-- Logs begin at Wed 2022-01-05 13:59:35 UTC, end at Wed 2022-01-05 15:21:22 UTC. -- Jan 05 14:38:17.283412 dv-cinder-master-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jan 05 14:38:17.290593 dv-cinder-master-3-iscsi devstack@keystone.service[90983]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jan 05 14:38:17.292597 dv-cinder-master-3-iscsi devstack@keystone.service[90983]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jan 5 14:38:17 2022] *** Jan 05 14:38:17.292597 dv-cinder-master-3-iscsi devstack@keystone.service[90983]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 05 14:38:17.292597 dv-cinder-master-3-iscsi devstack@keystone.service[90983]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 05 14:38:17.292597 dv-cinder-master-3-iscsi devstack@keystone.service[90983]: nodename: dv-cinder-master-3-iscsi Jan 05 14:38:17.292597 dv-cinder-master-3-iscsi devstack@keystone.service[90983]: machine: x86_64 Jan 05 14:38:17.292597 dv-cinder-master-3-iscsi devstack@keystone.service[90983]: clock source: unix Jan 05 14:38:17.292597 dv-cinder-master-3-iscsi devstack@keystone.service[90983]: pcre jit disabled Jan 05 14:38:17.293625 dv-cinder-master-3-iscsi devstack@keystone.service[90983]: detected number of CPU cores: 4 Jan 05 14:38:17.293625 dv-cinder-master-3-iscsi devstack@keystone.service[90983]: current working directory: / Jan 05 14:38:17.293625 dv-cinder-master-3-iscsi devstack@keystone.service[90983]: detected binary path: /usr/bin/uwsgi-core Jan 05 14:38:17.293625 dv-cinder-master-3-iscsi devstack@keystone.service[90983]: your processes number limit is 47680 Jan 05 14:38:17.293625 dv-cinder-master-3-iscsi devstack@keystone.service[90983]: your memory page size is 4096 bytes Jan 05 14:38:17.293625 dv-cinder-master-3-iscsi devstack@keystone.service[90983]: detected max file descriptor number: 2048 Jan 05 14:38:17.293625 dv-cinder-master-3-iscsi devstack@keystone.service[90983]: lock engine: pthread robust mutexes Jan 05 14:38:17.295618 dv-cinder-master-3-iscsi devstack@keystone.service[90983]: thunder lock: enabled Jan 05 14:38:17.295618 dv-cinder-master-3-iscsi devstack@keystone.service[90983]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jan 05 14:38:17.295618 dv-cinder-master-3-iscsi devstack@keystone.service[90983]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 05 14:38:17.346748 dv-cinder-master-3-iscsi devstack@keystone.service[90983]: Python main interpreter initialized at 0x56470eace9c0 Jan 05 14:38:17.346748 dv-cinder-master-3-iscsi devstack@keystone.service[90983]: python threads support enabled Jan 05 14:38:17.346748 dv-cinder-master-3-iscsi devstack@keystone.service[90983]: your server socket listen backlog is limited to 100 connections Jan 05 14:38:17.346748 dv-cinder-master-3-iscsi devstack@keystone.service[90983]: your mercy for graceful operations on workers is 90 seconds Jan 05 14:38:17.347122 dv-cinder-master-3-iscsi devstack@keystone.service[90983]: mapped 403077 bytes (393 KB) for 2 cores Jan 05 14:38:17.347198 dv-cinder-master-3-iscsi devstack@keystone.service[90983]: *** Operational MODE: preforking *** Jan 05 14:38:17.347420 dv-cinder-master-3-iscsi devstack@keystone.service[90983]: *** uWSGI is running in multiple interpreter mode *** Jan 05 14:38:17.347420 dv-cinder-master-3-iscsi devstack@keystone.service[90983]: spawned uWSGI master process (pid: 90983) Jan 05 14:38:17.347623 dv-cinder-master-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jan 05 14:38:17.348725 dv-cinder-master-3-iscsi devstack@keystone.service[90983]: spawned uWSGI worker 1 (pid: 90996, cores: 1) Jan 05 14:38:17.348725 dv-cinder-master-3-iscsi devstack@keystone.service[90983]: spawned uWSGI worker 2 (pid: 90997, cores: 1) Jan 05 14:38:17.348725 dv-cinder-master-3-iscsi devstack@keystone.service[90983]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 05 14:38:22.734871 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 05 14:38:22.734871 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: from cryptography.utils import int_from_bytes Jan 05 14:38:22.735652 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 05 14:38:22.735652 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: from cryptography.utils import int_from_bytes Jan 05 14:38:22.761932 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 05 14:38:22.761932 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: from cryptography.utils import int_from_bytes Jan 05 14:38:22.762400 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 05 14:38:22.762400 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: from cryptography.utils import int_from_bytes Jan 05 14:38:22.780631 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 05 14:38:22.780829 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 05 14:38:22.781031 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] command line args: [] {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 05 14:38:22.781341 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 05 14:38:22.781521 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ================================================================================ {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 05 14:38:22.781777 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] admin_token = **** {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.782025 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] config_dir = [] {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.782214 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.782400 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] config_source = [] {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.782581 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] debug = True {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.782781 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.784152 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.784152 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] insecure_debug = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.784152 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.784152 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.784152 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] list_limit = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.784624 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] log_config_append = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.784624 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.784624 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] log_dir = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.784930 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] log_file = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.784930 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.785183 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.785431 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.785679 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.785860 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.786039 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.786285 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.786534 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.786770 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.787007 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.787242 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.787476 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.787726 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.787972 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] notification_format = cadf {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.788249 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.788737 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.788920 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] publish_errors = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.789176 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.789410 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.789590 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.789837 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.790073 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.790312 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] standard_threads = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.790547 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] strict_password_check = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.790790 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.790974 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] use_eventlog = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.791152 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] use_journal = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.791330 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] use_json = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.791506 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] use_stderr = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.791683 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] use_syslog = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.791915 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] watch_log_file = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.792171 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.792410 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.792699 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.792946 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.793225 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.793473 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.793725 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.793966 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.794215 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.794464 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.794718 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.794955 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.795208 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.795450 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.795699 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.795947 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.796189 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.796445 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.796703 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.796951 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.797213 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.797471 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.797737 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.797994 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.798247 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.798482 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.798717 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.798950 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.799189 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.799441 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.799691 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.799924 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.800158 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.800408 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.800657 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.800912 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.801171 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.801408 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.801646 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.801885 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.802120 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.802353 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.802585 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.802817 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.803058 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.803308 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.803543 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.803785 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.804019 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.804259 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.804348 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 05 14:38:22.804498 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.804621 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 05 14:38:22.804723 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] command line args: [] {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 05 14:38:22.804825 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.804971 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.805147 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 05 14:38:22.805254 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ================================================================================ {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 05 14:38:22.805350 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.805447 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] admin_token = **** {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.805554 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.805660 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] config_dir = [] {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.805739 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.805863 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.805945 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.806064 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] config_source = [] {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.806147 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.806225 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] debug = True {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.806371 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.806479 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.806615 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.806701 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.806796 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] insecure_debug = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.806880 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.807050 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.807135 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.807282 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.807411 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.807523 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] list_limit = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.807611 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.807693 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] log_config_append = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.807765 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.807884 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.807997 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.808077 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] log_dir = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.808715 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] log_file = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.808795 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.808963 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.809045 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.809242 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.809329 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.809490 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.809563 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.809743 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.809825 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.809910 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.809982 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.810091 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.810221 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] cache.enabled = True {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.810343 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.810463 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.810591 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.810703 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.810829 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.810944 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.811068 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.811182 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.811306 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.811425 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.811542 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.811663 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.811792 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.811924 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.812040 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] notification_format = cadf {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.812168 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.812316 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.812401 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.812632 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.812812 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.812903 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.812996 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] publish_errors = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.813108 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.813257 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.813348 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.813491 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.813574 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.813671 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.813780 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.813920 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.814011 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.814158 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.814257 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.814396 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] standard_threads = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.814496 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.814632 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] strict_password_check = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.814755 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.814877 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.815013 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.815090 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] use_eventlog = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.815221 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] use_journal = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.815305 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.815385 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] use_json = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.815463 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] auth.external = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.815563 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] use_stderr = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.815693 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] auth.mapped = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.815774 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] use_syslog = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.815962 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] watch_log_file = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:38:22.816047 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.816205 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.816287 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.816437 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] auth.password = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.816515 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.816668 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] auth.token = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.816754 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.816908 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.816987 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.817168 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] catalog.caching = True {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.817250 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.817414 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.817504 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.817647 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.817724 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.817894 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.817971 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.818142 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.818227 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.818372 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.818450 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.818623 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] credential.caching = True {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.818700 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.818858 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.818944 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] credential.driver = sql {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.819108 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.819185 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.819348 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.819424 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.819584 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.819669 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.819832 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.819911 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.820070 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.820148 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.820328 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.820407 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.820584 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.820661 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.820824 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.820903 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.821095 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.821176 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.821339 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.821417 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.821604 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.821681 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.821862 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.821941 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.822106 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.822182 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.822339 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.822463 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.822556 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.822630 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] federation.caching = True {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.822793 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.822879 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.823033 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.823111 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] federation.driver = sql {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.823284 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.823363 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.823521 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.823596 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.823755 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.823865 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.824561 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.824643 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.824816 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.824893 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.825056 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.825148 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.825323 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.825401 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.825565 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.825649 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.825797 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.825874 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.826036 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.826115 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] identity.caching = True {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.826272 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.826349 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.826506 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.826583 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.826738 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.826816 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.826972 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.827050 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.827206 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.827289 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] identity.driver = sql {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.827440 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.827518 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.827682 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.827765 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.827914 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.827990 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.828161 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.828243 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.828396 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.828473 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.828627 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.828704 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.828860 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.828939 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.829130 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.829222 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.829369 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.829452 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.829613 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.829696 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.829856 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.829939 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.830098 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.830185 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.830345 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.830423 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.830586 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.830663 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.830819 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.830906 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.831050 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.831137 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.831292 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.831370 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.831531 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.831608 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.831764 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.831855 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.832007 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.832085 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.832250 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.832330 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.832483 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.832561 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.832718 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.832806 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.832955 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.833032 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.833225 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.833304 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.833464 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.833545 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.833714 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.833792 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.833952 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.834029 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.834184 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.834263 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] cache.enabled = True {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.834424 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.834503 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.834658 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.password = **** {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.834738 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.834897 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.834981 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.835137 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.835216 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.835377 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.835452 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.835617 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.835696 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.835867 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.835953 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.836115 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.836201 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.836360 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.836440 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.836594 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.836671 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.836824 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.836909 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.837058 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.837169 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.837320 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.837399 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.837555 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.837645 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.837793 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.837870 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.838029 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.838105 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.838260 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.user = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.838345 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.838504 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.838584 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.838761 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.838839 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.838994 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.839082 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.839245 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.839323 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.839516 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] auth.external = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.839593 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.839754 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] auth.mapped = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.839840 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.839991 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.840073 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.840225 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.840303 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.840464 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.840556 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] auth.password = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.840702 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.840780 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] auth.token = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.840942 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.841021 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.841199 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.841291 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] catalog.caching = True {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.841447 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.841525 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.841682 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.841761 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.841927 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.842012 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.842174 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.842253 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.842408 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.842491 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.842642 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.842728 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] credential.caching = True {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.842891 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] credential.driver = sql {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.842968 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.843129 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.843206 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.843368 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.843520 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.843602 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.843678 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.843833 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.843912 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.844080 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.844168 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.844328 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.844405 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.844568 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.844646 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.844810 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.844897 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] policy.driver = sql {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.845043 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.845196 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.845313 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.845392 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.845551 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.845645 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.845790 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] receipt.caching = True {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.845870 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.846030 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.846109 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.846279 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.846369 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.846522 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.846602 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] federation.caching = True {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.846757 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.846836 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.846995 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.847082 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] federation.driver = sql {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.847238 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] resource.caching = True {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.847322 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.847488 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.847566 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.847736 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] resource.driver = sql {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.847823 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.847975 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.848053 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.848225 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.848304 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.848465 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.848543 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.848715 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] revoke.caching = True {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.848792 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.848954 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.849032 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.849218 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.849300 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.849460 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] identity.caching = True {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.849537 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] role.cache_time = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.849697 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] role.caching = True {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.849774 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.849946 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] role.driver = sql {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.850026 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.850179 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] role.list_limit = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.850257 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.850422 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.850500 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.850670 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.850750 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] identity.driver = sql {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.850902 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.850979 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.851143 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.851222 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.851393 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.851472 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.851645 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.851722 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.851884 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.851961 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.852120 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.852199 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.852354 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.852431 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.852600 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.852677 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.852846 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.852925 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.853112 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.853197 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.853365 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.853443 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.853613 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.853759 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.853887 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.854002 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.854129 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.854257 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.854371 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.854512 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.854593 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.854765 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.854843 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.855017 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.855104 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.855277 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.855357 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.855534 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.855613 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.855775 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.855854 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.856021 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.856099 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.856251 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.856330 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.856485 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.856563 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.856719 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.856797 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.856962 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.857040 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.857242 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.857323 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.857494 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.857572 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.857730 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.857812 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.857968 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.858047 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.858200 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.password = **** {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.858308 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] token.cache_time = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.858442 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.858554 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] token.caching = True {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.858684 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.858799 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.858930 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.859053 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] token.provider = fernet {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.859182 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.859296 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.859426 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.859557 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.859679 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.859808 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.859929 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.860050 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.860162 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.860300 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.860401 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.860552 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.860655 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.860803 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] trust.driver = sql {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.860917 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.861046 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.861186 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.861316 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.861395 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.861563 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.861655 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.861814 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.861893 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.user = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.862066 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.862145 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.862299 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.862385 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.862546 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.862625 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.862795 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.862876 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.863045 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.863133 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] database.connection = **** {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.863295 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.863381 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.863534 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.863613 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.863767 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.863854 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.864006 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.864086 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.864242 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.864318 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.864479 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.864610 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.864714 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.864794 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.864951 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.865029 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.865220 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.865312 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.865469 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.865548 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.865716 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.865804 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.865955 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.866033 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.866185 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.866264 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.866430 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.866507 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.866667 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.866745 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.866894 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.866970 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.867133 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.867212 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.867373 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.867451 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.867530 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=90996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 05 14:38:22.867610 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.867859 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.868101 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.868357 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] policy.driver = sql {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.868590 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.868836 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.869086 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.869341 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] receipt.caching = True {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.869583 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.869834 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.870078 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.870318 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.870555 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.871384 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] resource.caching = True {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.871639 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.871889 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] resource.driver = sql {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.872130 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.872381 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.872635 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.872875 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] revoke.caching = True {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.873146 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.873389 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.873633 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] role.cache_time = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.873884 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] role.caching = True {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.874135 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] role.driver = sql {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.874371 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] role.list_limit = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.874624 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.874874 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.875124 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.875374 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.875622 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.875870 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.876119 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.876371 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.876606 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.876855 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.877127 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.877381 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.877630 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.878020 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.878258 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.878512 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.878764 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.879015 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.879267 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.879504 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.880026 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.880280 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.880523 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.880762 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.880997 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.881258 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.881516 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.881774 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.882027 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.882270 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.882511 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.882745 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] token.cache_time = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.882985 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] token.caching = True {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.883237 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.883489 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] token.provider = fernet {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.883730 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.883988 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.884238 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.884479 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.884727 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.884975 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.885248 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] trust.driver = sql {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.885489 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.885733 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.885973 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.886223 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.887026 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.887258 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.887506 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.887773 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.888046 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] database.connection = **** {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.888296 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.888546 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.888789 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.889034 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.889299 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.889542 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.889782 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.890021 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.890298 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.890540 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.890794 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.891035 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.891285 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.891524 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.891772 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.892006 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.892250 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.892488 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:38:22.892661 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=90997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 05 14:38:22.899123 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=90996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:22.899358 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=90996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:22.899586 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=90996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:22.908138 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=90996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:22.920096 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=90997) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:22.920464 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=90997) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:22.920819 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=90997) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:22.934238 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=90997) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:22.936825 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=90996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:22.937076 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=90996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:22.954546 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=90997) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:22.954776 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=90997) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.005845 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=90997) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.007060 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=90996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.055050 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=90997) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.055227 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=90997) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.055808 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=90996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.056048 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=90996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.120530 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.121334 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=90996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.121565 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=90996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.121787 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=90996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.122005 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=90996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.122220 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=90996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.123145 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90997) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.123384 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=90997) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.123614 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=90997) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.123842 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=90997) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.124064 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=90997) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.124280 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=90997) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.146118 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90997) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.146240 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.146351 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=90997) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.146433 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=90996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.146579 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=90997) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.146659 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=90996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.146804 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=90997) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.146884 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=90996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.147025 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=90997) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.147105 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=90996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.147243 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=90997) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.147322 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=90996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.147457 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=90996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.147538 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=90997) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.158529 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=90997) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.158952 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=90996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.171766 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90997) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.171948 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.172028 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=90997) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.172101 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=90996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.172210 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=90997) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.172290 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=90996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.172432 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=90997) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.172512 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=90996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.172650 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=90997) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.172730 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=90996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.172866 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=90997) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.172954 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=90996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.173103 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=90997) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.173228 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=90996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 05 14:38:23.190407 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.190621 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 05 14:38:23.190715 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.190839 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 05 14:38:23.190958 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.191159 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 05 14:38:23.191240 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.191366 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 05 14:38:23.191455 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.191638 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.191719 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.191902 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.192015 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.192163 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.192251 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.192419 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.203256 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.203533 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.203617 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.203887 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.203975 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.204160 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.204241 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.204448 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.212175 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=90997) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.212341 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=90996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.215959 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=90997) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.216158 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=90996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.216241 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.216441 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.216523 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.216768 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.216849 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.217046 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.217157 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.217332 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.217431 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.217599 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.217682 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.217867 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.217956 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.218138 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.218219 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.218410 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.218489 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.218683 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.218762 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.218950 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.244634 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.244732 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.246293 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=90996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.246387 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=90997) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.246572 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.246653 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.251686 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=90996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.251969 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.252049 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=90997) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.252249 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.252329 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.252549 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.259842 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=90996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.259996 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=90997) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.260280 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.260361 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.265231 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=90997) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.265521 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.265813 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.266097 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.266382 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.266660 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.267056 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.267333 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.267898 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=90996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.268292 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.268580 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.268913 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.269229 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.269510 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.269804 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.270075 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.285970 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.286253 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.289010 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.289314 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.290763 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=90997) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.293837 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=90996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.294328 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.294624 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.297397 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.297692 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.299475 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=90997) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.302606 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=90996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.302971 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=90997) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.306310 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=90996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.306508 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.306804 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.307084 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.307365 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.307641 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.308033 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.310380 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.310682 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.310966 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.311251 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.311530 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.311807 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.327625 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=90997) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.327907 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.328172 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.328443 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.331069 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=90996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.331355 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.331620 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.331883 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.336222 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.337926 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.338212 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.339581 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.341219 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=90997) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.341499 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.341782 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.341956 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.342075 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.342234 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.342356 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.345222 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=90996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.345510 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.345794 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.346096 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.346393 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.356679 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=90997) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.356962 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.357288 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.357572 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.357854 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.358131 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.358410 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.359485 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=90996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.359770 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.360059 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.360343 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.360626 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.360903 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.361205 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.376304 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=90997) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.379920 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=90997) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.380684 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=90996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.383165 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.383900 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=90996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.384725 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.386904 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=90997) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.387201 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.387482 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.387853 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.389436 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.391039 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=90996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.391330 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.391622 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.394559 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.396234 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=90997) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.398858 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.399406 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.399696 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.399978 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.400252 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.400440 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=90996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.403655 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.403948 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.404234 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.404512 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.409293 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=90997) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.409584 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.409863 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.413526 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=90996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.413816 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.414096 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.417687 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=90997) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.417970 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.418251 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.418528 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.418799 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.419078 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.419368 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.419639 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.419907 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.420189 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.420461 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.420723 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.420988 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.421286 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=90997) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.421810 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=90996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 05 14:38:23.422092 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.422374 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.422652 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.422925 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.423209 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.423484 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.423759 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.424029 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.424312 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.424590 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.424852 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.425248 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.425536 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=90996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 05 14:38:23.458743 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56470eace9c0 pid: 90997 (default app) Jan 05 14:38:23.461990 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9565a2-fa25-4f69-8d7e-bece46bb26a0 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:23.462281 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9565a2-fa25-4f69-8d7e-bece46bb26a0 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:23.462559 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9565a2-fa25-4f69-8d7e-bece46bb26a0 None None] PATH_INFO: `/v3` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:23.462921 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56470eace9c0 pid: 90996 (default app) Jan 05 14:38:23.467337 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 791 bytes} [Wed Jan 5 14:38:23 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:32.712144 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeafefc-6aa5-4db4-850d-1c392de2a356 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:32.712687 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeafefc-6aa5-4db4-850d-1c392de2a356 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:32.712687 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeafefc-6aa5-4db4-850d-1c392de2a356 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:32.717756 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1/2] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:38:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:38:32.724128 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c210c-963c-4995-9064-df85408f8983 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:32.724551 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c210c-963c-4995-9064-df85408f8983 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:32.724690 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c210c-963c-4995-9064-df85408f8983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:32.755099 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG oslo_db.sqlalchemy.engines [None req-9f5c210c-963c-4995-9064-df85408f8983 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=90997) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 14:38:33.035359 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG passlib.handlers.bcrypt [None req-9f5c210c-963c-4995-9064-df85408f8983 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=90997) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jan 05 14:38:33.035760 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG passlib.handlers.bcrypt [None req-9f5c210c-963c-4995-9064-df85408f8983 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=90997) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jan 05 14:38:33.091150 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-9f5c210c-963c-4995-9064-df85408f8983 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:38:33.096347 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-9f5c210c-963c-4995-9064-df85408f8983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:38:33.217166 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:38:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 494 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:38:33.374648 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeafefc-6aa5-4db4-850d-1c392de2a356 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:33.408004 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG oslo_db.sqlalchemy.engines [None req-fdeafefc-6aa5-4db4-850d-1c392de2a356 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=90996) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 14:38:33.636571 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeafefc-6aa5-4db4-850d-1c392de2a356 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:33.641293 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e51aa-79df-4fff-945b-6e9dd62e40ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:33.641942 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e51aa-79df-4fff-945b-6e9dd62e40ac admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:33.642246 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e51aa-79df-4fff-945b-6e9dd62e40ac admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:33.642522 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e51aa-79df-4fff-945b-6e9dd62e40ac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:33.650361 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e51aa-79df-4fff-945b-6e9dd62e40ac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:33.700185 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e57e51aa-79df-4fff-945b-6e9dd62e40ac admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jan 05 14:38:33.700521 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e51aa-79df-4fff-945b-6e9dd62e40ac admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:33.709806 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 2/4] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:38:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:38:33.715616 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c210c-963c-4995-9064-df85408f8983 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:33.730066 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c210c-963c-4995-9064-df85408f8983 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:33.734981 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b367a-5097-4d36-83b2-29be304ff688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:33.736107 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b367a-5097-4d36-83b2-29be304ff688 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:33.736390 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b367a-5097-4d36-83b2-29be304ff688 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:33.736663 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b367a-5097-4d36-83b2-29be304ff688 admin admin] PATH_INFO: `/v3/projects/df4f5a399f0847ef9e872ee655a1354c` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:33.738213 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b367a-5097-4d36-83b2-29be304ff688 admin admin] RBAC: Authorizing `identity:get_project(project_id=df4f5a399f0847ef9e872ee655a1354c)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:33.790331 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e95b367a-5097-4d36-83b2-29be304ff688 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jan 05 14:38:33.790696 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b367a-5097-4d36-83b2-29be304ff688 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:33.795849 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 3/5] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:38:33 2022] GET /identity/v3/projects/df4f5a399f0847ef9e872ee655a1354c => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:36.153227 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6355c9f-e346-4e98-8c5d-1d0d8834071d None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:36.153761 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6355c9f-e346-4e98-8c5d-1d0d8834071d None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:36.153761 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6355c9f-e346-4e98-8c5d-1d0d8834071d None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:36.158988 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 3/6] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:38:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 14:38:36.166638 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c1b7b-a3ed-4506-bede-e24eae3ec813 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:36.167071 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c1b7b-a3ed-4506-bede-e24eae3ec813 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:36.167192 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c1b7b-a3ed-4506-bede-e24eae3ec813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:36.186026 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-650c1b7b-a3ed-4506-bede-e24eae3ec813 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:38:36.187515 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-650c1b7b-a3ed-4506-bede-e24eae3ec813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:38:36.195305 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 4/7] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:38:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:38:36.219670 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6355c9f-e346-4e98-8c5d-1d0d8834071d None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:36.232245 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6355c9f-e346-4e98-8c5d-1d0d8834071d None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:36.236480 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479f767-56e4-4e02-8449-689b52f36538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:36.237134 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479f767-56e4-4e02-8449-689b52f36538 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:36.237424 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479f767-56e4-4e02-8449-689b52f36538 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:36.237701 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479f767-56e4-4e02-8449-689b52f36538 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:36.245219 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3479f767-56e4-4e02-8449-689b52f36538 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:36.246989 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3479f767-56e4-4e02-8449-689b52f36538 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:36.255742 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 4/8] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:38:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:38:36.260939 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c1b7b-a3ed-4506-bede-e24eae3ec813 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:36.269608 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c1b7b-a3ed-4506-bede-e24eae3ec813 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:36.273887 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cbd65-09cc-4ffa-a96e-e42ea7d54c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:36.274735 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cbd65-09cc-4ffa-a96e-e42ea7d54c18 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:36.275016 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cbd65-09cc-4ffa-a96e-e42ea7d54c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:36.275290 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cbd65-09cc-4ffa-a96e-e42ea7d54c18 admin admin] PATH_INFO: `/v3/users/a7c8dfde39e84abdb68271d16eaed381` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:36.276661 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073cbd65-09cc-4ffa-a96e-e42ea7d54c18 admin admin] RBAC: Authorizing `identity:get_user(user_id=a7c8dfde39e84abdb68271d16eaed381)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:36.279025 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073cbd65-09cc-4ffa-a96e-e42ea7d54c18 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:36.280539 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 5/9] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:38:36 2022] GET /identity/v3/users/a7c8dfde39e84abdb68271d16eaed381 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:38.730998 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95381ba8-9010-4bc5-a1cc-269760139859 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:38.731553 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95381ba8-9010-4bc5-a1cc-269760139859 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:38.731553 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95381ba8-9010-4bc5-a1cc-269760139859 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:38.733475 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 5/10] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:38:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:38:38.739892 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d929ee-74d2-4e3b-94e5-0b5fe5c4bbde None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:38.740555 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d929ee-74d2-4e3b-94e5-0b5fe5c4bbde None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:38.740555 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d929ee-74d2-4e3b-94e5-0b5fe5c4bbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:38.759471 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-03d929ee-74d2-4e3b-94e5-0b5fe5c4bbde None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:38:38.760576 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-03d929ee-74d2-4e3b-94e5-0b5fe5c4bbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:38:38.760753 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ca5b8-4308-4cda-9f3f-bc60cf94017e None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:38.761039 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ca5b8-4308-4cda-9f3f-bc60cf94017e None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:38.761340 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ca5b8-4308-4cda-9f3f-bc60cf94017e None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:38.763090 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 6/11] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 14:38:38.767949 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1b9ce-345c-4d59-a075-48af15ae7899 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:38.768232 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1b9ce-345c-4d59-a075-48af15ae7899 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:38.768510 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1b9ce-345c-4d59-a075-48af15ae7899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:38.768598 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 6/12] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:38:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:38:38.790751 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d929ee-74d2-4e3b-94e5-0b5fe5c4bbde None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:38.799882 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d929ee-74d2-4e3b-94e5-0b5fe5c4bbde None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:38.804225 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69da2d-12d3-47ba-88e2-c077cecf2e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:38.804857 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69da2d-12d3-47ba-88e2-c077cecf2e17 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:38.805174 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69da2d-12d3-47ba-88e2-c077cecf2e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:38.805452 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69da2d-12d3-47ba-88e2-c077cecf2e17 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:38.810296 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG passlib.handlers.bcrypt [None req-0dc1b9ce-345c-4d59-a075-48af15ae7899 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=90996) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jan 05 14:38:38.810728 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG passlib.handlers.bcrypt [None req-0dc1b9ce-345c-4d59-a075-48af15ae7899 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=90996) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jan 05 14:38:38.813740 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69da2d-12d3-47ba-88e2-c077cecf2e17 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:38.815507 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69da2d-12d3-47ba-88e2-c077cecf2e17 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:38.824037 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 7/13] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:38:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 05 14:38:38.829254 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69da2d-12d3-47ba-88e2-c077cecf2e17 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:38.837238 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69da2d-12d3-47ba-88e2-c077cecf2e17 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:38.841555 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f71b28-dfdf-49ca-8f62-a92d22d75420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:38.842264 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f71b28-dfdf-49ca-8f62-a92d22d75420 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:38.842549 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f71b28-dfdf-49ca-8f62-a92d22d75420 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:38.842825 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f71b28-dfdf-49ca-8f62-a92d22d75420 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:38.844104 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f71b28-dfdf-49ca-8f62-a92d22d75420 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:38.845838 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f71b28-dfdf-49ca-8f62-a92d22d75420 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:38.847423 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 8/14] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:38:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:38:38.857834 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-0dc1b9ce-345c-4d59-a075-48af15ae7899 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:38:38.859470 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-0dc1b9ce-345c-4d59-a075-48af15ae7899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:38:38.882599 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 7/15] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:38:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:38:38.909199 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f71b28-dfdf-49ca-8f62-a92d22d75420 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:38.919238 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f71b28-dfdf-49ca-8f62-a92d22d75420 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:38.923691 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac822f-7924-4f1e-8850-c357cf5e2bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:38.924494 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac822f-7924-4f1e-8850-c357cf5e2bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:38.924776 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac822f-7924-4f1e-8850-c357cf5e2bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:38.925051 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac822f-7924-4f1e-8850-c357cf5e2bd2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:38.939157 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac822f-7924-4f1e-8850-c357cf5e2bd2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:38:38.946590 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-baac822f-7924-4f1e-8850-c357cf5e2bd2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 05 14:38:38.948029 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 9/16] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:38:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:38:38.954367 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1b9ce-345c-4d59-a075-48af15ae7899 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:38.964057 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1b9ce-345c-4d59-a075-48af15ae7899 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:38.969414 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34058512-192e-4ecc-b7db-a4d6b0e04bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:38.970524 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34058512-192e-4ecc-b7db-a4d6b0e04bab admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:38.970883 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34058512-192e-4ecc-b7db-a4d6b0e04bab admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:38.971232 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34058512-192e-4ecc-b7db-a4d6b0e04bab admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:38.972267 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34058512-192e-4ecc-b7db-a4d6b0e04bab admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:38:38.972648 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34058512-192e-4ecc-b7db-a4d6b0e04bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:38.974620 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING py.warnings [None req-34058512-192e-4ecc-b7db-a4d6b0e04bab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:38:38.974620 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: warnings.warn(msg) Jan 05 14:38:38.974620 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: Jan 05 14:38:38.975726 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34058512-192e-4ecc-b7db-a4d6b0e04bab admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:38.993595 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 8/17] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:38:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:38.999873 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac822f-7924-4f1e-8850-c357cf5e2bd2 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:39.010328 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac822f-7924-4f1e-8850-c357cf5e2bd2 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:39.014673 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fc00d-50c8-4480-97b7-88ac7ba38ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:39.015558 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fc00d-50c8-4480-97b7-88ac7ba38ddb admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:39.015838 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fc00d-50c8-4480-97b7-88ac7ba38ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:39.016111 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fc00d-50c8-4480-97b7-88ac7ba38ddb admin admin] PATH_INFO: `/v3/users/a7c8dfde39e84abdb68271d16eaed381` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:39.017391 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fc00d-50c8-4480-97b7-88ac7ba38ddb admin admin] RBAC: Authorizing `identity:get_user(user_id=a7c8dfde39e84abdb68271d16eaed381)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:39.019251 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fc00d-50c8-4480-97b7-88ac7ba38ddb admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:39.020874 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 10/18] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:38:38 2022] GET /identity/v3/users/a7c8dfde39e84abdb68271d16eaed381 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:39.026708 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34058512-192e-4ecc-b7db-a4d6b0e04bab admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:39.036837 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34058512-192e-4ecc-b7db-a4d6b0e04bab admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:39.041354 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39984b-96c6-4a18-b101-78458856e9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:39.042156 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39984b-96c6-4a18-b101-78458856e9ef admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:39.042436 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39984b-96c6-4a18-b101-78458856e9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:39.042710 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39984b-96c6-4a18-b101-78458856e9ef admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:39.044641 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39984b-96c6-4a18-b101-78458856e9ef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:39.046419 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39984b-96c6-4a18-b101-78458856e9ef admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:39.048137 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 9/19] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:38:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:39.054038 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fc00d-50c8-4480-97b7-88ac7ba38ddb admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:39.064263 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fc00d-50c8-4480-97b7-88ac7ba38ddb admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:39.068610 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf14a4-1976-408a-881a-a1675b7c4cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:39.069278 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf14a4-1976-408a-881a-a1675b7c4cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:39.069563 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf14a4-1976-408a-881a-a1675b7c4cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:39.069839 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf14a4-1976-408a-881a-a1675b7c4cb4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:39.070703 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf14a4-1976-408a-881a-a1675b7c4cb4 admin admin] RBAC: Adding query filter params (role.id=494131614fcf424f92e0817fa7ff6961, scope.domain.id=default, user.id=a7c8dfde39e84abdb68271d16eaed381) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:38:39.070979 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf14a4-1976-408a-881a-a1675b7c4cb4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:39.072752 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING py.warnings [None req-33cf14a4-1976-408a-881a-a1675b7c4cb4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:38:39.072752 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: warnings.warn(msg) Jan 05 14:38:39.072752 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: Jan 05 14:38:39.073933 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf14a4-1976-408a-881a-a1675b7c4cb4 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:39.081124 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 11/20] 10.222.0.30 () {56 vars in 1343 bytes} [Wed Jan 5 14:38:39 2022] GET /identity/v3/role_assignments?user.id=a7c8dfde39e84abdb68271d16eaed381&scope.domain.id=default&role.id=494131614fcf424f92e0817fa7ff6961 => generated 233 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:41.873844 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429ae57-8d2d-4501-8ca3-25292ce3c5bb None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:41.977330 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429ae57-8d2d-4501-8ca3-25292ce3c5bb None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:41.977330 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429ae57-8d2d-4501-8ca3-25292ce3c5bb None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:41.977330 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 10/21] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:38:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:38:41.977983 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1c8ca-9ead-4b35-b6db-1bb76b622e05 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:41.977983 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1c8ca-9ead-4b35-b6db-1bb76b622e05 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:41.977983 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1c8ca-9ead-4b35-b6db-1bb76b622e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:41.977983 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-23b1c8ca-9ead-4b35-b6db-1bb76b622e05 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:38:41.977983 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-23b1c8ca-9ead-4b35-b6db-1bb76b622e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:38:41.977983 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 12/22] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:38:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:38:41.992927 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429ae57-8d2d-4501-8ca3-25292ce3c5bb None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:42.006889 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429ae57-8d2d-4501-8ca3-25292ce3c5bb None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:42.014629 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81df40-9e1e-49c3-95d2-cc54e825c027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:42.015294 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81df40-9e1e-49c3-95d2-cc54e825c027 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:42.015581 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81df40-9e1e-49c3-95d2-cc54e825c027 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:42.015860 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81df40-9e1e-49c3-95d2-cc54e825c027 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:42.016638 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f81df40-9e1e-49c3-95d2-cc54e825c027 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:42.017705 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING py.warnings [None req-9f81df40-9e1e-49c3-95d2-cc54e825c027 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:38:42.017705 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: warnings.warn(msg) Jan 05 14:38:42.017705 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: Jan 05 14:38:42.018620 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f81df40-9e1e-49c3-95d2-cc54e825c027 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:42.048531 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c7a05-ee03-4104-b13d-d828a959219a None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:42.048868 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c7a05-ee03-4104-b13d-d828a959219a None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:42.049118 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c7a05-ee03-4104-b13d-d828a959219a None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:42.051154 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 13/23] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:38:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 14:38:42.055942 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38817e19-0335-42c5-8782-7252c08b4a7d None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:42.056288 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38817e19-0335-42c5-8782-7252c08b4a7d None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:42.056580 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38817e19-0335-42c5-8782-7252c08b4a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:42.089131 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-38817e19-0335-42c5-8782-7252c08b4a7d None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:38:42.090556 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-38817e19-0335-42c5-8782-7252c08b4a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:38:42.098705 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 14/24] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:38:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:38:42.149454 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38817e19-0335-42c5-8782-7252c08b4a7d None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:42.172795 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38817e19-0335-42c5-8782-7252c08b4a7d None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:42.177546 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d65ee-57e3-4fbf-876c-2f77a837821d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:42.178505 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d65ee-57e3-4fbf-876c-2f77a837821d admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:42.178810 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d65ee-57e3-4fbf-876c-2f77a837821d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:42.179085 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d65ee-57e3-4fbf-876c-2f77a837821d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:42.207025 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d65ee-57e3-4fbf-876c-2f77a837821d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:38:42.214259 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-838d65ee-57e3-4fbf-876c-2f77a837821d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 05 14:38:42.215504 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 15/25] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:38:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:38:42.230055 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d65ee-57e3-4fbf-876c-2f77a837821d admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:42.248089 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d65ee-57e3-4fbf-876c-2f77a837821d admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:42.263221 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abdc7c-c6e1-44a8-8281-50320027a6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:42.263911 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abdc7c-c6e1-44a8-8281-50320027a6ec admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:42.264190 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abdc7c-c6e1-44a8-8281-50320027a6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:42.264464 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abdc7c-c6e1-44a8-8281-50320027a6ec admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:42.265263 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47abdc7c-c6e1-44a8-8281-50320027a6ec admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:38:42.265565 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47abdc7c-c6e1-44a8-8281-50320027a6ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:42.266577 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING py.warnings [None req-47abdc7c-c6e1-44a8-8281-50320027a6ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:38:42.266577 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: warnings.warn(msg) Jan 05 14:38:42.266577 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: Jan 05 14:38:42.267470 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47abdc7c-c6e1-44a8-8281-50320027a6ec admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:42.288952 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 16/26] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:38:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:42.294661 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abdc7c-c6e1-44a8-8281-50320027a6ec admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:42.300602 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 11/27] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 14:38:41 2022] POST /identity/v3/roles => generated 219 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:38:42.314831 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abdc7c-c6e1-44a8-8281-50320027a6ec admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:42.322287 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7d252-b12b-4129-965d-cd442e1f34c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:42.323208 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7d252-b12b-4129-965d-cd442e1f34c9 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:42.323498 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7d252-b12b-4129-965d-cd442e1f34c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:42.323780 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7d252-b12b-4129-965d-cd442e1f34c9 admin admin] PATH_INFO: `/v3/users/a7c8dfde39e84abdb68271d16eaed381` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:42.325774 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d7d252-b12b-4129-965d-cd442e1f34c9 admin admin] RBAC: Authorizing `identity:get_user(user_id=a7c8dfde39e84abdb68271d16eaed381)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:42.327640 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d7d252-b12b-4129-965d-cd442e1f34c9 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:42.329505 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 17/28] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:38:42 2022] GET /identity/v3/users/a7c8dfde39e84abdb68271d16eaed381 => generated 247 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:38:42.334896 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81df40-9e1e-49c3-95d2-cc54e825c027 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:42.346641 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81df40-9e1e-49c3-95d2-cc54e825c027 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:42.353766 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea3025-3df7-4d51-bc0f-a579309c089f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:42.354580 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea3025-3df7-4d51-bc0f-a579309c089f admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:42.354871 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea3025-3df7-4d51-bc0f-a579309c089f admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:42.355155 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea3025-3df7-4d51-bc0f-a579309c089f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:42.356542 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea3025-3df7-4d51-bc0f-a579309c089f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:42.358453 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea3025-3df7-4d51-bc0f-a579309c089f admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:42.360101 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 12/29] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:38:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:42.366115 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7d252-b12b-4129-965d-cd442e1f34c9 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:42.378335 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7d252-b12b-4129-965d-cd442e1f34c9 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:42.381239 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257e8b1-5b5d-482f-947e-50208f386792 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:42.381542 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257e8b1-5b5d-482f-947e-50208f386792 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:42.381821 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257e8b1-5b5d-482f-947e-50208f386792 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:42.384200 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 13/30] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:38:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 14:38:42.390049 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656ce67-3518-4b01-826e-a4a325548d43 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:42.390529 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656ce67-3518-4b01-826e-a4a325548d43 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:42.390825 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656ce67-3518-4b01-826e-a4a325548d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:42.394222 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31c8d0-9423-48c7-bf9b-3d07eda22fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:42.395125 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31c8d0-9423-48c7-bf9b-3d07eda22fd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:42.395404 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31c8d0-9423-48c7-bf9b-3d07eda22fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:42.395679 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31c8d0-9423-48c7-bf9b-3d07eda22fd3 admin admin] PATH_INFO: `/v3/domains/default/users/a7c8dfde39e84abdb68271d16eaed381/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:42.397966 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31c8d0-9423-48c7-bf9b-3d07eda22fd3 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a7c8dfde39e84abdb68271d16eaed381, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:42.399033 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING py.warnings [None req-fb31c8d0-9423-48c7-bf9b-3d07eda22fd3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:38:42.399033 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: warnings.warn(msg) Jan 05 14:38:42.399033 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: Jan 05 14:38:42.401123 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31c8d0-9423-48c7-bf9b-3d07eda22fd3 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:42.430321 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-7656ce67-3518-4b01-826e-a4a325548d43 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:38:42.431960 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-7656ce67-3518-4b01-826e-a4a325548d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:38:42.448488 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 14/31] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:38:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:38:42.486050 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656ce67-3518-4b01-826e-a4a325548d43 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:42.498954 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656ce67-3518-4b01-826e-a4a325548d43 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:42.505694 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd09c9f-3910-4835-899f-a55e09609b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:42.506521 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd09c9f-3910-4835-899f-a55e09609b8a admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:42.506809 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd09c9f-3910-4835-899f-a55e09609b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:42.507091 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd09c9f-3910-4835-899f-a55e09609b8a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:42.559801 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd09c9f-3910-4835-899f-a55e09609b8a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:42.561744 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd09c9f-3910-4835-899f-a55e09609b8a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:42.588267 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-6bd09c9f-3910-4835-899f-a55e09609b8a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:38:42.590605 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 15/32] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:38:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:38:42.596298 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca166e58-a672-4120-bd12-0b2064d2f369 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:42.596298 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca166e58-a672-4120-bd12-0b2064d2f369 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:42.596298 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca166e58-a672-4120-bd12-0b2064d2f369 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:42.596298 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 16/33] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:38:42.596298 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca166e58-a672-4120-bd12-0b2064d2f369 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:42.672283 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 18/34] 10.222.0.30 () {58 vars in 1382 bytes} [Wed Jan 5 14:38:42 2022] PUT /identity/v3/domains/default/users/a7c8dfde39e84abdb68271d16eaed381/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:38:42.674500 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432885c6-9ede-48d5-9895-3241a4e79ab4 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:42.675038 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432885c6-9ede-48d5-9895-3241a4e79ab4 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:42.675435 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca166e58-a672-4120-bd12-0b2064d2f369 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:42.675721 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432885c6-9ede-48d5-9895-3241a4e79ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:42.680604 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a75503-8732-4b42-8f2f-d19e23946989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:42.681528 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a75503-8732-4b42-8f2f-d19e23946989 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:42.681928 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a75503-8732-4b42-8f2f-d19e23946989 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:42.687434 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a75503-8732-4b42-8f2f-d19e23946989 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:42.687434 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a75503-8732-4b42-8f2f-d19e23946989 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:38:42.687434 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a75503-8732-4b42-8f2f-d19e23946989 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:42.687434 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING py.warnings [None req-22a75503-8732-4b42-8f2f-d19e23946989 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:38:42.687434 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: warnings.warn(msg) Jan 05 14:38:42.687434 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: Jan 05 14:38:42.687434 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a75503-8732-4b42-8f2f-d19e23946989 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:42.710410 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-432885c6-9ede-48d5-9895-3241a4e79ab4 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:38:42.712670 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 17/35] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:42.714538 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-432885c6-9ede-48d5-9895-3241a4e79ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:38:42.718663 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a75503-8732-4b42-8f2f-d19e23946989 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:42.735216 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a75503-8732-4b42-8f2f-d19e23946989 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:42.736821 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 19/36] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:38:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:38:42.749322 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da315aa5-202a-49e8-a467-a5ccaee3036b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:42.750298 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da315aa5-202a-49e8-a467-a5ccaee3036b admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:42.750736 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da315aa5-202a-49e8-a467-a5ccaee3036b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:42.751179 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da315aa5-202a-49e8-a467-a5ccaee3036b admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:42.752081 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da315aa5-202a-49e8-a467-a5ccaee3036b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:42.753386 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING py.warnings [None req-da315aa5-202a-49e8-a467-a5ccaee3036b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:38:42.753386 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: warnings.warn(msg) Jan 05 14:38:42.753386 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: Jan 05 14:38:42.755183 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da315aa5-202a-49e8-a467-a5ccaee3036b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:42.780029 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432885c6-9ede-48d5-9895-3241a4e79ab4 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:42.792664 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432885c6-9ede-48d5-9895-3241a4e79ab4 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:42.797654 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5956e26-9c56-4e73-9008-89d611206a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:42.798386 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5956e26-9c56-4e73-9008-89d611206a5f admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:42.798764 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5956e26-9c56-4e73-9008-89d611206a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:42.799047 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5956e26-9c56-4e73-9008-89d611206a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:42.799832 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5956e26-9c56-4e73-9008-89d611206a5f admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:42.801432 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING py.warnings [None req-e5956e26-9c56-4e73-9008-89d611206a5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:38:42.801432 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: warnings.warn(msg) Jan 05 14:38:42.801432 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: Jan 05 14:38:42.802453 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5956e26-9c56-4e73-9008-89d611206a5f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:42.857631 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 18/37] 10.222.0.30 () {60 vars in 1162 bytes} [Wed Jan 5 14:38:42 2022] POST /identity/v3/projects => generated 301 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:38:42.923209 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 20/38] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 14:38:42 2022] POST /identity/v3/roles => generated 225 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 14:38:42.966691 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effadc5a-f82d-4852-9395-631270233319 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:42.967418 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effadc5a-f82d-4852-9395-631270233319 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:42.967418 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effadc5a-f82d-4852-9395-631270233319 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:42.970050 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 19/39] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:38:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:38:42.976023 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785c9fe-be4f-4832-8b38-d05455ec56df None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:42.976574 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785c9fe-be4f-4832-8b38-d05455ec56df None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:42.977004 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785c9fe-be4f-4832-8b38-d05455ec56df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:42.999720 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-8785c9fe-be4f-4832-8b38-d05455ec56df None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:38:43.002139 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-8785c9fe-be4f-4832-8b38-d05455ec56df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:38:43.083056 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 21/40] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:38:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:38:43.111560 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effadc5a-f82d-4852-9395-631270233319 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:43.126188 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effadc5a-f82d-4852-9395-631270233319 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:43.131833 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf90158-a464-44e2-9352-b245383abb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:43.133176 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf90158-a464-44e2-9352-b245383abb18 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:43.133618 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf90158-a464-44e2-9352-b245383abb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:43.134045 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf90158-a464-44e2-9352-b245383abb18 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:43.135231 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf90158-a464-44e2-9352-b245383abb18 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:43.137228 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf90158-a464-44e2-9352-b245383abb18 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:43.210764 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 14:38:43 2022] POST /identity/v3/roles => generated 223 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:38:43.657936 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b52fd-2a86-470e-851c-604df7329abd None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:43.658285 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b52fd-2a86-470e-851c-604df7329abd None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:43.658502 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b52fd-2a86-470e-851c-604df7329abd None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:43.660308 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 22/42] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:38:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:38:43.665658 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3bd79-edc9-43fd-9c28-c88ff8fb8f45 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:43.665961 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3bd79-edc9-43fd-9c28-c88ff8fb8f45 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:43.666248 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3bd79-edc9-43fd-9c28-c88ff8fb8f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:43.684706 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-69d3bd79-edc9-43fd-9c28-c88ff8fb8f45 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:38:43.685988 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-69d3bd79-edc9-43fd-9c28-c88ff8fb8f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:38:43.697298 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 21/43] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:38:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:38:43.722129 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b52fd-2a86-470e-851c-604df7329abd None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:43.738710 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b52fd-2a86-470e-851c-604df7329abd None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:43.743111 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a8fc6-13dd-4d8b-b482-53bf5137f241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:43.743903 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a8fc6-13dd-4d8b-b482-53bf5137f241 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:43.744188 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a8fc6-13dd-4d8b-b482-53bf5137f241 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:43.744467 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a8fc6-13dd-4d8b-b482-53bf5137f241 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:43.745687 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a8fc6-13dd-4d8b-b482-53bf5137f241 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:43.747525 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a8fc6-13dd-4d8b-b482-53bf5137f241 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:43.749331 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 23/44] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:38:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:43.754938 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d3bd79-edc9-43fd-9c28-c88ff8fb8f45 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:43.764204 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d3bd79-edc9-43fd-9c28-c88ff8fb8f45 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:43.768628 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19c996-1c9c-42a2-93ea-cb17977b2679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:43.769332 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19c996-1c9c-42a2-93ea-cb17977b2679 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:43.769623 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19c996-1c9c-42a2-93ea-cb17977b2679 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:43.769906 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19c996-1c9c-42a2-93ea-cb17977b2679 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:43.770652 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f19c996-1c9c-42a2-93ea-cb17977b2679 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:43.772622 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f19c996-1c9c-42a2-93ea-cb17977b2679 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:43.861511 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1162 bytes} [Wed Jan 5 14:38:43 2022] POST /identity/v3/projects => generated 312 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:38:45.290317 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76bd92-77b9-434b-8c85-dd1ff59b9b1e None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:45.290836 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76bd92-77b9-434b-8c85-dd1ff59b9b1e None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:45.290910 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76bd92-77b9-434b-8c85-dd1ff59b9b1e None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:45.292636 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 24/46] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:38:45.298570 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b4ee0-b190-4fac-ab45-06f30d068c71 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:45.299006 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b4ee0-b190-4fac-ab45-06f30d068c71 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:45.299130 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b4ee0-b190-4fac-ab45-06f30d068c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:45.316864 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-295b4ee0-b190-4fac-ab45-06f30d068c71 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:38:45.318068 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-295b4ee0-b190-4fac-ab45-06f30d068c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:38:45.372799 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 23/47] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:38:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:38:45.397990 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76bd92-77b9-434b-8c85-dd1ff59b9b1e None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:45.409951 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76bd92-77b9-434b-8c85-dd1ff59b9b1e None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:45.414230 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13427b03-2158-4307-9d5b-cafa819be825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:45.415076 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13427b03-2158-4307-9d5b-cafa819be825 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:45.415430 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13427b03-2158-4307-9d5b-cafa819be825 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:45.415777 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13427b03-2158-4307-9d5b-cafa819be825 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:45.426142 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13427b03-2158-4307-9d5b-cafa819be825 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:38:45.433236 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-13427b03-2158-4307-9d5b-cafa819be825 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 05 14:38:45.434974 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 25/48] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:38:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:38:45.440332 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b4ee0-b190-4fac-ab45-06f30d068c71 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:45.449007 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b4ee0-b190-4fac-ab45-06f30d068c71 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:45.453844 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc113ef7-59f9-4292-9929-ada7ec82251a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:45.454494 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc113ef7-59f9-4292-9929-ada7ec82251a admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:45.454783 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc113ef7-59f9-4292-9929-ada7ec82251a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:45.455063 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc113ef7-59f9-4292-9929-ada7ec82251a admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:45.455826 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc113ef7-59f9-4292-9929-ada7ec82251a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:38:45.456133 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc113ef7-59f9-4292-9929-ada7ec82251a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:45.457808 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc113ef7-59f9-4292-9929-ada7ec82251a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:45.466434 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 24/49] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:38:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:45.471512 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13427b03-2158-4307-9d5b-cafa819be825 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:45.481179 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13427b03-2158-4307-9d5b-cafa819be825 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:45.485524 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5302da-0307-4f63-98a2-16ad61ceb17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:45.486346 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5302da-0307-4f63-98a2-16ad61ceb17f admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:45.486631 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5302da-0307-4f63-98a2-16ad61ceb17f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:45.486908 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5302da-0307-4f63-98a2-16ad61ceb17f admin admin] PATH_INFO: `/v3/users/a7c8dfde39e84abdb68271d16eaed381` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:45.488103 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5302da-0307-4f63-98a2-16ad61ceb17f admin admin] RBAC: Authorizing `identity:get_user(user_id=a7c8dfde39e84abdb68271d16eaed381)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:45.490012 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5302da-0307-4f63-98a2-16ad61ceb17f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:45.491708 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 26/50] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:38:45 2022] GET /identity/v3/users/a7c8dfde39e84abdb68271d16eaed381 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:45.496614 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc113ef7-59f9-4292-9929-ada7ec82251a admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:45.506904 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc113ef7-59f9-4292-9929-ada7ec82251a admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:45.512605 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96eb75a-c034-48aa-89dc-bd92e00fdf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:45.513422 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96eb75a-c034-48aa-89dc-bd92e00fdf76 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:45.513707 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96eb75a-c034-48aa-89dc-bd92e00fdf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:45.513987 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96eb75a-c034-48aa-89dc-bd92e00fdf76 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:45.515188 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96eb75a-c034-48aa-89dc-bd92e00fdf76 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:45.516925 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96eb75a-c034-48aa-89dc-bd92e00fdf76 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:45.518542 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 25/51] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:38:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:45.524217 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5302da-0307-4f63-98a2-16ad61ceb17f admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:45.534732 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5302da-0307-4f63-98a2-16ad61ceb17f admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:45.539110 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71881579-e2dc-410e-bd8b-adef20ccf239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:45.539739 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71881579-e2dc-410e-bd8b-adef20ccf239 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:45.540020 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71881579-e2dc-410e-bd8b-adef20ccf239 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:45.540294 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71881579-e2dc-410e-bd8b-adef20ccf239 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:45.541212 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71881579-e2dc-410e-bd8b-adef20ccf239 admin admin] RBAC: Adding query filter params (role.id=494131614fcf424f92e0817fa7ff6961, scope.domain.id=default, user.id=a7c8dfde39e84abdb68271d16eaed381) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:38:45.541474 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71881579-e2dc-410e-bd8b-adef20ccf239 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:45.543371 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71881579-e2dc-410e-bd8b-adef20ccf239 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:45.548961 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 27/52] 10.222.0.30 () {56 vars in 1343 bytes} [Wed Jan 5 14:38:45 2022] GET /identity/v3/role_assignments?user.id=a7c8dfde39e84abdb68271d16eaed381&scope.domain.id=default&role.id=494131614fcf424f92e0817fa7ff6961 => generated 530 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:46.290025 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86885493-6594-4e5e-9da2-9067f360e08d None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:46.290320 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86885493-6594-4e5e-9da2-9067f360e08d None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:46.290601 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86885493-6594-4e5e-9da2-9067f360e08d None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:46.292373 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 26/53] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:38:46.297471 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ddc94-3b20-4b3d-af88-282b271108c7 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:46.297897 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ddc94-3b20-4b3d-af88-282b271108c7 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:46.298033 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ddc94-3b20-4b3d-af88-282b271108c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:46.315150 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-e43ddc94-3b20-4b3d-af88-282b271108c7 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:38:46.316324 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-e43ddc94-3b20-4b3d-af88-282b271108c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:38:46.323886 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 28/54] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:38:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:38:46.349588 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86885493-6594-4e5e-9da2-9067f360e08d None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:46.361769 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86885493-6594-4e5e-9da2-9067f360e08d None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:46.366191 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee2a2e-4494-4f7c-ab05-32c246e79f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:46.366967 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee2a2e-4494-4f7c-ab05-32c246e79f19 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:46.367253 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee2a2e-4494-4f7c-ab05-32c246e79f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:46.367534 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee2a2e-4494-4f7c-ab05-32c246e79f19 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:46.368713 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee2a2e-4494-4f7c-ab05-32c246e79f19 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:46.370454 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee2a2e-4494-4f7c-ab05-32c246e79f19 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:46.372038 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 27/55] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:38:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:46.378355 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ddc94-3b20-4b3d-af88-282b271108c7 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:46.387947 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ddc94-3b20-4b3d-af88-282b271108c7 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:46.392289 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efba98-4a36-43d6-b2e3-ce14de476ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:46.392929 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efba98-4a36-43d6-b2e3-ce14de476ff6 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:46.393252 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efba98-4a36-43d6-b2e3-ce14de476ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:46.393532 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efba98-4a36-43d6-b2e3-ce14de476ff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:46.394238 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8efba98-4a36-43d6-b2e3-ce14de476ff6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:46.395278 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING py.warnings [None req-a8efba98-4a36-43d6-b2e3-ce14de476ff6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:38:46.395278 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: warnings.warn(msg) Jan 05 14:38:46.395278 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: Jan 05 14:38:46.396524 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8efba98-4a36-43d6-b2e3-ce14de476ff6 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:46.607517 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 29/56] 10.222.0.30 () {60 vars in 1161 bytes} [Wed Jan 5 14:38:46 2022] POST /identity/v3/projects => generated 298 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:38:48.982297 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30df27-5885-419a-ab06-ea9543b661b2 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:48.982814 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30df27-5885-419a-ab06-ea9543b661b2 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:48.982898 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30df27-5885-419a-ab06-ea9543b661b2 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:48.984605 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 28/57] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:38:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:38:48.989851 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3047243-a2ca-4700-9d1e-cb8960a32115 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:48.990262 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3047243-a2ca-4700-9d1e-cb8960a32115 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:48.990421 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3047243-a2ca-4700-9d1e-cb8960a32115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:49.007812 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-e3047243-a2ca-4700-9d1e-cb8960a32115 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:38:49.008986 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-e3047243-a2ca-4700-9d1e-cb8960a32115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:38:49.063428 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 30/58] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:38:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:38:49.088443 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30df27-5885-419a-ab06-ea9543b661b2 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:49.100620 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30df27-5885-419a-ab06-ea9543b661b2 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:49.104795 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab79a1-61f7-44f7-8d95-cd9998dc6a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:49.106193 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab79a1-61f7-44f7-8d95-cd9998dc6a3e admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:49.106481 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab79a1-61f7-44f7-8d95-cd9998dc6a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:49.106758 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab79a1-61f7-44f7-8d95-cd9998dc6a3e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:49.107930 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab79a1-61f7-44f7-8d95-cd9998dc6a3e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:49.109669 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab79a1-61f7-44f7-8d95-cd9998dc6a3e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:49.112175 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 29/59] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:38:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:49.117149 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3047243-a2ca-4700-9d1e-cb8960a32115 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:49.125755 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3047243-a2ca-4700-9d1e-cb8960a32115 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:49.130351 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866e951-f1f1-49c5-bf68-398b0580bce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:49.130999 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866e951-f1f1-49c5-bf68-398b0580bce8 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:49.131286 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866e951-f1f1-49c5-bf68-398b0580bce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:49.131567 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866e951-f1f1-49c5-bf68-398b0580bce8 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:49.132294 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9866e951-f1f1-49c5-bf68-398b0580bce8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:49.133352 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING py.warnings [None req-9866e951-f1f1-49c5-bf68-398b0580bce8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:38:49.133352 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: warnings.warn(msg) Jan 05 14:38:49.133352 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: Jan 05 14:38:49.134580 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9866e951-f1f1-49c5-bf68-398b0580bce8 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:49.268914 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 31/60] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Jan 5 14:38:49 2022] POST /identity/v3/users => generated 275 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 14:38:53.336420 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669368bf-1b38-443d-a539-cf86ec9e9ce9 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:53.337247 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669368bf-1b38-443d-a539-cf86ec9e9ce9 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:53.337247 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669368bf-1b38-443d-a539-cf86ec9e9ce9 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:53.339026 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 30/61] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:38:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:38:53.345405 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b66e6-5c8c-44ab-9763-2315e8f882a9 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:53.346046 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b66e6-5c8c-44ab-9763-2315e8f882a9 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:53.346351 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b66e6-5c8c-44ab-9763-2315e8f882a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:53.389506 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-661b66e6-5c8c-44ab-9763-2315e8f882a9 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:38:53.391481 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-661b66e6-5c8c-44ab-9763-2315e8f882a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:38:53.413056 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 32/62] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:38:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:38:53.456503 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a956ac-08a9-4a0f-8e9d-165ed009f18e None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:53.457105 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a956ac-08a9-4a0f-8e9d-165ed009f18e None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:53.457537 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a956ac-08a9-4a0f-8e9d-165ed009f18e None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:53.459444 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 31/63] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:38:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 14:38:53.467919 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a956ac-08a9-4a0f-8e9d-165ed009f18e None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:53.468257 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba4509-a921-43f3-a2db-b3ff83b5c6f6 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:53.469055 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba4509-a921-43f3-a2db-b3ff83b5c6f6 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:53.469842 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba4509-a921-43f3-a2db-b3ff83b5c6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:53.484280 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a956ac-08a9-4a0f-8e9d-165ed009f18e None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:53.488979 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a521b4-c504-4cac-bd65-6574dad65c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:53.490156 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a521b4-c504-4cac-bd65-6574dad65c0c admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:53.490672 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a521b4-c504-4cac-bd65-6574dad65c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:53.491148 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a521b4-c504-4cac-bd65-6574dad65c0c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:53.505726 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a521b4-c504-4cac-bd65-6574dad65c0c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:38:53.510178 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-a1ba4509-a921-43f3-a2db-b3ff83b5c6f6 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:38:53.511780 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-a1ba4509-a921-43f3-a2db-b3ff83b5c6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:38:53.515108 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-52a521b4-c504-4cac-bd65-6574dad65c0c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 05 14:38:53.516886 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 32/64] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:38:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:38:53.523498 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a521b4-c504-4cac-bd65-6574dad65c0c admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:53.534651 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a521b4-c504-4cac-bd65-6574dad65c0c admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:53.539429 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d7ba7-3d98-4380-9def-5677983bb88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:53.540138 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d7ba7-3d98-4380-9def-5677983bb88b admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:53.540425 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d7ba7-3d98-4380-9def-5677983bb88b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:53.540702 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d7ba7-3d98-4380-9def-5677983bb88b admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:53.541505 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d7ba7-3d98-4380-9def-5677983bb88b admin admin] RBAC: Adding query filter params (name=member) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:38:53.541813 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d7ba7-3d98-4380-9def-5677983bb88b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:53.544019 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d7ba7-3d98-4380-9def-5677983bb88b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:53.544218 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 33/65] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:38:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:38:53.558138 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 33/66] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jan 5 14:38:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:38:53.569725 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba4509-a921-43f3-a2db-b3ff83b5c6f6 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:53.583065 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d7ba7-3d98-4380-9def-5677983bb88b admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:53.586497 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba4509-a921-43f3-a2db-b3ff83b5c6f6 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:53.592891 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d7ba7-3d98-4380-9def-5677983bb88b admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:53.597605 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738b683-0aa0-47ff-95a6-10d8ddda53cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:53.598373 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738b683-0aa0-47ff-95a6-10d8ddda53cc admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:53.598658 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738b683-0aa0-47ff-95a6-10d8ddda53cc admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:53.598933 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738b683-0aa0-47ff-95a6-10d8ddda53cc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:53.600172 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dafac1-7536-41de-9e5d-98f7385e70f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:53.601314 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dafac1-7536-41de-9e5d-98f7385e70f7 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:53.601804 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dafac1-7536-41de-9e5d-98f7385e70f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:53.602313 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dafac1-7536-41de-9e5d-98f7385e70f7 admin admin] PATH_INFO: `/v3/users/686414665f0c44959e81a0f7d5a500e1` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:53.610708 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738b683-0aa0-47ff-95a6-10d8ddda53cc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:38:53.621232 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-7738b683-0aa0-47ff-95a6-10d8ddda53cc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 05 14:38:53.624014 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 34/67] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:38:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:38:53.625012 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738b683-0aa0-47ff-95a6-10d8ddda53cc admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:53.629577 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dafac1-7536-41de-9e5d-98f7385e70f7 admin admin] RBAC: Authorizing `identity:get_user(user_id=686414665f0c44959e81a0f7d5a500e1)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:53.631926 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dafac1-7536-41de-9e5d-98f7385e70f7 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:53.634083 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 34/68] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:38:53 2022] GET /identity/v3/users/686414665f0c44959e81a0f7d5a500e1 => generated 275 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:53.642459 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738b683-0aa0-47ff-95a6-10d8ddda53cc admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:53.645820 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dafac1-7536-41de-9e5d-98f7385e70f7 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:53.647461 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fbe2f-1b80-46ad-92aa-e433e3ffd81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:53.648222 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fbe2f-1b80-46ad-92aa-e433e3ffd81a admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:53.648606 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fbe2f-1b80-46ad-92aa-e433e3ffd81a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:53.648982 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fbe2f-1b80-46ad-92aa-e433e3ffd81a admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:53.649880 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fbe2f-1b80-46ad-92aa-e433e3ffd81a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:38:53.650281 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fbe2f-1b80-46ad-92aa-e433e3ffd81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:53.652540 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fbe2f-1b80-46ad-92aa-e433e3ffd81a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:53.664706 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dafac1-7536-41de-9e5d-98f7385e70f7 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:53.665276 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 35/69] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:38:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:53.668076 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fbe2f-1b80-46ad-92aa-e433e3ffd81a admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:53.671994 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf20ec6-852b-4bce-b241-e59ef5a66a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:53.672814 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf20ec6-852b-4bce-b241-e59ef5a66a39 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:53.673335 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf20ec6-852b-4bce-b241-e59ef5a66a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:53.673788 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf20ec6-852b-4bce-b241-e59ef5a66a39 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:53.678056 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fbe2f-1b80-46ad-92aa-e433e3ffd81a admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:53.682937 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf20ec6-852b-4bce-b241-e59ef5a66a39 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:53.683078 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0c1d1-df07-445a-8fd2-22abc43732b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:53.684006 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0c1d1-df07-445a-8fd2-22abc43732b3 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:53.684359 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0c1d1-df07-445a-8fd2-22abc43732b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:53.684705 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0c1d1-df07-445a-8fd2-22abc43732b3 admin admin] PATH_INFO: `/v3/users/a7c8dfde39e84abdb68271d16eaed381` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:53.685954 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf20ec6-852b-4bce-b241-e59ef5a66a39 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:53.686337 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0c1d1-df07-445a-8fd2-22abc43732b3 admin admin] RBAC: Authorizing `identity:get_user(user_id=a7c8dfde39e84abdb68271d16eaed381)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:53.688207 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0c1d1-df07-445a-8fd2-22abc43732b3 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:53.694534 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 36/70] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:38:53 2022] GET /identity/v3/users/a7c8dfde39e84abdb68271d16eaed381 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:38:53.695937 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ce4c8-584b-4d0d-9753-843003429aa4 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:53.696300 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ce4c8-584b-4d0d-9753-843003429aa4 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:53.696772 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ce4c8-584b-4d0d-9753-843003429aa4 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:53.697177 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 35/71] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:38:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 05 14:38:53.702092 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 37/72] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:38:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:38:53.703412 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf20ec6-852b-4bce-b241-e59ef5a66a39 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:53.704376 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ce4c8-584b-4d0d-9753-843003429aa4 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:53.714280 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf20ec6-852b-4bce-b241-e59ef5a66a39 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:53.719140 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0d0e3-c033-4f70-ae91-34280c58f8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:53.720316 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0d0e3-c033-4f70-ae91-34280c58f8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:53.720581 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ce4c8-584b-4d0d-9753-843003429aa4 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:53.721056 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0d0e3-c033-4f70-ae91-34280c58f8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:53.721570 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0d0e3-c033-4f70-ae91-34280c58f8d8 admin admin] PATH_INFO: `/v3/projects/5b2abea39102490891cc99e4df77ecc2` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:53.723137 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0d0e3-c033-4f70-ae91-34280c58f8d8 admin admin] RBAC: Authorizing `identity:get_project(project_id=5b2abea39102490891cc99e4df77ecc2)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:53.725422 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94455c39-be4f-4e25-9bb7-0c79f19b5984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:53.725577 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0d0e3-c033-4f70-ae91-34280c58f8d8 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:53.726057 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94455c39-be4f-4e25-9bb7-0c79f19b5984 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:53.726339 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94455c39-be4f-4e25-9bb7-0c79f19b5984 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:53.726615 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94455c39-be4f-4e25-9bb7-0c79f19b5984 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:53.727286 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 36/73] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:38:53 2022] GET /identity/v3/projects/5b2abea39102490891cc99e4df77ecc2 => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:38:53.728323 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa0d85-36c9-447b-b42d-01bfd3ecfb81 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:53.728613 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa0d85-36c9-447b-b42d-01bfd3ecfb81 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:53.728890 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa0d85-36c9-447b-b42d-01bfd3ecfb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:53.735612 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94455c39-be4f-4e25-9bb7-0c79f19b5984 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:53.737419 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94455c39-be4f-4e25-9bb7-0c79f19b5984 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:53.746634 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 38/74] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:38:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 05 14:38:53.746962 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-89aa0d85-36c9-447b-b42d-01bfd3ecfb81 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:38:53.748154 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-89aa0d85-36c9-447b-b42d-01bfd3ecfb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:38:53.749370 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb41dc3-31ae-4d7f-872d-8559ee0b2cd8 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:53.749960 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb41dc3-31ae-4d7f-872d-8559ee0b2cd8 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:53.750430 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb41dc3-31ae-4d7f-872d-8559ee0b2cd8 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:53.752714 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 39/75] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:38:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:38:53.753634 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb41dc3-31ae-4d7f-872d-8559ee0b2cd8 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:53.756530 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 37/76] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:38:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:38:53.757453 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa0d85-36c9-447b-b42d-01bfd3ecfb81 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:53.766522 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa0d85-36c9-447b-b42d-01bfd3ecfb81 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:53.767818 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb41dc3-31ae-4d7f-872d-8559ee0b2cd8 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:53.771121 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35958f-84ca-4a22-8157-7799159b1754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:53.772063 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35958f-84ca-4a22-8157-7799159b1754 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:53.772425 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35958f-84ca-4a22-8157-7799159b1754 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:53.772776 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35958f-84ca-4a22-8157-7799159b1754 admin admin] PATH_INFO: `/v3/projects/0c3d9801ad754740ae4b7891d05c103f` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:53.773756 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c7e6c-7de2-4501-8bdd-0a4e97ff2776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:53.774133 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35958f-84ca-4a22-8157-7799159b1754 admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3d9801ad754740ae4b7891d05c103f)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:53.774755 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c7e6c-7de2-4501-8bdd-0a4e97ff2776 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:53.775208 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c7e6c-7de2-4501-8bdd-0a4e97ff2776 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:53.775670 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c7e6c-7de2-4501-8bdd-0a4e97ff2776 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:53.776476 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35958f-84ca-4a22-8157-7799159b1754 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:53.776906 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c7e6c-7de2-4501-8bdd-0a4e97ff2776 admin admin] RBAC: Adding query filter params (role.id=eaba1e26bf0040868b08b042a7859698, scope.project.id=5b2abea39102490891cc99e4df77ecc2, user.id=686414665f0c44959e81a0f7d5a500e1) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:38:53.777419 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c7e6c-7de2-4501-8bdd-0a4e97ff2776 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:53.778608 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING py.warnings [None req-018c7e6c-7de2-4501-8bdd-0a4e97ff2776 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:38:53.778608 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: warnings.warn(msg) Jan 05 14:38:53.778608 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: Jan 05 14:38:53.778852 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 38/77] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:38:53 2022] GET /identity/v3/projects/0c3d9801ad754740ae4b7891d05c103f => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:53.779964 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcb653-bec3-4e8c-995c-be19644e0477 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:53.780323 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcb653-bec3-4e8c-995c-be19644e0477 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:53.780486 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c7e6c-7de2-4501-8bdd-0a4e97ff2776 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:53.780721 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcb653-bec3-4e8c-995c-be19644e0477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:53.789551 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 40/78] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:38:53 2022] GET /identity/v3/role_assignments?user.id=686414665f0c44959e81a0f7d5a500e1&scope.project.id=5b2abea39102490891cc99e4df77ecc2&role.id=eaba1e26bf0040868b08b042a7859698 => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:53.790560 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c7e6c-7de2-4501-8bdd-0a4e97ff2776 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:53.800091 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-12dcb653-bec3-4e8c-995c-be19644e0477 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:38:53.801470 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-12dcb653-bec3-4e8c-995c-be19644e0477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:38:53.802938 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c7e6c-7de2-4501-8bdd-0a4e97ff2776 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:53.808547 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd87e77-c364-4dca-990d-41340a252239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:53.809564 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd87e77-c364-4dca-990d-41340a252239 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:53.810029 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd87e77-c364-4dca-990d-41340a252239 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:53.810259 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 39/79] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:38:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:38:53.810683 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd87e77-c364-4dca-990d-41340a252239 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:53.811247 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dcb653-bec3-4e8c-995c-be19644e0477 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:53.811905 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd87e77-c364-4dca-990d-41340a252239 admin admin] RBAC: Adding query filter params (role.id=494131614fcf424f92e0817fa7ff6961, scope.project.id=0c3d9801ad754740ae4b7891d05c103f, user.id=a7c8dfde39e84abdb68271d16eaed381) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:38:53.812282 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd87e77-c364-4dca-990d-41340a252239 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:53.814298 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd87e77-c364-4dca-990d-41340a252239 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:53.821634 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dcb653-bec3-4e8c-995c-be19644e0477 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:53.822341 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 41/80] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:38:53 2022] GET /identity/v3/role_assignments?user.id=a7c8dfde39e84abdb68271d16eaed381&scope.project.id=0c3d9801ad754740ae4b7891d05c103f&role.id=494131614fcf424f92e0817fa7ff6961 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:53.835059 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179b632-76e9-454b-bcba-e2a845de3699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:53.836353 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179b632-76e9-454b-bcba-e2a845de3699 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:53.836877 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179b632-76e9-454b-bcba-e2a845de3699 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:53.837386 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179b632-76e9-454b-bcba-e2a845de3699 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:53.850567 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179b632-76e9-454b-bcba-e2a845de3699 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:38:53.858467 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-c179b632-76e9-454b-bcba-e2a845de3699 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 05 14:38:53.860304 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 40/81] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:38:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:38:53.869140 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd87e77-c364-4dca-990d-41340a252239 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:53.878585 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179b632-76e9-454b-bcba-e2a845de3699 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:53.880813 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd87e77-c364-4dca-990d-41340a252239 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:53.893978 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179b632-76e9-454b-bcba-e2a845de3699 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:53.894799 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e606e-89bc-4f30-bf10-3e54156e2a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:53.895597 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e606e-89bc-4f30-bf10-3e54156e2a8c admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:53.895889 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e606e-89bc-4f30-bf10-3e54156e2a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:53.896169 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e606e-89bc-4f30-bf10-3e54156e2a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:53.896945 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e606e-89bc-4f30-bf10-3e54156e2a8c admin admin] RBAC: Adding query filter params (name=member) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:38:53.897385 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e606e-89bc-4f30-bf10-3e54156e2a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:53.898615 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e45ab-ab0a-4d7c-bd85-cdc872fcf00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:53.899145 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e606e-89bc-4f30-bf10-3e54156e2a8c admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:53.899487 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e45ab-ab0a-4d7c-bd85-cdc872fcf00c admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:53.899778 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e45ab-ab0a-4d7c-bd85-cdc872fcf00c admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:53.900059 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e45ab-ab0a-4d7c-bd85-cdc872fcf00c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:53.901366 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e45ab-ab0a-4d7c-bd85-cdc872fcf00c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:53.903758 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e45ab-ab0a-4d7c-bd85-cdc872fcf00c admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:53.905579 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 41/82] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:38:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:38:53.906937 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd6c00-c678-4937-ad64-7aa6060fa713 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:53.907228 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd6c00-c678-4937-ad64-7aa6060fa713 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:53.907508 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd6c00-c678-4937-ad64-7aa6060fa713 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:53.909375 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 42/83] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:38:53.910513 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 42/84] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jan 5 14:38:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:53.912107 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd6c00-c678-4937-ad64-7aa6060fa713 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:53.918729 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6272b-6a38-40b7-ae9b-9909c79caf99 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:53.919021 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6272b-6a38-40b7-ae9b-9909c79caf99 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:53.919306 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6272b-6a38-40b7-ae9b-9909c79caf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:53.928631 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd6c00-c678-4937-ad64-7aa6060fa713 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:53.934477 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63743f42-2055-4d16-862d-987f8d40f25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:53.935289 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63743f42-2055-4d16-862d-987f8d40f25f admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:53.935651 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63743f42-2055-4d16-862d-987f8d40f25f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:53.935999 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63743f42-2055-4d16-862d-987f8d40f25f admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:53.936815 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63743f42-2055-4d16-862d-987f8d40f25f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:53.939052 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63743f42-2055-4d16-862d-987f8d40f25f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:53.945576 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-a5e6272b-6a38-40b7-ae9b-9909c79caf99 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:38:53.947970 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-a5e6272b-6a38-40b7-ae9b-9909c79caf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:38:53.957933 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 43/85] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:38:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:38:53.961718 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6272b-6a38-40b7-ae9b-9909c79caf99 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:53.973503 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6272b-6a38-40b7-ae9b-9909c79caf99 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:53.978575 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431253d9-6509-4e6b-813a-d151a7427ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:53.979905 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431253d9-6509-4e6b-813a-d151a7427ebc admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:53.980409 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431253d9-6509-4e6b-813a-d151a7427ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:53.980875 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431253d9-6509-4e6b-813a-d151a7427ebc admin admin] PATH_INFO: `/v3/users/686414665f0c44959e81a0f7d5a500e1` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:53.982475 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431253d9-6509-4e6b-813a-d151a7427ebc admin admin] RBAC: Authorizing `identity:get_user(user_id=686414665f0c44959e81a0f7d5a500e1)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:53.985103 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431253d9-6509-4e6b-813a-d151a7427ebc admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:53.987078 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 44/86] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:38:53 2022] GET /identity/v3/users/686414665f0c44959e81a0f7d5a500e1 => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:53.987820 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431253d9-6509-4e6b-813a-d151a7427ebc admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:53.998762 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431253d9-6509-4e6b-813a-d151a7427ebc admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:54.004287 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6adbd-1c7f-43f4-a767-e6c8fd5006b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:54.005241 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6adbd-1c7f-43f4-a767-e6c8fd5006b0 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:54.005640 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6adbd-1c7f-43f4-a767-e6c8fd5006b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:54.006009 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6adbd-1c7f-43f4-a767-e6c8fd5006b0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:54.018459 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6adbd-1c7f-43f4-a767-e6c8fd5006b0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:38:54.026561 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-04d6adbd-1c7f-43f4-a767-e6c8fd5006b0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 05 14:38:54.028167 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 45/87] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Jan 5 14:38:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:38:54.039950 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6adbd-1c7f-43f4-a767-e6c8fd5006b0 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:54.041627 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 43/88] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Jan 5 14:38:53 2022] POST /identity/v3/users => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:38:54.046194 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63743f42-2055-4d16-862d-987f8d40f25f admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:54.048345 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6adbd-1c7f-43f4-a767-e6c8fd5006b0 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:54.053502 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3722e-3335-427b-a4f7-c683c4f236dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:54.054488 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3722e-3335-427b-a4f7-c683c4f236dc admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:54.054953 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3722e-3335-427b-a4f7-c683c4f236dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:54.055405 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3722e-3335-427b-a4f7-c683c4f236dc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:54.069363 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63743f42-2055-4d16-862d-987f8d40f25f admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:54.070174 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b3722e-3335-427b-a4f7-c683c4f236dc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:54.072301 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b3722e-3335-427b-a4f7-c683c4f236dc admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:54.081003 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53a29f-a0a2-4e25-b8e1-7835ed80ce68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:54.081791 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53a29f-a0a2-4e25-b8e1-7835ed80ce68 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:54.082084 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53a29f-a0a2-4e25-b8e1-7835ed80ce68 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:54.082355 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53a29f-a0a2-4e25-b8e1-7835ed80ce68 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:54.086279 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 46/89] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:38:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:38:54.086401 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53a29f-a0a2-4e25-b8e1-7835ed80ce68 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:38:54.086401 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53a29f-a0a2-4e25-b8e1-7835ed80ce68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:54.086401 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53a29f-a0a2-4e25-b8e1-7835ed80ce68 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:54.091747 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3722e-3335-427b-a4f7-c683c4f236dc admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:54.105034 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 44/90] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:38:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:54.109237 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3722e-3335-427b-a4f7-c683c4f236dc admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:54.110741 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53a29f-a0a2-4e25-b8e1-7835ed80ce68 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:54.119907 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6ab43-2b99-4d69-98e8-035cefa34389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:54.121551 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6ab43-2b99-4d69-98e8-035cefa34389 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:54.121842 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6ab43-2b99-4d69-98e8-035cefa34389 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:54.122124 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6ab43-2b99-4d69-98e8-035cefa34389 admin admin] PATH_INFO: `/v3/projects/0c3d9801ad754740ae4b7891d05c103f` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:54.122610 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53a29f-a0a2-4e25-b8e1-7835ed80ce68 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:54.125282 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6ab43-2b99-4d69-98e8-035cefa34389 admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3d9801ad754740ae4b7891d05c103f)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:54.127514 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6ab43-2b99-4d69-98e8-035cefa34389 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:54.127897 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fea89-85b3-4ae7-8858-6f72ea994c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:54.129277 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fea89-85b3-4ae7-8858-6f72ea994c00 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:54.129738 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 47/91] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:38:54 2022] GET /identity/v3/projects/0c3d9801ad754740ae4b7891d05c103f => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:54.129993 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fea89-85b3-4ae7-8858-6f72ea994c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:54.130465 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fea89-85b3-4ae7-8858-6f72ea994c00 admin admin] PATH_INFO: `/v3/users/686414665f0c44959e81a0f7d5a500e1` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:54.132092 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88fea89-85b3-4ae7-8858-6f72ea994c00 admin admin] RBAC: Authorizing `identity:get_user(user_id=686414665f0c44959e81a0f7d5a500e1)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:54.134624 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88fea89-85b3-4ae7-8858-6f72ea994c00 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:54.135671 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6ab43-2b99-4d69-98e8-035cefa34389 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:54.137178 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 45/92] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:38:54 2022] GET /identity/v3/users/686414665f0c44959e81a0f7d5a500e1 => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:38:54.146469 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fea89-85b3-4ae7-8858-6f72ea994c00 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:54.159262 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6ab43-2b99-4d69-98e8-035cefa34389 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:54.160048 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fea89-85b3-4ae7-8858-6f72ea994c00 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:54.164997 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6ffea-9c81-4b0f-b92f-f1567433aebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:54.166025 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6ffea-9c81-4b0f-b92f-f1567433aebf admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:54.166567 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6ffea-9c81-4b0f-b92f-f1567433aebf admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:54.167039 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6ffea-9c81-4b0f-b92f-f1567433aebf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:54.176910 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6ffea-9c81-4b0f-b92f-f1567433aebf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:54.179089 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6ffea-9c81-4b0f-b92f-f1567433aebf admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:54.181936 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c43ad-57bc-41b3-b814-2e15538edbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:54.182628 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c43ad-57bc-41b3-b814-2e15538edbdf admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:54.182917 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c43ad-57bc-41b3-b814-2e15538edbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:54.183262 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c43ad-57bc-41b3-b814-2e15538edbdf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:54.184136 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c43ad-57bc-41b3-b814-2e15538edbdf admin admin] RBAC: Adding query filter params (role.id=eaba1e26bf0040868b08b042a7859698, scope.project.id=0c3d9801ad754740ae4b7891d05c103f, user.id=686414665f0c44959e81a0f7d5a500e1) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:38:54.184453 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c43ad-57bc-41b3-b814-2e15538edbdf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:54.186813 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c43ad-57bc-41b3-b814-2e15538edbdf admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:54.196766 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 46/93] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:38:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:38:54.198508 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6ffea-9c81-4b0f-b92f-f1567433aebf admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:54.199099 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 48/94] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:38:54 2022] GET /identity/v3/role_assignments?user.id=686414665f0c44959e81a0f7d5a500e1&scope.project.id=0c3d9801ad754740ae4b7891d05c103f&role.id=eaba1e26bf0040868b08b042a7859698 => generated 259 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:54.208811 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6ffea-9c81-4b0f-b92f-f1567433aebf admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:54.214011 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf327d9-a41a-4a57-b1fc-2af6f92c50ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:54.215736 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf327d9-a41a-4a57-b1fc-2af6f92c50ec admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:54.216220 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf327d9-a41a-4a57-b1fc-2af6f92c50ec admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:54.216691 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf327d9-a41a-4a57-b1fc-2af6f92c50ec admin admin] PATH_INFO: `/v3/projects/0c3d9801ad754740ae4b7891d05c103f` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:54.218279 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf327d9-a41a-4a57-b1fc-2af6f92c50ec admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3d9801ad754740ae4b7891d05c103f)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:54.220733 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf327d9-a41a-4a57-b1fc-2af6f92c50ec admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:54.222897 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 47/95] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:38:54 2022] GET /identity/v3/projects/0c3d9801ad754740ae4b7891d05c103f => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:38:54.229179 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c43ad-57bc-41b3-b814-2e15538edbdf admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:54.240496 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c43ad-57bc-41b3-b814-2e15538edbdf admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:54.245775 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0433e90-f601-4d9b-8e15-60d7cc5897b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:54.246846 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0433e90-f601-4d9b-8e15-60d7cc5897b5 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:54.247331 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0433e90-f601-4d9b-8e15-60d7cc5897b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:54.247806 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0433e90-f601-4d9b-8e15-60d7cc5897b5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:54.248916 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0433e90-f601-4d9b-8e15-60d7cc5897b5 admin admin] RBAC: Adding query filter params (role.id=78b87341e5464907bcce0d16dca76299, scope.project.id=0c3d9801ad754740ae4b7891d05c103f, user.id=686414665f0c44959e81a0f7d5a500e1) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:38:54.249516 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0433e90-f601-4d9b-8e15-60d7cc5897b5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:54.251709 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0433e90-f601-4d9b-8e15-60d7cc5897b5 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:54.258594 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 49/96] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:38:54 2022] GET /identity/v3/role_assignments?user.id=686414665f0c44959e81a0f7d5a500e1&scope.project.id=0c3d9801ad754740ae4b7891d05c103f&role.id=78b87341e5464907bcce0d16dca76299 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:56.629696 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f69f2-a184-4f34-9376-c347dc3b1e13 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:56.630749 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f69f2-a184-4f34-9376-c347dc3b1e13 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:56.631245 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f69f2-a184-4f34-9376-c347dc3b1e13 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:56.633580 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 48/97] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:38:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:38:56.639912 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a748ecd-ba9e-4c0e-ae33-bdb9207ac722 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:56.640742 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a748ecd-ba9e-4c0e-ae33-bdb9207ac722 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:56.641322 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a748ecd-ba9e-4c0e-ae33-bdb9207ac722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:56.666075 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-3a748ecd-ba9e-4c0e-ae33-bdb9207ac722 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:38:56.668184 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-3a748ecd-ba9e-4c0e-ae33-bdb9207ac722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:38:56.681621 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 50/98] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:38:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:38:56.724032 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f69f2-a184-4f34-9376-c347dc3b1e13 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:56.742644 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f69f2-a184-4f34-9376-c347dc3b1e13 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:56.747494 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c7d4f-0e56-4d8c-a404-4404ce4e995c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:56.748524 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c7d4f-0e56-4d8c-a404-4404ce4e995c admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:56.749015 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c7d4f-0e56-4d8c-a404-4404ce4e995c admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:56.749531 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c7d4f-0e56-4d8c-a404-4404ce4e995c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:56.764843 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c7d4f-0e56-4d8c-a404-4404ce4e995c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:38:56.772472 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-761c7d4f-0e56-4d8c-a404-4404ce4e995c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 05 14:38:56.774021 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 49/99] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:38:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:38:56.779976 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a748ecd-ba9e-4c0e-ae33-bdb9207ac722 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:56.793509 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a748ecd-ba9e-4c0e-ae33-bdb9207ac722 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:56.800119 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427b4af-e94c-4db2-b62f-d50bfaff1428 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:56.800638 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427b4af-e94c-4db2-b62f-d50bfaff1428 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:56.801137 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427b4af-e94c-4db2-b62f-d50bfaff1428 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:56.803108 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 50/100] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:38:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 14:38:56.803431 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4178ff1-5869-40b6-8cc4-aee7818fa13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:56.804402 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4178ff1-5869-40b6-8cc4-aee7818fa13a admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:56.804908 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4178ff1-5869-40b6-8cc4-aee7818fa13a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:56.805419 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4178ff1-5869-40b6-8cc4-aee7818fa13a admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:56.806472 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4178ff1-5869-40b6-8cc4-aee7818fa13a admin admin] RBAC: Adding query filter params (name=member) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:38:56.807721 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80998fc-2910-46af-af90-e589ef394f18 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:56.808279 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80998fc-2910-46af-af90-e589ef394f18 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:56.808760 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80998fc-2910-46af-af90-e589ef394f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:56.810591 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4178ff1-5869-40b6-8cc4-aee7818fa13a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:56.812887 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4178ff1-5869-40b6-8cc4-aee7818fa13a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:56.834353 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 51/101] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jan 5 14:38:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:56.839403 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4178ff1-5869-40b6-8cc4-aee7818fa13a admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:56.846205 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-b80998fc-2910-46af-af90-e589ef394f18 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:38:56.849285 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-b80998fc-2910-46af-af90-e589ef394f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:38:56.856193 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4178ff1-5869-40b6-8cc4-aee7818fa13a admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:56.864203 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 51/102] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:38:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:38:56.869721 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6db827-89c8-4f98-a25e-f41612920b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:56.870903 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6db827-89c8-4f98-a25e-f41612920b00 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:56.871402 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6db827-89c8-4f98-a25e-f41612920b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:56.871884 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6db827-89c8-4f98-a25e-f41612920b00 admin admin] PATH_INFO: `/v3/users/686414665f0c44959e81a0f7d5a500e1` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:56.877803 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6db827-89c8-4f98-a25e-f41612920b00 admin admin] RBAC: Authorizing `identity:get_user(user_id=686414665f0c44959e81a0f7d5a500e1)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:56.880474 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6db827-89c8-4f98-a25e-f41612920b00 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:56.882328 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 52/103] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:38:56 2022] GET /identity/v3/users/686414665f0c44959e81a0f7d5a500e1 => generated 275 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:38:56.888282 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80998fc-2910-46af-af90-e589ef394f18 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:56.898351 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80998fc-2910-46af-af90-e589ef394f18 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:56.906066 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6db827-89c8-4f98-a25e-f41612920b00 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:56.918680 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe49d9-02cd-4064-9a56-0486b476af27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:56.919793 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe49d9-02cd-4064-9a56-0486b476af27 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:56.921414 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe49d9-02cd-4064-9a56-0486b476af27 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:56.921930 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe49d9-02cd-4064-9a56-0486b476af27 admin admin] PATH_INFO: `/v3/projects/5b2abea39102490891cc99e4df77ecc2` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:56.923583 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6db827-89c8-4f98-a25e-f41612920b00 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:56.924446 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe49d9-02cd-4064-9a56-0486b476af27 admin admin] RBAC: Authorizing `identity:get_project(project_id=5b2abea39102490891cc99e4df77ecc2)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:56.927977 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe49d9-02cd-4064-9a56-0486b476af27 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:56.930597 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 52/104] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:38:56 2022] GET /identity/v3/projects/5b2abea39102490891cc99e4df77ecc2 => generated 312 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:56.936762 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c4559-e044-4d6a-ab20-7c5a1cee3889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:56.937901 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe49d9-02cd-4064-9a56-0486b476af27 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:56.938917 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c4559-e044-4d6a-ab20-7c5a1cee3889 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:56.939767 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c4559-e044-4d6a-ab20-7c5a1cee3889 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:56.940613 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c4559-e044-4d6a-ab20-7c5a1cee3889 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:56.962727 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe49d9-02cd-4064-9a56-0486b476af27 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:56.969226 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c4559-e044-4d6a-ab20-7c5a1cee3889 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:38:56.977480 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-2c6c4559-e044-4d6a-ab20-7c5a1cee3889 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 05 14:38:56.984363 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 53/105] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:38:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:38:56.984484 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250ac18-a3f1-473c-8634-c5f64d00a761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:56.984484 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250ac18-a3f1-473c-8634-c5f64d00a761 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:56.984484 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250ac18-a3f1-473c-8634-c5f64d00a761 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:56.984484 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250ac18-a3f1-473c-8634-c5f64d00a761 admin admin] PATH_INFO: `/v3/projects/5b2abea39102490891cc99e4df77ecc2/users/686414665f0c44959e81a0f7d5a500e1/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:56.985255 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250ac18-a3f1-473c-8634-c5f64d00a761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2abea39102490891cc99e4df77ecc2, user_id=686414665f0c44959e81a0f7d5a500e1, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:56.985753 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c4559-e044-4d6a-ab20-7c5a1cee3889 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:56.987947 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250ac18-a3f1-473c-8634-c5f64d00a761 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:57.001957 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c4559-e044-4d6a-ab20-7c5a1cee3889 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:57.009900 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40083f83-85e3-41fb-b1d9-d851f91c1c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:57.010896 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40083f83-85e3-41fb-b1d9-d851f91c1c43 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:57.012023 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40083f83-85e3-41fb-b1d9-d851f91c1c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:57.012529 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40083f83-85e3-41fb-b1d9-d851f91c1c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:57.015602 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40083f83-85e3-41fb-b1d9-d851f91c1c43 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:38:57.016192 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40083f83-85e3-41fb-b1d9-d851f91c1c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:57.018157 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40083f83-85e3-41fb-b1d9-d851f91c1c43 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:57.032573 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 54/106] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:38:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:38:57.038458 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40083f83-85e3-41fb-b1d9-d851f91c1c43 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:57.049242 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40083f83-85e3-41fb-b1d9-d851f91c1c43 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:57.057521 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437bd07-a86b-45f3-b88c-ef685432c32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:57.059229 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437bd07-a86b-45f3-b88c-ef685432c32b admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:57.059772 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437bd07-a86b-45f3-b88c-ef685432c32b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:57.060268 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437bd07-a86b-45f3-b88c-ef685432c32b admin admin] PATH_INFO: `/v3/users/a7c8dfde39e84abdb68271d16eaed381` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:57.064958 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437bd07-a86b-45f3-b88c-ef685432c32b admin admin] RBAC: Authorizing `identity:get_user(user_id=a7c8dfde39e84abdb68271d16eaed381)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:57.067154 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437bd07-a86b-45f3-b88c-ef685432c32b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:57.069037 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 55/107] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:38:57 2022] GET /identity/v3/users/a7c8dfde39e84abdb68271d16eaed381 => generated 247 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:38:57.074421 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437bd07-a86b-45f3-b88c-ef685432c32b admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:57.085563 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437bd07-a86b-45f3-b88c-ef685432c32b admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:57.093460 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 53/108] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Jan 5 14:38:56 2022] PUT /identity/v3/projects/5b2abea39102490891cc99e4df77ecc2/users/686414665f0c44959e81a0f7d5a500e1/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:38:57.108162 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b945e-cd0b-4c9f-95de-becb3f646522 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:57.108511 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b945e-cd0b-4c9f-95de-becb3f646522 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:57.108741 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b945e-cd0b-4c9f-95de-becb3f646522 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:57.110952 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 54/109] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:38:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:38:57.116179 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4354b2-ec35-4945-9ebf-38ec1b1dee32 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:57.116461 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4354b2-ec35-4945-9ebf-38ec1b1dee32 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:57.116744 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4354b2-ec35-4945-9ebf-38ec1b1dee32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:57.154125 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-2c4354b2-ec35-4945-9ebf-38ec1b1dee32 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:38:57.155334 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-2c4354b2-ec35-4945-9ebf-38ec1b1dee32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:38:57.174108 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a42a61-dd62-4af8-aa71-7df67d53cd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:57.176749 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a42a61-dd62-4af8-aa71-7df67d53cd80 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:57.177288 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a42a61-dd62-4af8-aa71-7df67d53cd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:57.178046 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a42a61-dd62-4af8-aa71-7df67d53cd80 admin admin] PATH_INFO: `/v3/projects/0c3d9801ad754740ae4b7891d05c103f` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:57.188911 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a42a61-dd62-4af8-aa71-7df67d53cd80 admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3d9801ad754740ae4b7891d05c103f)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:57.194671 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a42a61-dd62-4af8-aa71-7df67d53cd80 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:57.200629 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 56/110] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:38:57 2022] GET /identity/v3/projects/0c3d9801ad754740ae4b7891d05c103f => generated 298 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:38:57.208289 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a42a61-dd62-4af8-aa71-7df67d53cd80 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:57.230981 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a42a61-dd62-4af8-aa71-7df67d53cd80 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:57.242697 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ba22f-1111-4f08-bacf-55367f4f8f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:57.244027 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ba22f-1111-4f08-bacf-55367f4f8f2e admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:57.244567 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ba22f-1111-4f08-bacf-55367f4f8f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:57.245433 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ba22f-1111-4f08-bacf-55367f4f8f2e admin admin] PATH_INFO: `/v3/projects/0c3d9801ad754740ae4b7891d05c103f/users/a7c8dfde39e84abdb68271d16eaed381/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:57.253584 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ba22f-1111-4f08-bacf-55367f4f8f2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c3d9801ad754740ae4b7891d05c103f, user_id=a7c8dfde39e84abdb68271d16eaed381, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:57.255962 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING py.warnings [None req-b84ba22f-1111-4f08-bacf-55367f4f8f2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:38:57.255962 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: warnings.warn(msg) Jan 05 14:38:57.255962 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: Jan 05 14:38:57.258666 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ba22f-1111-4f08-bacf-55367f4f8f2e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:57.342829 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 55/111] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:38:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:38:57.369566 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4354b2-ec35-4945-9ebf-38ec1b1dee32 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:57.379008 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4354b2-ec35-4945-9ebf-38ec1b1dee32 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:57.385570 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcbb0e-2e6f-4757-8a77-358e8c3b0258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:57.386470 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcbb0e-2e6f-4757-8a77-358e8c3b0258 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:57.386762 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcbb0e-2e6f-4757-8a77-358e8c3b0258 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:57.387040 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcbb0e-2e6f-4757-8a77-358e8c3b0258 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:57.397895 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fcbb0e-2e6f-4757-8a77-358e8c3b0258 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:38:57.407035 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 57/112] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Jan 5 14:38:57 2022] PUT /identity/v3/projects/0c3d9801ad754740ae4b7891d05c103f/users/a7c8dfde39e84abdb68271d16eaed381/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:38:57.412615 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-f9fcbb0e-2e6f-4757-8a77-358e8c3b0258 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 05 14:38:57.414082 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 56/113] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:38:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:38:57.420029 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ba22f-1111-4f08-bacf-55367f4f8f2e admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:57.488136 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ba22f-1111-4f08-bacf-55367f4f8f2e admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:57.496939 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6512c1e-1464-4195-bd13-53771d8b2b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:57.497704 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6512c1e-1464-4195-bd13-53771d8b2b57 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:57.498054 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6512c1e-1464-4195-bd13-53771d8b2b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:57.498332 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6512c1e-1464-4195-bd13-53771d8b2b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:57.499166 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6512c1e-1464-4195-bd13-53771d8b2b57 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:38:57.499473 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6512c1e-1464-4195-bd13-53771d8b2b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:57.501233 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6512c1e-1464-4195-bd13-53771d8b2b57 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:57.518310 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 58/114] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jan 5 14:38:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:57.524067 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcbb0e-2e6f-4757-8a77-358e8c3b0258 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:57.535754 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcbb0e-2e6f-4757-8a77-358e8c3b0258 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:57.545305 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db5410-cd48-451b-aa83-957ed754cd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:57.546257 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db5410-cd48-451b-aa83-957ed754cd1c admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:57.546538 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db5410-cd48-451b-aa83-957ed754cd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:57.546809 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db5410-cd48-451b-aa83-957ed754cd1c admin admin] PATH_INFO: `/v3/users/686414665f0c44959e81a0f7d5a500e1` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:57.548146 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db5410-cd48-451b-aa83-957ed754cd1c admin admin] RBAC: Authorizing `identity:get_user(user_id=686414665f0c44959e81a0f7d5a500e1)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:57.550548 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db5410-cd48-451b-aa83-957ed754cd1c admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:57.552227 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 57/115] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:38:57 2022] GET /identity/v3/users/686414665f0c44959e81a0f7d5a500e1 => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:57.558322 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6512c1e-1464-4195-bd13-53771d8b2b57 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:57.568666 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6512c1e-1464-4195-bd13-53771d8b2b57 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:57.578302 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4f53b-173f-4013-996b-00addf9ddae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:57.579182 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4f53b-173f-4013-996b-00addf9ddae5 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:57.579513 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4f53b-173f-4013-996b-00addf9ddae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:57.579839 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4f53b-173f-4013-996b-00addf9ddae5 admin admin] PATH_INFO: `/v3/projects/0c3d9801ad754740ae4b7891d05c103f` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:57.581249 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4f53b-173f-4013-996b-00addf9ddae5 admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3d9801ad754740ae4b7891d05c103f)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:57.583510 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4f53b-173f-4013-996b-00addf9ddae5 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:57.585302 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 59/116] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:38:57 2022] GET /identity/v3/projects/0c3d9801ad754740ae4b7891d05c103f => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:57.591253 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db5410-cd48-451b-aa83-957ed754cd1c admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:57.603481 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db5410-cd48-451b-aa83-957ed754cd1c admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:57.609646 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ad274-8425-4758-bc6f-3ee461d56efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:57.610598 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ad274-8425-4758-bc6f-3ee461d56efb admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:57.610880 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ad274-8425-4758-bc6f-3ee461d56efb admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:57.611208 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ad274-8425-4758-bc6f-3ee461d56efb admin admin] PATH_INFO: `/v3/projects/0c3d9801ad754740ae4b7891d05c103f/users/686414665f0c44959e81a0f7d5a500e1/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:57.618545 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ad274-8425-4758-bc6f-3ee461d56efb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c3d9801ad754740ae4b7891d05c103f, user_id=686414665f0c44959e81a0f7d5a500e1, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:57.622025 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ad274-8425-4758-bc6f-3ee461d56efb admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:57.699436 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68947a33-eacf-4a66-984f-83e05e93a0bf None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:57.699942 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68947a33-eacf-4a66-984f-83e05e93a0bf None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:57.700042 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68947a33-eacf-4a66-984f-83e05e93a0bf None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:57.701937 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 60/117] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:38:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 14:38:57.712340 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 58/118] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Jan 5 14:38:57 2022] PUT /identity/v3/projects/0c3d9801ad754740ae4b7891d05c103f/users/686414665f0c44959e81a0f7d5a500e1/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:38:57.717051 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfc399-16c2-4f30-814a-d8f0863094e2 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:57.717365 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfc399-16c2-4f30-814a-d8f0863094e2 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:57.717646 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfc399-16c2-4f30-814a-d8f0863094e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:57.742518 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-82dfc399-16c2-4f30-814a-d8f0863094e2 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:38:57.743768 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-82dfc399-16c2-4f30-814a-d8f0863094e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:38:57.821548 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 61/119] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:38:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:38:57.866300 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ad274-8425-4758-bc6f-3ee461d56efb admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:57.882527 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ad274-8425-4758-bc6f-3ee461d56efb admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:57.889709 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4970b4-7afc-4acb-a76e-c9d294884466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:57.890526 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4970b4-7afc-4acb-a76e-c9d294884466 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:57.890811 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4970b4-7afc-4acb-a76e-c9d294884466 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:57.891085 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4970b4-7afc-4acb-a76e-c9d294884466 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:57.908013 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4970b4-7afc-4acb-a76e-c9d294884466 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:38:57.915715 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-bf4970b4-7afc-4acb-a76e-c9d294884466 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 05 14:38:57.916972 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 59/120] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Jan 5 14:38:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:38:57.923276 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfc399-16c2-4f30-814a-d8f0863094e2 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:57.932716 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfc399-16c2-4f30-814a-d8f0863094e2 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:57.941316 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e9c46-bf73-456d-900d-9ba4fd3de7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:57.942007 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e9c46-bf73-456d-900d-9ba4fd3de7de admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:57.942295 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e9c46-bf73-456d-900d-9ba4fd3de7de admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:57.942580 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e9c46-bf73-456d-900d-9ba4fd3de7de admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:57.943364 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e9c46-bf73-456d-900d-9ba4fd3de7de admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:38:57.943671 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e9c46-bf73-456d-900d-9ba4fd3de7de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:57.945363 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e9c46-bf73-456d-900d-9ba4fd3de7de admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:57.958743 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 62/121] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:38:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:57.966216 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4970b4-7afc-4acb-a76e-c9d294884466 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:57.976511 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4970b4-7afc-4acb-a76e-c9d294884466 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:57.984976 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e840c0b-9db6-4645-b054-9de6fe5a4f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:57.991104 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e840c0b-9db6-4645-b054-9de6fe5a4f58 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:57.991104 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e840c0b-9db6-4645-b054-9de6fe5a4f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:57.991104 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e840c0b-9db6-4645-b054-9de6fe5a4f58 admin admin] PATH_INFO: `/v3/users/686414665f0c44959e81a0f7d5a500e1` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:57.991104 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e840c0b-9db6-4645-b054-9de6fe5a4f58 admin admin] RBAC: Authorizing `identity:get_user(user_id=686414665f0c44959e81a0f7d5a500e1)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:57.991104 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e840c0b-9db6-4645-b054-9de6fe5a4f58 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:57.991597 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 60/122] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:38:57 2022] GET /identity/v3/users/686414665f0c44959e81a0f7d5a500e1 => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:57.998045 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e9c46-bf73-456d-900d-9ba4fd3de7de admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:58.008654 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e9c46-bf73-456d-900d-9ba4fd3de7de admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:58.017469 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2b0cc-53d4-4927-ad5c-03acb519ee66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:58.018451 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2b0cc-53d4-4927-ad5c-03acb519ee66 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:58.018706 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2b0cc-53d4-4927-ad5c-03acb519ee66 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:58.018990 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2b0cc-53d4-4927-ad5c-03acb519ee66 admin admin] PATH_INFO: `/v3/projects/0c3d9801ad754740ae4b7891d05c103f` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:58.020254 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2b0cc-53d4-4927-ad5c-03acb519ee66 admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3d9801ad754740ae4b7891d05c103f)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:58.022420 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2b0cc-53d4-4927-ad5c-03acb519ee66 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:58.024361 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 63/123] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:38:57 2022] GET /identity/v3/projects/0c3d9801ad754740ae4b7891d05c103f => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:58.030998 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e840c0b-9db6-4645-b054-9de6fe5a4f58 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:58.047119 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e840c0b-9db6-4645-b054-9de6fe5a4f58 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:58.054015 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63bb97-6202-4b24-ad50-c9924d8ecbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:58.054928 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63bb97-6202-4b24-ad50-c9924d8ecbaf admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:58.055219 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63bb97-6202-4b24-ad50-c9924d8ecbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:58.055501 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63bb97-6202-4b24-ad50-c9924d8ecbaf admin admin] PATH_INFO: `/v3/projects/0c3d9801ad754740ae4b7891d05c103f/users/686414665f0c44959e81a0f7d5a500e1/roles/78b87341e5464907bcce0d16dca76299` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:58.057845 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab63bb97-6202-4b24-ad50-c9924d8ecbaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c3d9801ad754740ae4b7891d05c103f, user_id=686414665f0c44959e81a0f7d5a500e1, role_id=78b87341e5464907bcce0d16dca76299)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:58.061093 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab63bb97-6202-4b24-ad50-c9924d8ecbaf admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:58.149474 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 61/124] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Jan 5 14:38:58 2022] PUT /identity/v3/projects/0c3d9801ad754740ae4b7891d05c103f/users/686414665f0c44959e81a0f7d5a500e1/roles/78b87341e5464907bcce0d16dca76299 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:38:58.814145 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d87d4-b063-4188-b03e-9e6ec936e0c6 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:58.814660 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d87d4-b063-4188-b03e-9e6ec936e0c6 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:58.814660 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d87d4-b063-4188-b03e-9e6ec936e0c6 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:58.816390 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 64/125] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:38:58.821825 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087837d-7802-45b7-b161-f936b0014168 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:58.822250 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087837d-7802-45b7-b161-f936b0014168 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:58.822427 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087837d-7802-45b7-b161-f936b0014168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:58.850154 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-f087837d-7802-45b7-b161-f936b0014168 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:38:58.851363 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-f087837d-7802-45b7-b161-f936b0014168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:38:58.918267 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b9a68-993d-47b8-aee7-278d16a1f75e None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:58.918576 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b9a68-993d-47b8-aee7-278d16a1f75e None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:58.918835 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b9a68-993d-47b8-aee7-278d16a1f75e None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:58.920733 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 65/126] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:38:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 14:38:58.921833 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 62/127] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:38:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:38:58.925965 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65812cb6-1824-4498-a6a5-596ecc9be5c7 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:58.926258 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65812cb6-1824-4498-a6a5-596ecc9be5c7 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:58.926542 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65812cb6-1824-4498-a6a5-596ecc9be5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:58.950062 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087837d-7802-45b7-b161-f936b0014168 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:58.950245 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-65812cb6-1824-4498-a6a5-596ecc9be5c7 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:38:58.951356 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-65812cb6-1824-4498-a6a5-596ecc9be5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:38:58.962007 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087837d-7802-45b7-b161-f936b0014168 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:58.963439 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 66/128] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:38:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:38:58.974743 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7bad5-4e9f-4c2a-895c-6a15a3cf333c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:58.975533 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7bad5-4e9f-4c2a-895c-6a15a3cf333c admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:58.975824 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7bad5-4e9f-4c2a-895c-6a15a3cf333c admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:58.976107 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7bad5-4e9f-4c2a-895c-6a15a3cf333c admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:58.994015 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7bad5-4e9f-4c2a-895c-6a15a3cf333c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:38:59.002183 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-e9b7bad5-4e9f-4c2a-895c-6a15a3cf333c admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 05 14:38:59.003593 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 63/129] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:38:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:38:59.010901 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65812cb6-1824-4498-a6a5-596ecc9be5c7 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:59.015430 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7bad5-4e9f-4c2a-895c-6a15a3cf333c admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:59.028675 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65812cb6-1824-4498-a6a5-596ecc9be5c7 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:59.030185 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7bad5-4e9f-4c2a-895c-6a15a3cf333c admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:59.043166 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee038d9-d44a-4f1d-92ff-e2bf3ac2f970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:59.043870 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043b8bd-3375-42bf-ab13-fca61125d082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:59.043987 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee038d9-d44a-4f1d-92ff-e2bf3ac2f970 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:59.044264 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee038d9-d44a-4f1d-92ff-e2bf3ac2f970 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:59.044547 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee038d9-d44a-4f1d-92ff-e2bf3ac2f970 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:59.044836 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043b8bd-3375-42bf-ab13-fca61125d082 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:59.045299 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043b8bd-3375-42bf-ab13-fca61125d082 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:59.045729 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043b8bd-3375-42bf-ab13-fca61125d082 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:59.046896 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043b8bd-3375-42bf-ab13-fca61125d082 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:38:59.047392 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043b8bd-3375-42bf-ab13-fca61125d082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:59.049831 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee038d9-d44a-4f1d-92ff-e2bf3ac2f970 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:59.049974 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043b8bd-3375-42bf-ab13-fca61125d082 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:59.051570 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee038d9-d44a-4f1d-92ff-e2bf3ac2f970 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:59.053223 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 64/130] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:38:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:38:59.067658 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee038d9-d44a-4f1d-92ff-e2bf3ac2f970 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:59.070430 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 67/131] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jan 5 14:38:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:59.076273 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043b8bd-3375-42bf-ab13-fca61125d082 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:59.091670 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee038d9-d44a-4f1d-92ff-e2bf3ac2f970 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:59.092471 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043b8bd-3375-42bf-ab13-fca61125d082 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:59.106975 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac780abb-f97d-4058-b5b0-c4bb12f0eb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:59.107915 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac780abb-f97d-4058-b5b0-c4bb12f0eb23 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:59.108057 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeabb4d-9704-41b5-a297-81c6672ba986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:59.108201 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac780abb-f97d-4058-b5b0-c4bb12f0eb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:59.108500 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac780abb-f97d-4058-b5b0-c4bb12f0eb23 admin admin] PATH_INFO: `/v3/users/dc5002447aca48da8529616540d6b77d` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:59.108818 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeabb4d-9704-41b5-a297-81c6672ba986 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:59.109265 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeabb4d-9704-41b5-a297-81c6672ba986 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:59.109686 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeabb4d-9704-41b5-a297-81c6672ba986 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:59.110738 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeabb4d-9704-41b5-a297-81c6672ba986 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:59.112696 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeabb4d-9704-41b5-a297-81c6672ba986 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:59.134184 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac780abb-f97d-4058-b5b0-c4bb12f0eb23 admin admin] RBAC: Authorizing `identity:get_user(user_id=dc5002447aca48da8529616540d6b77d)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:59.136948 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac780abb-f97d-4058-b5b0-c4bb12f0eb23 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:59.138969 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 68/132] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:38:59 2022] GET /identity/v3/users/dc5002447aca48da8529616540d6b77d => generated 289 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:59.144968 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac780abb-f97d-4058-b5b0-c4bb12f0eb23 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:59.158727 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac780abb-f97d-4058-b5b0-c4bb12f0eb23 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:59.174636 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3ce23-51da-46b9-9f18-2210f8b936a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:59.175302 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3ce23-51da-46b9-9f18-2210f8b936a6 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:59.175591 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3ce23-51da-46b9-9f18-2210f8b936a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:59.175871 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3ce23-51da-46b9-9f18-2210f8b936a6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:59.190285 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3ce23-51da-46b9-9f18-2210f8b936a6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:59.194183 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3ce23-51da-46b9-9f18-2210f8b936a6 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:59.209162 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 69/133] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:38:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:38:59.215319 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3ce23-51da-46b9-9f18-2210f8b936a6 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:59.224015 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3ce23-51da-46b9-9f18-2210f8b936a6 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:59.233117 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac667dd-a1ac-419c-abda-ad0b668a0600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:59.233989 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac667dd-a1ac-419c-abda-ad0b668a0600 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:59.234274 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac667dd-a1ac-419c-abda-ad0b668a0600 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:59.234565 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac667dd-a1ac-419c-abda-ad0b668a0600 admin admin] PATH_INFO: `/v3/projects/0c3d9801ad754740ae4b7891d05c103f` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:59.235864 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac667dd-a1ac-419c-abda-ad0b668a0600 admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3d9801ad754740ae4b7891d05c103f)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:59.237965 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac667dd-a1ac-419c-abda-ad0b668a0600 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:59.239930 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 70/134] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:38:59 2022] GET /identity/v3/projects/0c3d9801ad754740ae4b7891d05c103f => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:38:59.242734 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 65/135] 10.222.0.30 () {60 vars in 1162 bytes} [Wed Jan 5 14:38:59 2022] POST /identity/v3/projects => generated 302 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 14:38:59.246276 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac667dd-a1ac-419c-abda-ad0b668a0600 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:38:59.256856 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac667dd-a1ac-419c-abda-ad0b668a0600 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:38:59.335185 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa3f7d-1ebd-4eb6-883f-9c3869ec33e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:38:59.335776 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa3f7d-1ebd-4eb6-883f-9c3869ec33e7 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:38:59.336065 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa3f7d-1ebd-4eb6-883f-9c3869ec33e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:38:59.336348 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa3f7d-1ebd-4eb6-883f-9c3869ec33e7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:38:59.337237 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa3f7d-1ebd-4eb6-883f-9c3869ec33e7 admin admin] RBAC: Adding query filter params (role.id=1024abc4fc3948018b1356e4a6671464, scope.project.id=0c3d9801ad754740ae4b7891d05c103f, user.id=dc5002447aca48da8529616540d6b77d) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:38:59.337557 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa3f7d-1ebd-4eb6-883f-9c3869ec33e7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:38:59.339541 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa3f7d-1ebd-4eb6-883f-9c3869ec33e7 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:38:59.345764 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 71/136] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:38:59 2022] GET /identity/v3/role_assignments?user.id=dc5002447aca48da8529616540d6b77d&scope.project.id=0c3d9801ad754740ae4b7891d05c103f&role.id=1024abc4fc3948018b1356e4a6671464 => generated 259 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:00.289727 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62cf65-a2dc-4eec-9128-728390ad5d66 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:00.290411 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62cf65-a2dc-4eec-9128-728390ad5d66 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:00.290411 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62cf65-a2dc-4eec-9128-728390ad5d66 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:00.292243 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 66/137] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:00.297196 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107d697-731b-44eb-ba80-6ceeaf27caba None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:00.297655 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107d697-731b-44eb-ba80-6ceeaf27caba None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:00.297801 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107d697-731b-44eb-ba80-6ceeaf27caba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:00.321266 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-6107d697-731b-44eb-ba80-6ceeaf27caba None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:00.322456 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-6107d697-731b-44eb-ba80-6ceeaf27caba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:00.335346 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 72/138] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:39:00.372542 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62cf65-a2dc-4eec-9128-728390ad5d66 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:00.391081 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62cf65-a2dc-4eec-9128-728390ad5d66 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:00.401686 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1dc8a6-c281-4e56-a4e1-d50b7a466590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:00.402494 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1dc8a6-c281-4e56-a4e1-d50b7a466590 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:00.402780 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1dc8a6-c281-4e56-a4e1-d50b7a466590 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:00.403055 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1dc8a6-c281-4e56-a4e1-d50b7a466590 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:00.413685 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1dc8a6-c281-4e56-a4e1-d50b7a466590 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:00.421404 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-7d1dc8a6-c281-4e56-a4e1-d50b7a466590 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 05 14:39:00.422765 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 67/139] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:00.428530 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107d697-731b-44eb-ba80-6ceeaf27caba None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:00.438242 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107d697-731b-44eb-ba80-6ceeaf27caba None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:00.449132 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc2e61-94e4-43c6-8e54-102089f8d433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:00.449796 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc2e61-94e4-43c6-8e54-102089f8d433 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:00.450085 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc2e61-94e4-43c6-8e54-102089f8d433 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:00.450369 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc2e61-94e4-43c6-8e54-102089f8d433 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:00.451139 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc2e61-94e4-43c6-8e54-102089f8d433 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:00.451446 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc2e61-94e4-43c6-8e54-102089f8d433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:00.453083 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc2e61-94e4-43c6-8e54-102089f8d433 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:00.461994 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 73/140] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jan 5 14:39:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:00.467819 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1dc8a6-c281-4e56-a4e1-d50b7a466590 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:00.482419 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1dc8a6-c281-4e56-a4e1-d50b7a466590 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:00.493443 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d09a42-2484-4701-9a7a-e841a12213e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:00.493443 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d09a42-2484-4701-9a7a-e841a12213e9 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:00.493443 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d09a42-2484-4701-9a7a-e841a12213e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:00.493443 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d09a42-2484-4701-9a7a-e841a12213e9 admin admin] PATH_INFO: `/v3/users/686414665f0c44959e81a0f7d5a500e1` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:00.494089 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d09a42-2484-4701-9a7a-e841a12213e9 admin admin] RBAC: Authorizing `identity:get_user(user_id=686414665f0c44959e81a0f7d5a500e1)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:00.495571 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d09a42-2484-4701-9a7a-e841a12213e9 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:00.496303 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 68/141] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:39:00 2022] GET /identity/v3/users/686414665f0c44959e81a0f7d5a500e1 => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:00.501913 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc2e61-94e4-43c6-8e54-102089f8d433 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:00.513156 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc2e61-94e4-43c6-8e54-102089f8d433 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:00.520584 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecd645-f747-4c04-b985-b019cf6a29b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:00.521482 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecd645-f747-4c04-b985-b019cf6a29b3 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:00.521928 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecd645-f747-4c04-b985-b019cf6a29b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:00.522350 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecd645-f747-4c04-b985-b019cf6a29b3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:00.532395 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecd645-f747-4c04-b985-b019cf6a29b3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:00.534340 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecd645-f747-4c04-b985-b019cf6a29b3 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:00.543340 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 74/142] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:39:00.548912 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d09a42-2484-4701-9a7a-e841a12213e9 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:00.562018 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d09a42-2484-4701-9a7a-e841a12213e9 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:00.570989 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d44a14-e735-4a3e-b73b-7c977fef767e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:00.572003 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d44a14-e735-4a3e-b73b-7c977fef767e admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:00.572459 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d44a14-e735-4a3e-b73b-7c977fef767e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:00.572889 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d44a14-e735-4a3e-b73b-7c977fef767e admin admin] PATH_INFO: `/v3/projects/5b2abea39102490891cc99e4df77ecc2` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:00.574829 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d44a14-e735-4a3e-b73b-7c977fef767e admin admin] RBAC: Authorizing `identity:get_project(project_id=5b2abea39102490891cc99e4df77ecc2)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:00.577022 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d44a14-e735-4a3e-b73b-7c977fef767e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:00.578840 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 69/143] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:00 2022] GET /identity/v3/projects/5b2abea39102490891cc99e4df77ecc2 => generated 312 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:00.584620 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecd645-f747-4c04-b985-b019cf6a29b3 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:00.594016 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecd645-f747-4c04-b985-b019cf6a29b3 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:00.605710 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922848e8-5f21-45e8-ada4-94a1d8f9bec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:00.606548 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922848e8-5f21-45e8-ada4-94a1d8f9bec5 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:00.606976 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922848e8-5f21-45e8-ada4-94a1d8f9bec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:00.607427 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922848e8-5f21-45e8-ada4-94a1d8f9bec5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:00.608415 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922848e8-5f21-45e8-ada4-94a1d8f9bec5 admin admin] RBAC: Adding query filter params (role.id=eaba1e26bf0040868b08b042a7859698, scope.project.id=5b2abea39102490891cc99e4df77ecc2, user.id=686414665f0c44959e81a0f7d5a500e1) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:00.608880 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922848e8-5f21-45e8-ada4-94a1d8f9bec5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:00.610928 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922848e8-5f21-45e8-ada4-94a1d8f9bec5 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:00.617505 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 75/144] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:39:00 2022] GET /identity/v3/role_assignments?user.id=686414665f0c44959e81a0f7d5a500e1&scope.project.id=5b2abea39102490891cc99e4df77ecc2&role.id=eaba1e26bf0040868b08b042a7859698 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:01.258410 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048dec5-a0cc-456f-813c-7d59818c4d58 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:01.258940 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048dec5-a0cc-456f-813c-7d59818c4d58 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:01.259366 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048dec5-a0cc-456f-813c-7d59818c4d58 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:01.262221 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 70/145] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:01.268332 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88305b0-7baf-4510-87df-c4c9714a41c8 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:01.268950 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88305b0-7baf-4510-87df-c4c9714a41c8 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:01.269499 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88305b0-7baf-4510-87df-c4c9714a41c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:01.291923 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-d88305b0-7baf-4510-87df-c4c9714a41c8 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:01.293969 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-d88305b0-7baf-4510-87df-c4c9714a41c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:01.307291 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 76/146] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:01.359017 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048dec5-a0cc-456f-813c-7d59818c4d58 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:01.380891 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048dec5-a0cc-456f-813c-7d59818c4d58 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:01.388770 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2f30c-3ed4-4f8e-b987-bcd5c9a9d65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:01.389878 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2f30c-3ed4-4f8e-b987-bcd5c9a9d65b admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:01.390402 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2f30c-3ed4-4f8e-b987-bcd5c9a9d65b admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:01.390874 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2f30c-3ed4-4f8e-b987-bcd5c9a9d65b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:01.402234 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2f30c-3ed4-4f8e-b987-bcd5c9a9d65b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:01.409986 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-5cf2f30c-3ed4-4f8e-b987-bcd5c9a9d65b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 05 14:39:01.411582 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 71/147] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:01.418316 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88305b0-7baf-4510-87df-c4c9714a41c8 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:01.427795 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88305b0-7baf-4510-87df-c4c9714a41c8 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:01.437546 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1e52b-f5cf-4e47-86d1-bbcb853f6759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:01.438505 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1e52b-f5cf-4e47-86d1-bbcb853f6759 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:01.439011 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1e52b-f5cf-4e47-86d1-bbcb853f6759 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:01.439507 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1e52b-f5cf-4e47-86d1-bbcb853f6759 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:01.440474 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1e52b-f5cf-4e47-86d1-bbcb853f6759 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:01.440982 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1e52b-f5cf-4e47-86d1-bbcb853f6759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:01.442829 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1e52b-f5cf-4e47-86d1-bbcb853f6759 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:01.452672 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 77/148] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jan 5 14:39:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:01.458602 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2f30c-3ed4-4f8e-b987-bcd5c9a9d65b admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:01.469237 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2f30c-3ed4-4f8e-b987-bcd5c9a9d65b admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:01.476941 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c814359-bfda-4798-9b91-0dfd2c214d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:01.478239 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c814359-bfda-4798-9b91-0dfd2c214d86 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:01.478752 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c814359-bfda-4798-9b91-0dfd2c214d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:01.479231 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c814359-bfda-4798-9b91-0dfd2c214d86 admin admin] PATH_INFO: `/v3/users/686414665f0c44959e81a0f7d5a500e1` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:01.485963 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c814359-bfda-4798-9b91-0dfd2c214d86 admin admin] RBAC: Authorizing `identity:get_user(user_id=686414665f0c44959e81a0f7d5a500e1)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:01.488456 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c814359-bfda-4798-9b91-0dfd2c214d86 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:01.490811 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 72/149] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:39:01 2022] GET /identity/v3/users/686414665f0c44959e81a0f7d5a500e1 => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:01.496830 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1e52b-f5cf-4e47-86d1-bbcb853f6759 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:01.507209 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1e52b-f5cf-4e47-86d1-bbcb853f6759 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:01.517234 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ac731-5b26-4122-8fb3-7607274f7d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:01.517909 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ac731-5b26-4122-8fb3-7607274f7d40 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:01.518193 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ac731-5b26-4122-8fb3-7607274f7d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:01.518473 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ac731-5b26-4122-8fb3-7607274f7d40 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:01.533375 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ac731-5b26-4122-8fb3-7607274f7d40 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:01.535153 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ac731-5b26-4122-8fb3-7607274f7d40 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:01.544807 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 78/150] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:39:01.552394 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c814359-bfda-4798-9b91-0dfd2c214d86 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:01.567668 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c814359-bfda-4798-9b91-0dfd2c214d86 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:01.575606 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f39252-322e-4cef-b2fc-6c58d115b768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:01.576532 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f39252-322e-4cef-b2fc-6c58d115b768 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:01.576822 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f39252-322e-4cef-b2fc-6c58d115b768 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:01.577122 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f39252-322e-4cef-b2fc-6c58d115b768 admin admin] PATH_INFO: `/v3/projects/0c3d9801ad754740ae4b7891d05c103f` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:01.578420 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f39252-322e-4cef-b2fc-6c58d115b768 admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3d9801ad754740ae4b7891d05c103f)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:01.580552 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f39252-322e-4cef-b2fc-6c58d115b768 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:01.585373 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 73/151] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:01 2022] GET /identity/v3/projects/0c3d9801ad754740ae4b7891d05c103f => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:01.588768 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ac731-5b26-4122-8fb3-7607274f7d40 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:01.602766 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ac731-5b26-4122-8fb3-7607274f7d40 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:01.610812 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627ddc6-deb9-458a-b9ae-ae9ada421390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:01.611477 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627ddc6-deb9-458a-b9ae-ae9ada421390 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:01.611767 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627ddc6-deb9-458a-b9ae-ae9ada421390 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:01.612046 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627ddc6-deb9-458a-b9ae-ae9ada421390 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:01.612908 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627ddc6-deb9-458a-b9ae-ae9ada421390 admin admin] RBAC: Adding query filter params (role.id=eaba1e26bf0040868b08b042a7859698, scope.project.id=0c3d9801ad754740ae4b7891d05c103f, user.id=686414665f0c44959e81a0f7d5a500e1) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:01.613251 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627ddc6-deb9-458a-b9ae-ae9ada421390 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:01.615140 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627ddc6-deb9-458a-b9ae-ae9ada421390 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:01.625646 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 79/152] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:39:01 2022] GET /identity/v3/role_assignments?user.id=686414665f0c44959e81a0f7d5a500e1&scope.project.id=0c3d9801ad754740ae4b7891d05c103f&role.id=eaba1e26bf0040868b08b042a7859698 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:01.634713 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e979561-ea0c-4658-89aa-812ac724d55e None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:01.635050 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e979561-ea0c-4658-89aa-812ac724d55e None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:01.635351 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e979561-ea0c-4658-89aa-812ac724d55e None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:01.637299 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 74/153] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:01.643189 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232d34c-7c20-4cb6-a243-1779e128fd90 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:01.643493 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232d34c-7c20-4cb6-a243-1779e128fd90 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:01.643756 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232d34c-7c20-4cb6-a243-1779e128fd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:01.671068 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-b232d34c-7c20-4cb6-a243-1779e128fd90 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:01.672292 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-b232d34c-7c20-4cb6-a243-1779e128fd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:01.685302 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 80/154] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:01.723282 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e979561-ea0c-4658-89aa-812ac724d55e None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:01.739515 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e979561-ea0c-4658-89aa-812ac724d55e None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:01.750192 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cec95f-1010-4ba1-b96c-936b1a038a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:01.751115 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cec95f-1010-4ba1-b96c-936b1a038a77 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:01.751441 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cec95f-1010-4ba1-b96c-936b1a038a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:01.751722 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cec95f-1010-4ba1-b96c-936b1a038a77 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:01.763483 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cec95f-1010-4ba1-b96c-936b1a038a77 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:01.775196 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-68cec95f-1010-4ba1-b96c-936b1a038a77 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 05 14:39:01.777013 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 75/155] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:39:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:01.782991 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232d34c-7c20-4cb6-a243-1779e128fd90 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:01.798483 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232d34c-7c20-4cb6-a243-1779e128fd90 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:01.814889 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f25d07-6485-45ce-80c6-375ba3a71eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:01.815585 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f25d07-6485-45ce-80c6-375ba3a71eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:01.815873 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f25d07-6485-45ce-80c6-375ba3a71eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:01.816155 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f25d07-6485-45ce-80c6-375ba3a71eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:01.816956 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f25d07-6485-45ce-80c6-375ba3a71eb3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:01.817293 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f25d07-6485-45ce-80c6-375ba3a71eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:01.818984 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f25d07-6485-45ce-80c6-375ba3a71eb3 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:01.832940 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 81/156] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:01.839001 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cec95f-1010-4ba1-b96c-936b1a038a77 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:01.849551 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cec95f-1010-4ba1-b96c-936b1a038a77 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:01.862681 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1bb5e-e2c9-4693-9b0e-deb89309c9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:01.863624 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1bb5e-e2c9-4693-9b0e-deb89309c9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:01.863968 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1bb5e-e2c9-4693-9b0e-deb89309c9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:01.864250 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1bb5e-e2c9-4693-9b0e-deb89309c9b7 admin admin] PATH_INFO: `/v3/users/a7c8dfde39e84abdb68271d16eaed381` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:01.865543 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1bb5e-e2c9-4693-9b0e-deb89309c9b7 admin admin] RBAC: Authorizing `identity:get_user(user_id=a7c8dfde39e84abdb68271d16eaed381)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:01.867495 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1bb5e-e2c9-4693-9b0e-deb89309c9b7 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:01.869197 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 76/157] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:39:01 2022] GET /identity/v3/users/a7c8dfde39e84abdb68271d16eaed381 => generated 247 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:01.875548 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f25d07-6485-45ce-80c6-375ba3a71eb3 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:01.890272 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f25d07-6485-45ce-80c6-375ba3a71eb3 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:01.901383 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f4675-b893-4575-af3e-fb8ff2f99802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:01.902560 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f4675-b893-4575-af3e-fb8ff2f99802 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:01.902851 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f4675-b893-4575-af3e-fb8ff2f99802 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:01.903131 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f4675-b893-4575-af3e-fb8ff2f99802 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:01.916896 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f4675-b893-4575-af3e-fb8ff2f99802 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:01.918927 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f4675-b893-4575-af3e-fb8ff2f99802 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:01.930523 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 82/158] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:39:01.936401 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1bb5e-e2c9-4693-9b0e-deb89309c9b7 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:01.951969 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1bb5e-e2c9-4693-9b0e-deb89309c9b7 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:01.961232 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701a1ad-946f-49a3-ae58-cb18951f9b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:01.962165 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701a1ad-946f-49a3-ae58-cb18951f9b1d admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:01.962449 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701a1ad-946f-49a3-ae58-cb18951f9b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:01.962724 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701a1ad-946f-49a3-ae58-cb18951f9b1d admin admin] PATH_INFO: `/v3/projects/0c3d9801ad754740ae4b7891d05c103f` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:01.963998 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701a1ad-946f-49a3-ae58-cb18951f9b1d admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3d9801ad754740ae4b7891d05c103f)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:01.966334 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701a1ad-946f-49a3-ae58-cb18951f9b1d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:01.968183 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 77/159] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:01 2022] GET /identity/v3/projects/0c3d9801ad754740ae4b7891d05c103f => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:01.974068 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f4675-b893-4575-af3e-fb8ff2f99802 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:01.985409 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f4675-b893-4575-af3e-fb8ff2f99802 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:01.990818 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac134375-7b5f-46ca-905c-bca3bc2ea9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:01.991514 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac134375-7b5f-46ca-905c-bca3bc2ea9ee admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:01.991798 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac134375-7b5f-46ca-905c-bca3bc2ea9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:01.992116 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac134375-7b5f-46ca-905c-bca3bc2ea9ee admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:01.993037 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac134375-7b5f-46ca-905c-bca3bc2ea9ee admin admin] RBAC: Adding query filter params (role.id=494131614fcf424f92e0817fa7ff6961, scope.project.id=0c3d9801ad754740ae4b7891d05c103f, user.id=a7c8dfde39e84abdb68271d16eaed381) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:01.993457 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac134375-7b5f-46ca-905c-bca3bc2ea9ee admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:01.995505 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac134375-7b5f-46ca-905c-bca3bc2ea9ee admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:02.002542 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 83/160] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:39:01 2022] GET /identity/v3/role_assignments?user.id=a7c8dfde39e84abdb68271d16eaed381&scope.project.id=0c3d9801ad754740ae4b7891d05c103f&role.id=494131614fcf424f92e0817fa7ff6961 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:02.014960 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb5d91-c8bb-4ab8-b06f-a74222856cae None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:02.015237 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb5d91-c8bb-4ab8-b06f-a74222856cae None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:02.015438 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb5d91-c8bb-4ab8-b06f-a74222856cae None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:02.017399 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 78/161] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:02.023390 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df372a3-84ed-480d-bdcc-6e1e018bba67 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:02.023685 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df372a3-84ed-480d-bdcc-6e1e018bba67 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:02.023943 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df372a3-84ed-480d-bdcc-6e1e018bba67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:02.044302 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-0df372a3-84ed-480d-bdcc-6e1e018bba67 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:02.045561 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-0df372a3-84ed-480d-bdcc-6e1e018bba67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:02.053883 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 84/162] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:02.080605 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb5d91-c8bb-4ab8-b06f-a74222856cae None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:02.094191 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb5d91-c8bb-4ab8-b06f-a74222856cae None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:02.099297 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91311a48-d76e-4551-92b4-8c276c8e03ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:02.100232 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91311a48-d76e-4551-92b4-8c276c8e03ee admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:02.100537 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91311a48-d76e-4551-92b4-8c276c8e03ee admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:02.100816 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91311a48-d76e-4551-92b4-8c276c8e03ee admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:02.113901 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91311a48-d76e-4551-92b4-8c276c8e03ee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:02.122064 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-91311a48-d76e-4551-92b4-8c276c8e03ee admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 05 14:39:02.123429 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 79/163] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Jan 5 14:39:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:02.139028 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df372a3-84ed-480d-bdcc-6e1e018bba67 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:02.149813 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df372a3-84ed-480d-bdcc-6e1e018bba67 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:02.158496 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384ab80-f91c-4d45-997d-c7c9d8b2912d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:02.159192 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384ab80-f91c-4d45-997d-c7c9d8b2912d admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:02.159475 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384ab80-f91c-4d45-997d-c7c9d8b2912d admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:02.159752 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384ab80-f91c-4d45-997d-c7c9d8b2912d admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:02.160532 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384ab80-f91c-4d45-997d-c7c9d8b2912d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:02.160835 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384ab80-f91c-4d45-997d-c7c9d8b2912d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:02.162636 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384ab80-f91c-4d45-997d-c7c9d8b2912d admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:02.178555 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 85/164] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:39:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:02.185191 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91311a48-d76e-4551-92b4-8c276c8e03ee admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:02.197013 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91311a48-d76e-4551-92b4-8c276c8e03ee admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:02.207717 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba38999-015c-494f-8865-dd2365a6dbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:02.208672 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba38999-015c-494f-8865-dd2365a6dbf4 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:02.208967 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba38999-015c-494f-8865-dd2365a6dbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:02.209319 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba38999-015c-494f-8865-dd2365a6dbf4 admin admin] PATH_INFO: `/v3/users/686414665f0c44959e81a0f7d5a500e1` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:02.211753 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba38999-015c-494f-8865-dd2365a6dbf4 admin admin] RBAC: Authorizing `identity:get_user(user_id=686414665f0c44959e81a0f7d5a500e1)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:02.214100 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba38999-015c-494f-8865-dd2365a6dbf4 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:02.215947 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 80/165] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:39:02 2022] GET /identity/v3/users/686414665f0c44959e81a0f7d5a500e1 => generated 275 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:02.221819 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384ab80-f91c-4d45-997d-c7c9d8b2912d admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:02.236170 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384ab80-f91c-4d45-997d-c7c9d8b2912d admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:02.241025 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed829f77-36cb-4503-991c-049e415ab286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:02.241767 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed829f77-36cb-4503-991c-049e415ab286 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:02.242118 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed829f77-36cb-4503-991c-049e415ab286 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:02.242461 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed829f77-36cb-4503-991c-049e415ab286 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:02.257454 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed829f77-36cb-4503-991c-049e415ab286 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:02.259333 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed829f77-36cb-4503-991c-049e415ab286 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:02.270699 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 86/166] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:39:02.277442 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba38999-015c-494f-8865-dd2365a6dbf4 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:02.289111 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba38999-015c-494f-8865-dd2365a6dbf4 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:02.294090 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c7196a-a0e8-47b0-8da9-4bcfc070dd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:02.295159 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7196a-a0e8-47b0-8da9-4bcfc070dd28 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:02.295507 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7196a-a0e8-47b0-8da9-4bcfc070dd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:02.295848 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7196a-a0e8-47b0-8da9-4bcfc070dd28 admin admin] PATH_INFO: `/v3/projects/0c3d9801ad754740ae4b7891d05c103f` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:02.297342 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c7196a-a0e8-47b0-8da9-4bcfc070dd28 admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3d9801ad754740ae4b7891d05c103f)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:02.299607 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c7196a-a0e8-47b0-8da9-4bcfc070dd28 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:02.301464 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 81/167] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:02 2022] GET /identity/v3/projects/0c3d9801ad754740ae4b7891d05c103f => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:02.307206 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed829f77-36cb-4503-991c-049e415ab286 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:02.316790 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed829f77-36cb-4503-991c-049e415ab286 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:02.321407 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9b7ef-3d64-4966-8673-b89d017e765d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:02.322053 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9b7ef-3d64-4966-8673-b89d017e765d admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:02.322336 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9b7ef-3d64-4966-8673-b89d017e765d admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:02.322614 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9b7ef-3d64-4966-8673-b89d017e765d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:02.323522 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9b7ef-3d64-4966-8673-b89d017e765d admin admin] RBAC: Adding query filter params (role.id=78b87341e5464907bcce0d16dca76299, scope.project.id=0c3d9801ad754740ae4b7891d05c103f, user.id=686414665f0c44959e81a0f7d5a500e1) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:02.324335 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9b7ef-3d64-4966-8673-b89d017e765d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:02.326251 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9b7ef-3d64-4966-8673-b89d017e765d admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:02.332737 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 87/168] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:39:02 2022] GET /identity/v3/role_assignments?user.id=686414665f0c44959e81a0f7d5a500e1&scope.project.id=0c3d9801ad754740ae4b7891d05c103f&role.id=78b87341e5464907bcce0d16dca76299 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:02.729430 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc9527-5129-46ae-ae88-c87141051279 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:02.730446 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc9527-5129-46ae-ae88-c87141051279 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:02.730446 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc9527-5129-46ae-ae88-c87141051279 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:02.732245 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 82/169] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:02.737471 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7d821-110a-4e97-a92c-0b9b8477dfd5 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:02.737829 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7d821-110a-4e97-a92c-0b9b8477dfd5 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:02.738178 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7d821-110a-4e97-a92c-0b9b8477dfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:02.756234 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-e6e7d821-110a-4e97-a92c-0b9b8477dfd5 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:02.757427 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-e6e7d821-110a-4e97-a92c-0b9b8477dfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:02.764746 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 88/170] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:02.790340 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc9527-5129-46ae-ae88-c87141051279 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:02.802746 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc9527-5129-46ae-ae88-c87141051279 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:02.806941 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb139d7-1196-458d-a73e-7e38ce7841be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:02.807762 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb139d7-1196-458d-a73e-7e38ce7841be admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:02.808603 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb139d7-1196-458d-a73e-7e38ce7841be admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:02.808875 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb139d7-1196-458d-a73e-7e38ce7841be admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:02.810071 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb139d7-1196-458d-a73e-7e38ce7841be admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:02.811753 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb139d7-1196-458d-a73e-7e38ce7841be admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:02.813520 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 83/171] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:02.818734 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7d821-110a-4e97-a92c-0b9b8477dfd5 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:02.827579 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7d821-110a-4e97-a92c-0b9b8477dfd5 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:02.831875 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ceca62-eeae-4c41-8af2-1a94c3819dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:02.832528 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ceca62-eeae-4c41-8af2-1a94c3819dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:02.832810 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ceca62-eeae-4c41-8af2-1a94c3819dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:02.833154 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ceca62-eeae-4c41-8af2-1a94c3819dd7 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:02.833915 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ceca62-eeae-4c41-8af2-1a94c3819dd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:02.834952 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING py.warnings [None req-e0ceca62-eeae-4c41-8af2-1a94c3819dd7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:39:02.834952 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: warnings.warn(msg) Jan 05 14:39:02.834952 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: Jan 05 14:39:02.835528 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2c4a9-8d22-4744-a552-e8179a6f9e08 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:02.835814 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2c4a9-8d22-4744-a552-e8179a6f9e08 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:02.836089 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2c4a9-8d22-4744-a552-e8179a6f9e08 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:02.836221 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ceca62-eeae-4c41-8af2-1a94c3819dd7 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:02.837865 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 84/172] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 14:39:02.842486 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a44642-59e6-4a07-9903-4b878d978174 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:02.842771 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a44642-59e6-4a07-9903-4b878d978174 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:02.843047 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a44642-59e6-4a07-9903-4b878d978174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:02.860558 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-53a44642-59e6-4a07-9903-4b878d978174 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:02.864696 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-53a44642-59e6-4a07-9903-4b878d978174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:02.869035 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 85/173] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:39:02.892834 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a44642-59e6-4a07-9903-4b878d978174 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:02.901351 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a44642-59e6-4a07-9903-4b878d978174 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:02.906266 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac41ac-955f-4383-885c-158fd13a19ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:02.909157 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac41ac-955f-4383-885c-158fd13a19ab admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:02.909157 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac41ac-955f-4383-885c-158fd13a19ab admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:02.909157 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac41ac-955f-4383-885c-158fd13a19ab admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:02.917430 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac41ac-955f-4383-885c-158fd13a19ab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:02.924521 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-60ac41ac-955f-4383-885c-158fd13a19ab admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 05 14:39:02.925684 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 86/174] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:39:02.930859 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac41ac-955f-4383-885c-158fd13a19ab admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:02.939855 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac41ac-955f-4383-885c-158fd13a19ab admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:02.944127 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec66db-6f7c-4e22-a9c3-37fa7bd8fc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:02.944706 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec66db-6f7c-4e22-a9c3-37fa7bd8fc9d admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:02.944983 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec66db-6f7c-4e22-a9c3-37fa7bd8fc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:02.945284 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec66db-6f7c-4e22-a9c3-37fa7bd8fc9d admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:02.946018 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec66db-6f7c-4e22-a9c3-37fa7bd8fc9d admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:02.946316 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec66db-6f7c-4e22-a9c3-37fa7bd8fc9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:02.947901 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec66db-6f7c-4e22-a9c3-37fa7bd8fc9d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:02.956507 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 87/175] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jan 5 14:39:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:02.961469 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec66db-6f7c-4e22-a9c3-37fa7bd8fc9d admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:02.962907 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 89/176] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Jan 5 14:39:02 2022] POST /identity/v3/users => generated 283 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:39:02.971539 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec66db-6f7c-4e22-a9c3-37fa7bd8fc9d admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:02.976152 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddbf00-7fd6-4d1a-847a-e2d8f63dd557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:02.977049 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddbf00-7fd6-4d1a-847a-e2d8f63dd557 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:02.977354 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddbf00-7fd6-4d1a-847a-e2d8f63dd557 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:02.977625 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddbf00-7fd6-4d1a-847a-e2d8f63dd557 admin admin] PATH_INFO: `/v3/users/dc5002447aca48da8529616540d6b77d` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:02.978894 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ddbf00-7fd6-4d1a-847a-e2d8f63dd557 admin admin] RBAC: Authorizing `identity:get_user(user_id=dc5002447aca48da8529616540d6b77d)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:02.981310 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ddbf00-7fd6-4d1a-847a-e2d8f63dd557 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:02.982996 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 88/177] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:39:02 2022] GET /identity/v3/users/dc5002447aca48da8529616540d6b77d => generated 289 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:02.988703 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ceca62-eeae-4c41-8af2-1a94c3819dd7 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:02.998757 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ceca62-eeae-4c41-8af2-1a94c3819dd7 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:03.003223 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2dec4-1f93-4826-ae96-95b3200a9f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:03.004391 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2dec4-1f93-4826-ae96-95b3200a9f8b admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:03.004673 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2dec4-1f93-4826-ae96-95b3200a9f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:03.004944 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2dec4-1f93-4826-ae96-95b3200a9f8b admin admin] PATH_INFO: `/v3/projects/0c3d9801ad754740ae4b7891d05c103f` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:03.006242 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2dec4-1f93-4826-ae96-95b3200a9f8b admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3d9801ad754740ae4b7891d05c103f)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:03.008382 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2dec4-1f93-4826-ae96-95b3200a9f8b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:03.010341 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 90/178] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:02 2022] GET /identity/v3/projects/0c3d9801ad754740ae4b7891d05c103f => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:03.016347 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddbf00-7fd6-4d1a-847a-e2d8f63dd557 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:03.026499 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddbf00-7fd6-4d1a-847a-e2d8f63dd557 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:03.031809 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d9f3a-7562-4182-a66d-83c13b317ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:03.032711 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d9f3a-7562-4182-a66d-83c13b317ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:03.032991 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d9f3a-7562-4182-a66d-83c13b317ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:03.033295 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d9f3a-7562-4182-a66d-83c13b317ea2 admin admin] PATH_INFO: `/v3/projects/0c3d9801ad754740ae4b7891d05c103f/users/dc5002447aca48da8529616540d6b77d/roles/1024abc4fc3948018b1356e4a6671464` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:03.035291 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d9f3a-7562-4182-a66d-83c13b317ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c3d9801ad754740ae4b7891d05c103f, user_id=dc5002447aca48da8529616540d6b77d, role_id=1024abc4fc3948018b1356e4a6671464)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:03.038032 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d9f3a-7562-4182-a66d-83c13b317ea2 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:03.174347 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 89/179] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Jan 5 14:39:03 2022] PUT /identity/v3/projects/0c3d9801ad754740ae4b7891d05c103f/users/dc5002447aca48da8529616540d6b77d/roles/1024abc4fc3948018b1356e4a6671464 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:39:05.457482 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2103018-7e35-4f8a-a5d4-1910161b581e None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:05.458503 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2103018-7e35-4f8a-a5d4-1910161b581e None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:05.458993 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2103018-7e35-4f8a-a5d4-1910161b581e None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:05.461302 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 91/180] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:05.466808 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef86cb-801b-4549-abac-bc07ea333c61 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:05.467603 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef86cb-801b-4549-abac-bc07ea333c61 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:05.468078 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef86cb-801b-4549-abac-bc07ea333c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:05.485851 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-47ef86cb-801b-4549-abac-bc07ea333c61 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:05.487322 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-47ef86cb-801b-4549-abac-bc07ea333c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:05.553508 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 90/181] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:05.578504 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2103018-7e35-4f8a-a5d4-1910161b581e None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:05.591463 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2103018-7e35-4f8a-a5d4-1910161b581e None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:05.595872 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b200873-8d0e-4924-9c79-30f3cefe9da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:05.596664 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b200873-8d0e-4924-9c79-30f3cefe9da0 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:05.596942 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b200873-8d0e-4924-9c79-30f3cefe9da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:05.597250 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b200873-8d0e-4924-9c79-30f3cefe9da0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:05.608090 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b200873-8d0e-4924-9c79-30f3cefe9da0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:05.615212 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-4b200873-8d0e-4924-9c79-30f3cefe9da0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 05 14:39:05.616710 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 92/182] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:39:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:05.622672 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055e278-ba5e-448a-bf94-e16b85c38468 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:05.622817 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b200873-8d0e-4924-9c79-30f3cefe9da0 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:05.623454 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055e278-ba5e-448a-bf94-e16b85c38468 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:05.623926 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055e278-ba5e-448a-bf94-e16b85c38468 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:05.625920 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 91/183] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:05.631551 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959b26a-ed99-4f1e-9209-e1bf1906507a None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:05.632061 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959b26a-ed99-4f1e-9209-e1bf1906507a None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:05.632526 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959b26a-ed99-4f1e-9209-e1bf1906507a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:05.633872 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b200873-8d0e-4924-9c79-30f3cefe9da0 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:05.638396 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a92bf-4a63-4114-b79d-257c0dedfe0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:05.639050 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a92bf-4a63-4114-b79d-257c0dedfe0b admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:05.639331 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a92bf-4a63-4114-b79d-257c0dedfe0b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:05.639607 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a92bf-4a63-4114-b79d-257c0dedfe0b admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:05.640366 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a92bf-4a63-4114-b79d-257c0dedfe0b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:05.640670 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a92bf-4a63-4114-b79d-257c0dedfe0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:05.642323 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a92bf-4a63-4114-b79d-257c0dedfe0b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:05.651128 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 93/184] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:05.653583 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-6959b26a-ed99-4f1e-9209-e1bf1906507a None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:05.654768 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-6959b26a-ed99-4f1e-9209-e1bf1906507a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:05.657114 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985ca90-092e-435b-8af9-f042d2d9d61b None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:05.657409 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985ca90-092e-435b-8af9-f042d2d9d61b None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:05.657690 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985ca90-092e-435b-8af9-f042d2d9d61b None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:05.659524 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 94/185] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:05.660078 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985ca90-092e-435b-8af9-f042d2d9d61b None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:05.662606 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 92/186] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:39:05.666464 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f0ea6-2fd7-4711-9df1-aa7b0440b29a None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:05.666963 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f0ea6-2fd7-4711-9df1-aa7b0440b29a None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:05.667503 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f0ea6-2fd7-4711-9df1-aa7b0440b29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:05.673000 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985ca90-092e-435b-8af9-f042d2d9d61b None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:05.677295 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773c470-e4fc-476b-9cb2-6016252b9e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:05.678148 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773c470-e4fc-476b-9cb2-6016252b9e4c admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:05.678428 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773c470-e4fc-476b-9cb2-6016252b9e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:05.678702 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773c470-e4fc-476b-9cb2-6016252b9e4c admin admin] PATH_INFO: `/v3/users/ca85f67760704ec88731db1e307e24f9` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:05.686098 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-049f0ea6-2fd7-4711-9df1-aa7b0440b29a None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:05.687729 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-049f0ea6-2fd7-4711-9df1-aa7b0440b29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:05.692188 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773c470-e4fc-476b-9cb2-6016252b9e4c admin admin] RBAC: Authorizing `identity:get_user(user_id=ca85f67760704ec88731db1e307e24f9)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:05.694382 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773c470-e4fc-476b-9cb2-6016252b9e4c admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:05.695242 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 93/187] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:05.697095 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 95/188] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:39:05 2022] GET /identity/v3/users/ca85f67760704ec88731db1e307e24f9 => generated 283 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:05.697095 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773c470-e4fc-476b-9cb2-6016252b9e4c admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:05.697770 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d59626-a8d9-4504-954e-ec8688ce2bdd None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:05.698130 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d59626-a8d9-4504-954e-ec8688ce2bdd None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:05.699015 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d59626-a8d9-4504-954e-ec8688ce2bdd None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:05.700795 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 94/189] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:05.703337 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d59626-a8d9-4504-954e-ec8688ce2bdd None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:05.709393 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773c470-e4fc-476b-9cb2-6016252b9e4c admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:05.713589 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce1720-9bf0-4cc5-bddd-c3f02bec24d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:05.714937 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce1720-9bf0-4cc5-bddd-c3f02bec24d1 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:05.715214 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce1720-9bf0-4cc5-bddd-c3f02bec24d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:05.715490 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce1720-9bf0-4cc5-bddd-c3f02bec24d1 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:05.719016 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d59626-a8d9-4504-954e-ec8688ce2bdd None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:05.726381 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b372f-b7ec-4b12-ba29-5c2f92c3bd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:05.726381 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b372f-b7ec-4b12-ba29-5c2f92c3bd15 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:05.726381 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b372f-b7ec-4b12-ba29-5c2f92c3bd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:05.726381 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b372f-b7ec-4b12-ba29-5c2f92c3bd15 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:05.730685 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce1720-9bf0-4cc5-bddd-c3f02bec24d1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:05.734589 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b372f-b7ec-4b12-ba29-5c2f92c3bd15 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:05.736350 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b372f-b7ec-4b12-ba29-5c2f92c3bd15 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:05.739227 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-59ce1720-9bf0-4cc5-bddd-c3f02bec24d1 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 05 14:39:05.741201 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 96/190] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:05.742848 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cc123-0d31-485b-81ee-79c7460c1bb5 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:05.743272 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cc123-0d31-485b-81ee-79c7460c1bb5 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:05.743687 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cc123-0d31-485b-81ee-79c7460c1bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:05.745499 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 95/191] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 05 14:39:05.746136 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b372f-b7ec-4b12-ba29-5c2f92c3bd15 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:05.759157 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b372f-b7ec-4b12-ba29-5c2f92c3bd15 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:05.763304 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-0b3cc123-0d31-485b-81ee-79c7460c1bb5 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:05.764483 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-0b3cc123-0d31-485b-81ee-79c7460c1bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:05.765732 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc1c09-eb92-4e0e-8c9b-49321d67dbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:05.766910 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc1c09-eb92-4e0e-8c9b-49321d67dbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:05.767333 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc1c09-eb92-4e0e-8c9b-49321d67dbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:05.767747 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc1c09-eb92-4e0e-8c9b-49321d67dbd9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:05.772598 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 97/192] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:05.773717 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cc123-0d31-485b-81ee-79c7460c1bb5 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:05.780022 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc1c09-eb92-4e0e-8c9b-49321d67dbd9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:05.784012 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cc123-0d31-485b-81ee-79c7460c1bb5 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:05.789471 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688a453-c323-4103-9552-e4d0cf228f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:05.789691 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-14bc1c09-eb92-4e0e-8c9b-49321d67dbd9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 05 14:39:05.790386 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688a453-c323-4103-9552-e4d0cf228f81 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:05.790670 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688a453-c323-4103-9552-e4d0cf228f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:05.790943 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688a453-c323-4103-9552-e4d0cf228f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:05.791193 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 96/193] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Jan 5 14:39:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:05.792371 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc1c09-eb92-4e0e-8c9b-49321d67dbd9 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:05.796923 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688a453-c323-4103-9552-e4d0cf228f81 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:05.797273 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688a453-c323-4103-9552-e4d0cf228f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:05.799663 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688a453-c323-4103-9552-e4d0cf228f81 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:05.804385 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc1c09-eb92-4e0e-8c9b-49321d67dbd9 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:05.813475 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 98/194] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jan 5 14:39:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:05.813475 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688a453-c323-4103-9552-e4d0cf228f81 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:05.814578 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66408a0-bf92-4f43-93c9-f0bee4945bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:05.815425 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66408a0-bf92-4f43-93c9-f0bee4945bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:05.815699 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66408a0-bf92-4f43-93c9-f0bee4945bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:05.815964 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66408a0-bf92-4f43-93c9-f0bee4945bc1 admin admin] PATH_INFO: `/v3/projects/c6f6acecb2424b65a947c7f56c378682` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:05.817174 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66408a0-bf92-4f43-93c9-f0bee4945bc1 admin admin] RBAC: Authorizing `identity:get_project(project_id=c6f6acecb2424b65a947c7f56c378682)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:05.819192 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66408a0-bf92-4f43-93c9-f0bee4945bc1 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:05.821839 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 97/195] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:05 2022] GET /identity/v3/projects/c6f6acecb2424b65a947c7f56c378682 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:05.821839 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66408a0-bf92-4f43-93c9-f0bee4945bc1 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:05.828619 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688a453-c323-4103-9552-e4d0cf228f81 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:05.832933 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc351165-d184-453c-97a0-14e2eff0dbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:05.833606 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc351165-d184-453c-97a0-14e2eff0dbb2 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:05.833886 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc351165-d184-453c-97a0-14e2eff0dbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:05.834161 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc351165-d184-453c-97a0-14e2eff0dbb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:05.834821 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66408a0-bf92-4f43-93c9-f0bee4945bc1 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:05.834954 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc351165-d184-453c-97a0-14e2eff0dbb2 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:05.835196 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc351165-d184-453c-97a0-14e2eff0dbb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:05.836796 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc351165-d184-453c-97a0-14e2eff0dbb2 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:05.839711 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73979459-df51-4bba-b690-e6b1e79915d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:05.840427 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73979459-df51-4bba-b690-e6b1e79915d0 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:05.840705 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73979459-df51-4bba-b690-e6b1e79915d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:05.840973 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73979459-df51-4bba-b690-e6b1e79915d0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:05.842142 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73979459-df51-4bba-b690-e6b1e79915d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:05.843760 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73979459-df51-4bba-b690-e6b1e79915d0 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:05.849975 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 98/196] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:05.850107 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 99/197] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:39:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:05.850201 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73979459-df51-4bba-b690-e6b1e79915d0 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:05.850283 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc351165-d184-453c-97a0-14e2eff0dbb2 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:05.859038 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc351165-d184-453c-97a0-14e2eff0dbb2 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:05.859149 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73979459-df51-4bba-b690-e6b1e79915d0 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:05.863230 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756d31d-05ad-4ef6-9d43-99790c262c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:05.863347 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bc79f-6226-44aa-88e3-a4af52b3fc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:05.863881 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bc79f-6226-44aa-88e3-a4af52b3fc67 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:05.864051 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756d31d-05ad-4ef6-9d43-99790c262c39 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:05.864163 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bc79f-6226-44aa-88e3-a4af52b3fc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:05.864330 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756d31d-05ad-4ef6-9d43-99790c262c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:05.864440 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bc79f-6226-44aa-88e3-a4af52b3fc67 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:05.864600 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756d31d-05ad-4ef6-9d43-99790c262c39 admin admin] PATH_INFO: `/v3/users/dc5002447aca48da8529616540d6b77d` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:05.865295 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1bc79f-6226-44aa-88e3-a4af52b3fc67 admin admin] RBAC: Adding query filter params (role.id=494131614fcf424f92e0817fa7ff6961, scope.project.id=c6f6acecb2424b65a947c7f56c378682, user.id=ca85f67760704ec88731db1e307e24f9) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:05.865604 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1bc79f-6226-44aa-88e3-a4af52b3fc67 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:05.865764 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4756d31d-05ad-4ef6-9d43-99790c262c39 admin admin] RBAC: Authorizing `identity:get_user(user_id=dc5002447aca48da8529616540d6b77d)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:05.867420 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1bc79f-6226-44aa-88e3-a4af52b3fc67 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:05.867790 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4756d31d-05ad-4ef6-9d43-99790c262c39 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:05.869366 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 99/198] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:39:05 2022] GET /identity/v3/users/dc5002447aca48da8529616540d6b77d => generated 289 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:05.869366 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756d31d-05ad-4ef6-9d43-99790c262c39 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:05.876914 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 100/199] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:39:05 2022] GET /identity/v3/role_assignments?user.id=ca85f67760704ec88731db1e307e24f9&scope.project.id=c6f6acecb2424b65a947c7f56c378682&role.id=494131614fcf424f92e0817fa7ff6961 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:05.877685 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bc79f-6226-44aa-88e3-a4af52b3fc67 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:05.879730 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756d31d-05ad-4ef6-9d43-99790c262c39 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:05.887467 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f754d30-6776-4936-8a11-aeed5b9d0560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:05.888365 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f754d30-6776-4936-8a11-aeed5b9d0560 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:05.888644 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f754d30-6776-4936-8a11-aeed5b9d0560 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:05.888917 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f754d30-6776-4936-8a11-aeed5b9d0560 admin admin] PATH_INFO: `/v3/users/ca85f67760704ec88731db1e307e24f9` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:05.890226 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f754d30-6776-4936-8a11-aeed5b9d0560 admin admin] RBAC: Authorizing `identity:get_user(user_id=ca85f67760704ec88731db1e307e24f9)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:05.892397 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f754d30-6776-4936-8a11-aeed5b9d0560 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:05.893210 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bc79f-6226-44aa-88e3-a4af52b3fc67 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:05.894380 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 100/200] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:39:05 2022] GET /identity/v3/users/ca85f67760704ec88731db1e307e24f9 => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:05.894943 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f754d30-6776-4936-8a11-aeed5b9d0560 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:05.897856 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be64d2-bae2-4660-8c08-39ebddd0e77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:05.898689 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be64d2-bae2-4660-8c08-39ebddd0e77c admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:05.898941 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be64d2-bae2-4660-8c08-39ebddd0e77c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:05.899287 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be64d2-bae2-4660-8c08-39ebddd0e77c admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:05.900097 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be64d2-bae2-4660-8c08-39ebddd0e77c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:05.902831 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be64d2-bae2-4660-8c08-39ebddd0e77c admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:05.905435 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f754d30-6776-4936-8a11-aeed5b9d0560 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:05.909836 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bceba6f-c340-4e24-999c-f3347bb2eb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:05.910495 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bceba6f-c340-4e24-999c-f3347bb2eb26 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:05.910812 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bceba6f-c340-4e24-999c-f3347bb2eb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:05.911095 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bceba6f-c340-4e24-999c-f3347bb2eb26 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:05.919832 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bceba6f-c340-4e24-999c-f3347bb2eb26 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:05.921663 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bceba6f-c340-4e24-999c-f3347bb2eb26 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:05.931557 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 101/201] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:39:05.932389 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bceba6f-c340-4e24-999c-f3347bb2eb26 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:05.942213 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bceba6f-c340-4e24-999c-f3347bb2eb26 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:05.946717 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a1330-9c16-456f-bad9-13612e9ec409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:05.947380 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a1330-9c16-456f-bad9-13612e9ec409 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:05.947812 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a1330-9c16-456f-bad9-13612e9ec409 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:05.948147 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a1330-9c16-456f-bad9-13612e9ec409 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:05.957457 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a1330-9c16-456f-bad9-13612e9ec409 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:05.959373 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a1330-9c16-456f-bad9-13612e9ec409 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:05.969609 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 102/202] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:39:05.970189 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a1330-9c16-456f-bad9-13612e9ec409 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:05.980023 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 101/203] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Jan 5 14:39:05 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:39:05.986285 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be64d2-bae2-4660-8c08-39ebddd0e77c admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:05.986459 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a1330-9c16-456f-bad9-13612e9ec409 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:05.991679 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ca265-f263-4116-ae9d-8bf0e76e095e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:05.993365 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ca265-f263-4116-ae9d-8bf0e76e095e admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:05.993649 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ca265-f263-4116-ae9d-8bf0e76e095e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:05.994260 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ca265-f263-4116-ae9d-8bf0e76e095e admin admin] PATH_INFO: `/v3/projects/0c3d9801ad754740ae4b7891d05c103f` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:05.995686 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ca265-f263-4116-ae9d-8bf0e76e095e admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3d9801ad754740ae4b7891d05c103f)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:05.996486 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be64d2-bae2-4660-8c08-39ebddd0e77c admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:05.997974 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ca265-f263-4116-ae9d-8bf0e76e095e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:06.000183 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 103/204] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:05 2022] GET /identity/v3/projects/0c3d9801ad754740ae4b7891d05c103f => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:06.002088 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad8931-0a52-49e2-8a2e-5734ca4c584d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:06.003079 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad8931-0a52-49e2-8a2e-5734ca4c584d admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:06.003368 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad8931-0a52-49e2-8a2e-5734ca4c584d admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:06.003900 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad8931-0a52-49e2-8a2e-5734ca4c584d admin admin] PATH_INFO: `/v3/projects/c6f6acecb2424b65a947c7f56c378682` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:06.005326 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad8931-0a52-49e2-8a2e-5734ca4c584d admin admin] RBAC: Authorizing `identity:get_project(project_id=c6f6acecb2424b65a947c7f56c378682)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:06.006391 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ca265-f263-4116-ae9d-8bf0e76e095e admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:06.007782 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad8931-0a52-49e2-8a2e-5734ca4c584d admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:06.010080 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 102/205] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:05 2022] GET /identity/v3/projects/c6f6acecb2424b65a947c7f56c378682 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:06.016596 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad8931-0a52-49e2-8a2e-5734ca4c584d admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:06.018336 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ca265-f263-4116-ae9d-8bf0e76e095e admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:06.025258 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1cf31-4ed7-477b-9481-4943975619d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:06.026279 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1cf31-4ed7-477b-9481-4943975619d4 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:06.027222 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1cf31-4ed7-477b-9481-4943975619d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:06.027547 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1cf31-4ed7-477b-9481-4943975619d4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:06.028512 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1cf31-4ed7-477b-9481-4943975619d4 admin admin] RBAC: Adding query filter params (role.id=1024abc4fc3948018b1356e4a6671464, scope.project.id=0c3d9801ad754740ae4b7891d05c103f, user.id=dc5002447aca48da8529616540d6b77d) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:06.028918 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1cf31-4ed7-477b-9481-4943975619d4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:06.029105 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad8931-0a52-49e2-8a2e-5734ca4c584d admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:06.031039 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1cf31-4ed7-477b-9481-4943975619d4 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:06.033943 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad542f84-2abf-44c3-9a35-2544c3f9c69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:06.034847 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad542f84-2abf-44c3-9a35-2544c3f9c69a admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:06.035129 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad542f84-2abf-44c3-9a35-2544c3f9c69a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:06.035476 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad542f84-2abf-44c3-9a35-2544c3f9c69a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:06.036263 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad542f84-2abf-44c3-9a35-2544c3f9c69a admin admin] RBAC: Adding query filter params (role.id=78b87341e5464907bcce0d16dca76299, scope.project.id=c6f6acecb2424b65a947c7f56c378682, user.id=ca85f67760704ec88731db1e307e24f9) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:06.036580 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad542f84-2abf-44c3-9a35-2544c3f9c69a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:06.038540 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad542f84-2abf-44c3-9a35-2544c3f9c69a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:06.041393 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 104/206] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:39:06 2022] GET /identity/v3/role_assignments?user.id=dc5002447aca48da8529616540d6b77d&scope.project.id=0c3d9801ad754740ae4b7891d05c103f&role.id=1024abc4fc3948018b1356e4a6671464 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:06.055681 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 103/207] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:39:06 2022] GET /identity/v3/role_assignments?user.id=ca85f67760704ec88731db1e307e24f9&scope.project.id=c6f6acecb2424b65a947c7f56c378682&role.id=78b87341e5464907bcce0d16dca76299 => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:08.336798 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fcabae-9bf8-4b5e-a107-e1625363d694 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:08.337855 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fcabae-9bf8-4b5e-a107-e1625363d694 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:08.338361 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fcabae-9bf8-4b5e-a107-e1625363d694 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:08.340370 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 105/208] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:08.345719 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e0fc1-2b7b-4aa4-a4f6-d93be433c115 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:08.346531 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e0fc1-2b7b-4aa4-a4f6-d93be433c115 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:08.347007 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e0fc1-2b7b-4aa4-a4f6-d93be433c115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:08.366081 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-b65e0fc1-2b7b-4aa4-a4f6-d93be433c115 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:08.367628 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-b65e0fc1-2b7b-4aa4-a4f6-d93be433c115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:08.376826 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 104/209] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:39:08.401487 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fcabae-9bf8-4b5e-a107-e1625363d694 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:08.414014 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fcabae-9bf8-4b5e-a107-e1625363d694 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:08.418594 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42479e9-be23-441d-84d6-e58b32c21e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:08.419699 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42479e9-be23-441d-84d6-e58b32c21e9b admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:08.420189 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42479e9-be23-441d-84d6-e58b32c21e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:08.420652 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42479e9-be23-441d-84d6-e58b32c21e9b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:08.431200 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42479e9-be23-441d-84d6-e58b32c21e9b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:08.439251 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-c42479e9-be23-441d-84d6-e58b32c21e9b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 05 14:39:08.440974 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 106/210] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:39:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:08.446876 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e0fc1-2b7b-4aa4-a4f6-d93be433c115 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:08.456781 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e0fc1-2b7b-4aa4-a4f6-d93be433c115 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:08.461546 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5337b47-3a05-45d7-b4a0-399a26a48881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:08.462446 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5337b47-3a05-45d7-b4a0-399a26a48881 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:08.462935 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5337b47-3a05-45d7-b4a0-399a26a48881 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:08.463415 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5337b47-3a05-45d7-b4a0-399a26a48881 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:08.464402 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5337b47-3a05-45d7-b4a0-399a26a48881 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:08.464903 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5337b47-3a05-45d7-b4a0-399a26a48881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:08.466751 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5337b47-3a05-45d7-b4a0-399a26a48881 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:08.475834 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 105/211] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:08.482796 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42479e9-be23-441d-84d6-e58b32c21e9b admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:08.501200 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42479e9-be23-441d-84d6-e58b32c21e9b admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:08.506289 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace416a3-1089-437b-947f-6687bae3ad51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:08.507431 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace416a3-1089-437b-947f-6687bae3ad51 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:08.507911 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace416a3-1089-437b-947f-6687bae3ad51 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:08.508378 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace416a3-1089-437b-947f-6687bae3ad51 admin admin] PATH_INFO: `/v3/users/ca85f67760704ec88731db1e307e24f9` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:08.509869 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace416a3-1089-437b-947f-6687bae3ad51 admin admin] RBAC: Authorizing `identity:get_user(user_id=ca85f67760704ec88731db1e307e24f9)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:08.514118 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace416a3-1089-437b-947f-6687bae3ad51 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:08.514258 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 107/212] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:39:08 2022] GET /identity/v3/users/ca85f67760704ec88731db1e307e24f9 => generated 283 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:08.519769 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5337b47-3a05-45d7-b4a0-399a26a48881 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:08.529892 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5337b47-3a05-45d7-b4a0-399a26a48881 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:08.534359 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a41c88-f6e2-4a03-bb7b-aff1f1460883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:08.536007 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a41c88-f6e2-4a03-bb7b-aff1f1460883 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:08.536007 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a41c88-f6e2-4a03-bb7b-aff1f1460883 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:08.536007 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a41c88-f6e2-4a03-bb7b-aff1f1460883 admin admin] PATH_INFO: `/v3/projects/c6f6acecb2424b65a947c7f56c378682` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:08.536956 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a41c88-f6e2-4a03-bb7b-aff1f1460883 admin admin] RBAC: Authorizing `identity:get_project(project_id=c6f6acecb2424b65a947c7f56c378682)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:08.539170 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a41c88-f6e2-4a03-bb7b-aff1f1460883 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:08.541050 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 106/213] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:08 2022] GET /identity/v3/projects/c6f6acecb2424b65a947c7f56c378682 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:08.546416 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a41c88-f6e2-4a03-bb7b-aff1f1460883 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:08.546996 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfc86a-00ea-4cca-9f3b-a6714bbaa300 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:08.547293 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfc86a-00ea-4cca-9f3b-a6714bbaa300 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:08.547571 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfc86a-00ea-4cca-9f3b-a6714bbaa300 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:08.549374 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 108/214] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:08.555393 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48eea06-311b-429f-bdc7-6734216112d4 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:08.555682 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48eea06-311b-429f-bdc7-6734216112d4 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:08.555959 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48eea06-311b-429f-bdc7-6734216112d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:08.560338 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a41c88-f6e2-4a03-bb7b-aff1f1460883 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:08.569508 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac335538-9954-4e67-ab79-9a49b5ee7c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:08.570702 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac335538-9954-4e67-ab79-9a49b5ee7c3f admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:08.571181 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac335538-9954-4e67-ab79-9a49b5ee7c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:08.572114 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac335538-9954-4e67-ab79-9a49b5ee7c3f admin admin] PATH_INFO: `/v3/projects/c6f6acecb2424b65a947c7f56c378682/users/ca85f67760704ec88731db1e307e24f9/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:08.575386 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac335538-9954-4e67-ab79-9a49b5ee7c3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6f6acecb2424b65a947c7f56c378682, user_id=ca85f67760704ec88731db1e307e24f9, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:08.578031 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-d48eea06-311b-429f-bdc7-6734216112d4 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:08.578702 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac335538-9954-4e67-ab79-9a49b5ee7c3f admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:08.579215 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-d48eea06-311b-429f-bdc7-6734216112d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:08.589169 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 109/215] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:39:08.608904 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30180d06-e950-4a1e-aa0d-41d80bfc7168 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:08.609286 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30180d06-e950-4a1e-aa0d-41d80bfc7168 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:08.609568 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30180d06-e950-4a1e-aa0d-41d80bfc7168 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:08.611354 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 110/216] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 14:39:08.612042 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30180d06-e950-4a1e-aa0d-41d80bfc7168 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:08.624667 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30180d06-e950-4a1e-aa0d-41d80bfc7168 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:08.630300 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b35aa8-fab9-44e4-9d59-ccea42b387aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:08.630300 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b35aa8-fab9-44e4-9d59-ccea42b387aa admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:08.630300 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b35aa8-fab9-44e4-9d59-ccea42b387aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:08.630537 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b35aa8-fab9-44e4-9d59-ccea42b387aa admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:08.641676 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b35aa8-fab9-44e4-9d59-ccea42b387aa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:08.650552 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-09b35aa8-fab9-44e4-9d59-ccea42b387aa admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 05 14:39:08.651338 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 107/217] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Jan 5 14:39:08 2022] PUT /identity/v3/projects/c6f6acecb2424b65a947c7f56c378682/users/ca85f67760704ec88731db1e307e24f9/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:39:08.651881 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 111/218] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Jan 5 14:39:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:08.658107 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b35aa8-fab9-44e4-9d59-ccea42b387aa admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:08.660544 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c955b11-5c04-402d-9a9d-9b3a6a4e73a3 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:08.660839 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c955b11-5c04-402d-9a9d-9b3a6a4e73a3 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:08.661139 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c955b11-5c04-402d-9a9d-9b3a6a4e73a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:08.668619 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b35aa8-fab9-44e4-9d59-ccea42b387aa admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:08.692764 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-0c955b11-5c04-402d-9a9d-9b3a6a4e73a3 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:08.696289 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-0c955b11-5c04-402d-9a9d-9b3a6a4e73a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:08.734825 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429cc92-e5f2-4eaf-8cb5-e3cb422a3eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:08.735610 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429cc92-e5f2-4eaf-8cb5-e3cb422a3eec admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:08.735895 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429cc92-e5f2-4eaf-8cb5-e3cb422a3eec admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:08.736174 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429cc92-e5f2-4eaf-8cb5-e3cb422a3eec admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:08.737107 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429cc92-e5f2-4eaf-8cb5-e3cb422a3eec admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:08.737268 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429cc92-e5f2-4eaf-8cb5-e3cb422a3eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:08.738904 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429cc92-e5f2-4eaf-8cb5-e3cb422a3eec admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:08.749245 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 112/219] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:39:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:08.749743 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68b91d-ddaa-446a-b542-18d81f9a07ef None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:08.750029 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68b91d-ddaa-446a-b542-18d81f9a07ef None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:08.750311 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68b91d-ddaa-446a-b542-18d81f9a07ef None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:08.752091 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 113/220] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:08.757454 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68b91d-ddaa-446a-b542-18d81f9a07ef None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:08.768383 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 108/221] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:08.769657 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9410f7-0df7-43d0-99a4-9ea1719b8dc7 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:08.769948 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9410f7-0df7-43d0-99a4-9ea1719b8dc7 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:08.770227 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9410f7-0df7-43d0-99a4-9ea1719b8dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:08.776718 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68b91d-ddaa-446a-b542-18d81f9a07ef None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:08.782879 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52445a-4f9d-47ae-838d-05b67b159297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:08.784037 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52445a-4f9d-47ae-838d-05b67b159297 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:08.784521 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52445a-4f9d-47ae-838d-05b67b159297 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:08.785165 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52445a-4f9d-47ae-838d-05b67b159297 admin admin] PATH_INFO: `/v3/users/ca85f67760704ec88731db1e307e24f9` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:08.786832 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52445a-4f9d-47ae-838d-05b67b159297 admin admin] RBAC: Authorizing `identity:get_user(user_id=ca85f67760704ec88731db1e307e24f9)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:08.789412 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52445a-4f9d-47ae-838d-05b67b159297 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:08.789552 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-0e9410f7-0df7-43d0-99a4-9ea1719b8dc7 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:08.790893 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-0e9410f7-0df7-43d0-99a4-9ea1719b8dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:08.792893 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 114/222] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:39:08 2022] GET /identity/v3/users/ca85f67760704ec88731db1e307e24f9 => generated 283 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:08.797953 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52445a-4f9d-47ae-838d-05b67b159297 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:08.801325 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 109/223] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:08.802596 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9410f7-0df7-43d0-99a4-9ea1719b8dc7 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:08.813667 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9410f7-0df7-43d0-99a4-9ea1719b8dc7 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:08.814116 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52445a-4f9d-47ae-838d-05b67b159297 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:08.820274 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e103daa-2c3d-413b-aacc-08d2bc334439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:08.820987 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921613b-3497-40df-ae0c-427b0e003a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:08.821438 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e103daa-2c3d-413b-aacc-08d2bc334439 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:08.821828 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e103daa-2c3d-413b-aacc-08d2bc334439 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:08.822332 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921613b-3497-40df-ae0c-427b0e003a49 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:08.822523 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e103daa-2c3d-413b-aacc-08d2bc334439 admin admin] PATH_INFO: `/v3/projects/c6f6acecb2424b65a947c7f56c378682` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:08.822896 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921613b-3497-40df-ae0c-427b0e003a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:08.823334 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921613b-3497-40df-ae0c-427b0e003a49 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:08.824296 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e103daa-2c3d-413b-aacc-08d2bc334439 admin admin] RBAC: Authorizing `identity:get_project(project_id=c6f6acecb2424b65a947c7f56c378682)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:08.826740 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e103daa-2c3d-413b-aacc-08d2bc334439 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:08.829045 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 115/224] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:08 2022] GET /identity/v3/projects/c6f6acecb2424b65a947c7f56c378682 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:08.836538 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e103daa-2c3d-413b-aacc-08d2bc334439 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:08.840316 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921613b-3497-40df-ae0c-427b0e003a49 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:08.847664 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-d921613b-3497-40df-ae0c-427b0e003a49 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 05 14:39:08.848672 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e103daa-2c3d-413b-aacc-08d2bc334439 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:08.848913 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 110/225] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:08.849794 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921613b-3497-40df-ae0c-427b0e003a49 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:08.857917 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5da40c-d491-4c2c-8ea8-941cb6f1f65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:08.858885 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5da40c-d491-4c2c-8ea8-941cb6f1f65d admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:08.859216 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5da40c-d491-4c2c-8ea8-941cb6f1f65d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:08.859764 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5da40c-d491-4c2c-8ea8-941cb6f1f65d admin admin] PATH_INFO: `/v3/projects/c6f6acecb2424b65a947c7f56c378682/users/ca85f67760704ec88731db1e307e24f9/roles/78b87341e5464907bcce0d16dca76299` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:08.862095 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5da40c-d491-4c2c-8ea8-941cb6f1f65d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6f6acecb2424b65a947c7f56c378682, user_id=ca85f67760704ec88731db1e307e24f9, role_id=78b87341e5464907bcce0d16dca76299)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:08.864665 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921613b-3497-40df-ae0c-427b0e003a49 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:08.864798 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5da40c-d491-4c2c-8ea8-941cb6f1f65d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:08.869852 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c64b4-9505-4f53-b606-cc07e0dde075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:08.871317 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c64b4-9505-4f53-b606-cc07e0dde075 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:08.871597 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c64b4-9505-4f53-b606-cc07e0dde075 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:08.871870 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c64b4-9505-4f53-b606-cc07e0dde075 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:08.873146 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c64b4-9505-4f53-b606-cc07e0dde075 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:08.874945 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c64b4-9505-4f53-b606-cc07e0dde075 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:08.876645 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 111/226] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:08.881533 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c64b4-9505-4f53-b606-cc07e0dde075 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:08.891809 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c64b4-9505-4f53-b606-cc07e0dde075 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:08.896717 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6387c23-5cba-430e-9075-d696fcbdd308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:08.897405 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6387c23-5cba-430e-9075-d696fcbdd308 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:08.897688 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6387c23-5cba-430e-9075-d696fcbdd308 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:08.897959 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6387c23-5cba-430e-9075-d696fcbdd308 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:08.898782 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6387c23-5cba-430e-9075-d696fcbdd308 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:08.899111 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6387c23-5cba-430e-9075-d696fcbdd308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:08.900664 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6387c23-5cba-430e-9075-d696fcbdd308 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:08.911200 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 112/227] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jan 5 14:39:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:08.912007 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6387c23-5cba-430e-9075-d696fcbdd308 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:08.921764 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6387c23-5cba-430e-9075-d696fcbdd308 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:08.926253 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21263d0e-ff43-44d4-bbc2-90ae6d6ee9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:08.927008 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21263d0e-ff43-44d4-bbc2-90ae6d6ee9aa admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:08.927294 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21263d0e-ff43-44d4-bbc2-90ae6d6ee9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:08.927573 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21263d0e-ff43-44d4-bbc2-90ae6d6ee9aa admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:08.928300 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21263d0e-ff43-44d4-bbc2-90ae6d6ee9aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:08.930295 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21263d0e-ff43-44d4-bbc2-90ae6d6ee9aa admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:08.932738 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 116/228] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Jan 5 14:39:08 2022] PUT /identity/v3/projects/c6f6acecb2424b65a947c7f56c378682/users/ca85f67760704ec88731db1e307e24f9/roles/78b87341e5464907bcce0d16dca76299 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:39:08.933810 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5da40c-d491-4c2c-8ea8-941cb6f1f65d admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:09.000308 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5da40c-d491-4c2c-8ea8-941cb6f1f65d admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:09.005231 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d84943-8fd9-4cc6-abdc-a80b4e7121e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:09.006144 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d84943-8fd9-4cc6-abdc-a80b4e7121e5 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:09.006483 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d84943-8fd9-4cc6-abdc-a80b4e7121e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:09.006822 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d84943-8fd9-4cc6-abdc-a80b4e7121e5 admin admin] PATH_INFO: `/v3/users/4817e34788324c2ba48b2dfe3f83d5ef` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:09.015684 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 113/229] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Jan 5 14:39:08 2022] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:39:09.037557 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d84943-8fd9-4cc6-abdc-a80b4e7121e5 admin admin] RBAC: Authorizing `identity:get_user(user_id=4817e34788324c2ba48b2dfe3f83d5ef)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:09.040511 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d84943-8fd9-4cc6-abdc-a80b4e7121e5 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:09.043030 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 117/230] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:39:08 2022] GET /identity/v3/users/4817e34788324c2ba48b2dfe3f83d5ef => generated 297 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:09.049834 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21263d0e-ff43-44d4-bbc2-90ae6d6ee9aa admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:09.061354 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21263d0e-ff43-44d4-bbc2-90ae6d6ee9aa admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:09.066277 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815b9b0-e9ab-45f1-ac9d-48d70bf51a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:09.066938 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815b9b0-e9ab-45f1-ac9d-48d70bf51a9b admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:09.067426 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815b9b0-e9ab-45f1-ac9d-48d70bf51a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:09.067901 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815b9b0-e9ab-45f1-ac9d-48d70bf51a9b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:09.078028 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b815b9b0-e9ab-45f1-ac9d-48d70bf51a9b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:09.080058 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b815b9b0-e9ab-45f1-ac9d-48d70bf51a9b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:09.096991 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 114/231] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:39:09.098415 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d84943-8fd9-4cc6-abdc-a80b4e7121e5 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:09.112311 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d84943-8fd9-4cc6-abdc-a80b4e7121e5 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:09.118614 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665dfc1-7c85-4393-8dbc-c7c2c131db71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:09.120026 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665dfc1-7c85-4393-8dbc-c7c2c131db71 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:09.121211 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665dfc1-7c85-4393-8dbc-c7c2c131db71 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:09.121787 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665dfc1-7c85-4393-8dbc-c7c2c131db71 admin admin] PATH_INFO: `/v3/projects/c6f6acecb2424b65a947c7f56c378682` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:09.123531 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1665dfc1-7c85-4393-8dbc-c7c2c131db71 admin admin] RBAC: Authorizing `identity:get_project(project_id=c6f6acecb2424b65a947c7f56c378682)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:09.126301 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1665dfc1-7c85-4393-8dbc-c7c2c131db71 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:09.133856 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 118/232] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:09 2022] GET /identity/v3/projects/c6f6acecb2424b65a947c7f56c378682 => generated 302 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:09.139097 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815b9b0-e9ab-45f1-ac9d-48d70bf51a9b admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:09.151248 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815b9b0-e9ab-45f1-ac9d-48d70bf51a9b admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:09.156936 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea270021-a92e-45df-9b53-fafda86c5477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:09.158022 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea270021-a92e-45df-9b53-fafda86c5477 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:09.158494 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea270021-a92e-45df-9b53-fafda86c5477 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:09.158941 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea270021-a92e-45df-9b53-fafda86c5477 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:09.159984 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea270021-a92e-45df-9b53-fafda86c5477 admin admin] RBAC: Adding query filter params (role.id=eaba1e26bf0040868b08b042a7859698, scope.project.id=c6f6acecb2424b65a947c7f56c378682, user.id=4817e34788324c2ba48b2dfe3f83d5ef) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:09.160507 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea270021-a92e-45df-9b53-fafda86c5477 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:09.162679 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea270021-a92e-45df-9b53-fafda86c5477 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:09.169739 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 115/233] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:39:09 2022] GET /identity/v3/role_assignments?user.id=4817e34788324c2ba48b2dfe3f83d5ef&scope.project.id=c6f6acecb2424b65a947c7f56c378682&role.id=eaba1e26bf0040868b08b042a7859698 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:11.646825 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90663cd1-ec07-48b6-8123-8af4fb84f79c None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:11.647823 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90663cd1-ec07-48b6-8123-8af4fb84f79c None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:11.648328 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90663cd1-ec07-48b6-8123-8af4fb84f79c None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:11.650646 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 119/234] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:11.656350 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ebcaa-95f7-442b-a736-54fe66b0ebd5 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:11.656921 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ebcaa-95f7-442b-a736-54fe66b0ebd5 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:11.656921 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ebcaa-95f7-442b-a736-54fe66b0ebd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:11.686333 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-c61ebcaa-95f7-442b-a736-54fe66b0ebd5 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:11.687602 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-c61ebcaa-95f7-442b-a736-54fe66b0ebd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:11.695797 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 116/235] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:11.721221 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90663cd1-ec07-48b6-8123-8af4fb84f79c None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:11.741734 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90663cd1-ec07-48b6-8123-8af4fb84f79c None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:11.746546 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26775de6-b414-4554-890d-1fd9abc88c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:11.747608 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26775de6-b414-4554-890d-1fd9abc88c69 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:11.748169 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26775de6-b414-4554-890d-1fd9abc88c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:11.748634 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26775de6-b414-4554-890d-1fd9abc88c69 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:11.768056 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26775de6-b414-4554-890d-1fd9abc88c69 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:11.775699 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-26775de6-b414-4554-890d-1fd9abc88c69 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 05 14:39:11.777788 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 120/236] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:39:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:11.784106 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ebcaa-95f7-442b-a736-54fe66b0ebd5 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:11.803327 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ebcaa-95f7-442b-a736-54fe66b0ebd5 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:11.807965 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04c7e7-339e-40de-98d8-6f1b779512e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:11.808647 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04c7e7-339e-40de-98d8-6f1b779512e1 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:11.808925 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04c7e7-339e-40de-98d8-6f1b779512e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:11.809220 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04c7e7-339e-40de-98d8-6f1b779512e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:11.809981 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04c7e7-339e-40de-98d8-6f1b779512e1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:11.810281 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04c7e7-339e-40de-98d8-6f1b779512e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:11.811874 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04c7e7-339e-40de-98d8-6f1b779512e1 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:11.825616 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 117/237] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:11.832541 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26775de6-b414-4554-890d-1fd9abc88c69 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:11.846090 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26775de6-b414-4554-890d-1fd9abc88c69 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:11.855955 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37671665-fd7f-42d1-8c4f-1e6aeeb7745c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:11.857147 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37671665-fd7f-42d1-8c4f-1e6aeeb7745c admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:11.857650 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37671665-fd7f-42d1-8c4f-1e6aeeb7745c admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:11.858115 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37671665-fd7f-42d1-8c4f-1e6aeeb7745c admin admin] PATH_INFO: `/v3/users/ca85f67760704ec88731db1e307e24f9` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:11.861776 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37671665-fd7f-42d1-8c4f-1e6aeeb7745c admin admin] RBAC: Authorizing `identity:get_user(user_id=ca85f67760704ec88731db1e307e24f9)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:11.864109 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37671665-fd7f-42d1-8c4f-1e6aeeb7745c admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:11.866432 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 121/238] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:39:11 2022] GET /identity/v3/users/ca85f67760704ec88731db1e307e24f9 => generated 283 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:11.871695 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04c7e7-339e-40de-98d8-6f1b779512e1 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:11.886716 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04c7e7-339e-40de-98d8-6f1b779512e1 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:11.897254 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a719b56-aa7c-4a3a-952b-b6d9c5e02a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:11.897903 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a719b56-aa7c-4a3a-952b-b6d9c5e02a6a admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:11.898182 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a719b56-aa7c-4a3a-952b-b6d9c5e02a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:11.898452 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a719b56-aa7c-4a3a-952b-b6d9c5e02a6a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:11.916795 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a719b56-aa7c-4a3a-952b-b6d9c5e02a6a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:11.918595 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a719b56-aa7c-4a3a-952b-b6d9c5e02a6a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:11.930563 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 118/239] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:39:11.936337 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37671665-fd7f-42d1-8c4f-1e6aeeb7745c admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:11.951456 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37671665-fd7f-42d1-8c4f-1e6aeeb7745c admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:11.960644 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7791a33-0bcd-4100-920e-0bdf023cdf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:11.961870 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7791a33-0bcd-4100-920e-0bdf023cdf2b admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:11.962370 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7791a33-0bcd-4100-920e-0bdf023cdf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:11.962852 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7791a33-0bcd-4100-920e-0bdf023cdf2b admin admin] PATH_INFO: `/v3/projects/c6f6acecb2424b65a947c7f56c378682` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:11.966160 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7791a33-0bcd-4100-920e-0bdf023cdf2b admin admin] RBAC: Authorizing `identity:get_project(project_id=c6f6acecb2424b65a947c7f56c378682)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:11.968407 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7791a33-0bcd-4100-920e-0bdf023cdf2b admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:11.971279 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 122/240] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:11 2022] GET /identity/v3/projects/c6f6acecb2424b65a947c7f56c378682 => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:11.976070 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a719b56-aa7c-4a3a-952b-b6d9c5e02a6a admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:11.990022 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a719b56-aa7c-4a3a-952b-b6d9c5e02a6a admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:11.994272 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be55e3-0227-42ce-a1b7-0d24e95ea816 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:11.994856 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be55e3-0227-42ce-a1b7-0d24e95ea816 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:11.995359 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be55e3-0227-42ce-a1b7-0d24e95ea816 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:11.996440 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dbd4f-c356-463a-b8b1-dcc6bb202ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:11.997105 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dbd4f-c356-463a-b8b1-dcc6bb202ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:11.997384 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dbd4f-c356-463a-b8b1-dcc6bb202ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:11.997660 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dbd4f-c356-463a-b8b1-dcc6bb202ed0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:11.998355 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 123/241] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 14:39:11.998563 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310dbd4f-c356-463a-b8b1-dcc6bb202ed0 admin admin] RBAC: Adding query filter params (role.id=494131614fcf424f92e0817fa7ff6961, scope.project.id=c6f6acecb2424b65a947c7f56c378682, user.id=ca85f67760704ec88731db1e307e24f9) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:12.001091 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310dbd4f-c356-463a-b8b1-dcc6bb202ed0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:12.001091 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310dbd4f-c356-463a-b8b1-dcc6bb202ed0 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:12.007847 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b682a12-9f00-4b20-bbaa-41f0d4eb9ecd None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:12.008352 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b682a12-9f00-4b20-bbaa-41f0d4eb9ecd None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:12.008781 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b682a12-9f00-4b20-bbaa-41f0d4eb9ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:12.011969 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 119/242] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:39:11 2022] GET /identity/v3/role_assignments?user.id=ca85f67760704ec88731db1e307e24f9&scope.project.id=c6f6acecb2424b65a947c7f56c378682&role.id=494131614fcf424f92e0817fa7ff6961 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:12.033567 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-6b682a12-9f00-4b20-bbaa-41f0d4eb9ecd None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:12.034669 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-6b682a12-9f00-4b20-bbaa-41f0d4eb9ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:12.048004 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 124/243] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:39:12.086117 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dbd4f-c356-463a-b8b1-dcc6bb202ed0 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:12.102504 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dbd4f-c356-463a-b8b1-dcc6bb202ed0 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:12.107302 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41beef-d848-4bc8-b264-a5c6ee40ab22 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:12.107588 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41beef-d848-4bc8-b264-a5c6ee40ab22 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:12.107872 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41beef-d848-4bc8-b264-a5c6ee40ab22 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:12.109938 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 125/244] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:12.113147 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c0782-608a-40c1-b651-476591f9a508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:12.113147 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c0782-608a-40c1-b651-476591f9a508 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:12.113147 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c0782-608a-40c1-b651-476591f9a508 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:12.113147 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c0782-608a-40c1-b651-476591f9a508 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:12.116040 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74457fc0-64aa-4685-a722-49c37ceb76d2 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:12.116588 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74457fc0-64aa-4685-a722-49c37ceb76d2 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:12.117050 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74457fc0-64aa-4685-a722-49c37ceb76d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:12.135064 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c0782-608a-40c1-b651-476591f9a508 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:12.149247 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-363c0782-608a-40c1-b651-476591f9a508 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 05 14:39:12.151422 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 120/245] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Jan 5 14:39:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:12.159567 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec1263-a7d7-4c04-82d1-811ed38bd2a4 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:12.159876 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec1263-a7d7-4c04-82d1-811ed38bd2a4 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:12.160348 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec1263-a7d7-4c04-82d1-811ed38bd2a4 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:12.163888 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 121/246] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 14:39:12.169258 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec1263-a7d7-4c04-82d1-811ed38bd2a4 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:12.174557 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-74457fc0-64aa-4685-a722-49c37ceb76d2 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:12.175770 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-74457fc0-64aa-4685-a722-49c37ceb76d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:12.189716 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 126/247] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:39:12.192300 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec1263-a7d7-4c04-82d1-811ed38bd2a4 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:12.197474 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5bc2a-18b6-4dfc-8e71-73f6dd5da0df None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:12.198079 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5bc2a-18b6-4dfc-8e71-73f6dd5da0df None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:12.199099 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5bc2a-18b6-4dfc-8e71-73f6dd5da0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:12.199747 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525660a-ec2e-4bed-981f-2de86898e232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:12.200680 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525660a-ec2e-4bed-981f-2de86898e232 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:12.201205 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525660a-ec2e-4bed-981f-2de86898e232 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:12.201678 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525660a-ec2e-4bed-981f-2de86898e232 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:12.202649 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525660a-ec2e-4bed-981f-2de86898e232 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:12.203164 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525660a-ec2e-4bed-981f-2de86898e232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:12.205106 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525660a-ec2e-4bed-981f-2de86898e232 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:12.215004 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 122/248] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:39:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:12.216674 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9ec91-011c-4cf4-aebe-8bd24ed0a4d0 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:12.217211 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9ec91-011c-4cf4-aebe-8bd24ed0a4d0 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:12.217680 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9ec91-011c-4cf4-aebe-8bd24ed0a4d0 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:12.219597 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 123/249] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:12.226071 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ead921-97ed-48c8-a0c0-6f639d81a41e None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:12.226071 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ead921-97ed-48c8-a0c0-6f639d81a41e None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:12.226437 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ead921-97ed-48c8-a0c0-6f639d81a41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:12.238069 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-e0b5bc2a-18b6-4dfc-8e71-73f6dd5da0df None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:12.239281 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-e0b5bc2a-18b6-4dfc-8e71-73f6dd5da0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:12.248246 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 127/250] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:12.249095 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5bc2a-18b6-4dfc-8e71-73f6dd5da0df None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:12.249199 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-31ead921-97ed-48c8-a0c0-6f639d81a41e None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:12.251322 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-31ead921-97ed-48c8-a0c0-6f639d81a41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:12.258871 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5bc2a-18b6-4dfc-8e71-73f6dd5da0df None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:12.264166 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c752605-ba6b-46ba-93d3-9d5d0c58740e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:12.265131 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c752605-ba6b-46ba-93d3-9d5d0c58740e admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:12.265451 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c752605-ba6b-46ba-93d3-9d5d0c58740e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:12.265551 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 124/251] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:12.265735 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c752605-ba6b-46ba-93d3-9d5d0c58740e admin admin] PATH_INFO: `/v3/users/ca85f67760704ec88731db1e307e24f9` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:12.266393 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ead921-97ed-48c8-a0c0-6f639d81a41e None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:12.267140 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c752605-ba6b-46ba-93d3-9d5d0c58740e admin admin] RBAC: Authorizing `identity:get_user(user_id=ca85f67760704ec88731db1e307e24f9)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:12.269531 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c752605-ba6b-46ba-93d3-9d5d0c58740e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:12.271243 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 128/252] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:39:12 2022] GET /identity/v3/users/ca85f67760704ec88731db1e307e24f9 => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:12.276949 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c752605-ba6b-46ba-93d3-9d5d0c58740e admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:12.287148 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c752605-ba6b-46ba-93d3-9d5d0c58740e admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:12.287316 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ead921-97ed-48c8-a0c0-6f639d81a41e None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:12.291526 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5f11e-c5d4-4646-8921-3da2cf9d568d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:12.292205 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5f11e-c5d4-4646-8921-3da2cf9d568d admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:12.292493 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5f11e-c5d4-4646-8921-3da2cf9d568d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:12.292783 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5f11e-c5d4-4646-8921-3da2cf9d568d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:12.293985 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592925fd-d4f9-4aaf-99e2-bc96a63a4c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:12.294792 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592925fd-d4f9-4aaf-99e2-bc96a63a4c37 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:12.295069 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592925fd-d4f9-4aaf-99e2-bc96a63a4c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:12.295340 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592925fd-d4f9-4aaf-99e2-bc96a63a4c37 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:12.301218 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e5f11e-c5d4-4646-8921-3da2cf9d568d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:12.303145 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e5f11e-c5d4-4646-8921-3da2cf9d568d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:12.306941 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592925fd-d4f9-4aaf-99e2-bc96a63a4c37 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:12.313676 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 129/253] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 05 14:39:12.314561 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5f11e-c5d4-4646-8921-3da2cf9d568d admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:12.314664 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-592925fd-d4f9-4aaf-99e2-bc96a63a4c37 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 05 14:39:12.315909 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 125/254] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:12.317932 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592925fd-d4f9-4aaf-99e2-bc96a63a4c37 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:12.324400 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5f11e-c5d4-4646-8921-3da2cf9d568d admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:12.329381 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3964a-2916-4d7f-b21b-59aff6322290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:12.330132 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592925fd-d4f9-4aaf-99e2-bc96a63a4c37 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:12.330754 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3964a-2916-4d7f-b21b-59aff6322290 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:12.330754 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3964a-2916-4d7f-b21b-59aff6322290 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:12.330933 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3964a-2916-4d7f-b21b-59aff6322290 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:12.335014 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6feb05b-a305-4b83-8354-1bd5cb6ce314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:12.335635 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6feb05b-a305-4b83-8354-1bd5cb6ce314 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:12.335914 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6feb05b-a305-4b83-8354-1bd5cb6ce314 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:12.336185 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6feb05b-a305-4b83-8354-1bd5cb6ce314 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:12.337406 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6feb05b-a305-4b83-8354-1bd5cb6ce314 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:12.339128 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6feb05b-a305-4b83-8354-1bd5cb6ce314 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:12.340862 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 126/255] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:12.343877 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da3964a-2916-4d7f-b21b-59aff6322290 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:12.346567 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6feb05b-a305-4b83-8354-1bd5cb6ce314 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:12.351165 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-6da3964a-2916-4d7f-b21b-59aff6322290 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 05 14:39:12.352432 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 130/256] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:12.353156 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3964a-2916-4d7f-b21b-59aff6322290 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:12.356650 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6feb05b-a305-4b83-8354-1bd5cb6ce314 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:12.362578 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af47dfc-044a-4321-b4d2-afe9115c1df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:12.363259 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3964a-2916-4d7f-b21b-59aff6322290 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:12.363435 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af47dfc-044a-4321-b4d2-afe9115c1df1 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:12.363686 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af47dfc-044a-4321-b4d2-afe9115c1df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:12.363953 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af47dfc-044a-4321-b4d2-afe9115c1df1 admin admin] PATH_INFO: `/v3/projects/c6f6acecb2424b65a947c7f56c378682` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:12.365127 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af47dfc-044a-4321-b4d2-afe9115c1df1 admin admin] RBAC: Authorizing `identity:get_project(project_id=c6f6acecb2424b65a947c7f56c378682)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:12.367192 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af47dfc-044a-4321-b4d2-afe9115c1df1 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:12.368841 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 127/257] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:12 2022] GET /identity/v3/projects/c6f6acecb2424b65a947c7f56c378682 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:12.369575 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af47dfc-044a-4321-b4d2-afe9115c1df1 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:12.371028 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92cfda-cf8b-4618-a144-d9523d411e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:12.371679 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92cfda-cf8b-4618-a144-d9523d411e78 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:12.371966 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92cfda-cf8b-4618-a144-d9523d411e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:12.372244 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92cfda-cf8b-4618-a144-d9523d411e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:12.373004 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92cfda-cf8b-4618-a144-d9523d411e78 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:12.373352 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92cfda-cf8b-4618-a144-d9523d411e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:12.374945 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92cfda-cf8b-4618-a144-d9523d411e78 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:12.383068 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af47dfc-044a-4321-b4d2-afe9115c1df1 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:12.385154 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 131/258] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jan 5 14:39:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:12.385350 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92cfda-cf8b-4618-a144-d9523d411e78 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:12.392513 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727d6a8-e412-43ba-bd93-e806fad069ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:12.393228 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727d6a8-e412-43ba-bd93-e806fad069ed admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:12.393514 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727d6a8-e412-43ba-bd93-e806fad069ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:12.393791 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727d6a8-e412-43ba-bd93-e806fad069ed admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:12.394523 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727d6a8-e412-43ba-bd93-e806fad069ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:12.395328 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92cfda-cf8b-4618-a144-d9523d411e78 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:12.396446 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727d6a8-e412-43ba-bd93-e806fad069ed admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:12.399597 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c533a7-b06c-453f-8912-5d2952d4b7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:12.400224 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c533a7-b06c-453f-8912-5d2952d4b7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:12.400501 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c533a7-b06c-453f-8912-5d2952d4b7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:12.400772 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c533a7-b06c-453f-8912-5d2952d4b7a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:12.401599 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c533a7-b06c-453f-8912-5d2952d4b7a7 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:12.401898 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c533a7-b06c-453f-8912-5d2952d4b7a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:12.403439 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c533a7-b06c-453f-8912-5d2952d4b7a7 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:12.411640 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 132/259] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jan 5 14:39:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:12.412424 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c533a7-b06c-453f-8912-5d2952d4b7a7 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:12.421993 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c533a7-b06c-453f-8912-5d2952d4b7a7 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:12.426292 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61701e6b-9fb5-4535-9ac8-7330426123da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:12.426868 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61701e6b-9fb5-4535-9ac8-7330426123da admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:12.427145 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61701e6b-9fb5-4535-9ac8-7330426123da admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:12.427499 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61701e6b-9fb5-4535-9ac8-7330426123da admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:12.428228 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61701e6b-9fb5-4535-9ac8-7330426123da admin admin] RBAC: Adding query filter params (role.id=78b87341e5464907bcce0d16dca76299, scope.project.id=c6f6acecb2424b65a947c7f56c378682, user.id=ca85f67760704ec88731db1e307e24f9) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:12.428529 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61701e6b-9fb5-4535-9ac8-7330426123da admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:12.430337 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61701e6b-9fb5-4535-9ac8-7330426123da admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:12.436535 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 133/260] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:39:12 2022] GET /identity/v3/role_assignments?user.id=ca85f67760704ec88731db1e307e24f9&scope.project.id=c6f6acecb2424b65a947c7f56c378682&role.id=78b87341e5464907bcce0d16dca76299 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:12.437280 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61701e6b-9fb5-4535-9ac8-7330426123da admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:12.446793 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61701e6b-9fb5-4535-9ac8-7330426123da admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:12.451443 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463203a-fc47-4ad4-984a-32cf469bbfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:12.452346 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463203a-fc47-4ad4-984a-32cf469bbfff admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:12.452628 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463203a-fc47-4ad4-984a-32cf469bbfff admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:12.452902 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463203a-fc47-4ad4-984a-32cf469bbfff admin admin] PATH_INFO: `/v3/users/4817e34788324c2ba48b2dfe3f83d5ef` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:12.454388 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463203a-fc47-4ad4-984a-32cf469bbfff admin admin] RBAC: Authorizing `identity:get_user(user_id=4817e34788324c2ba48b2dfe3f83d5ef)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:12.456561 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463203a-fc47-4ad4-984a-32cf469bbfff admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:12.458302 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 134/261] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:39:12 2022] GET /identity/v3/users/4817e34788324c2ba48b2dfe3f83d5ef => generated 297 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:12.462099 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463203a-fc47-4ad4-984a-32cf469bbfff admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:12.472917 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463203a-fc47-4ad4-984a-32cf469bbfff admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:12.477465 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306162be-5127-41bf-8684-9e3b3e1f431f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:12.478366 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306162be-5127-41bf-8684-9e3b3e1f431f admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:12.478647 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306162be-5127-41bf-8684-9e3b3e1f431f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:12.478958 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306162be-5127-41bf-8684-9e3b3e1f431f admin admin] PATH_INFO: `/v3/users/0808d1267403401f9b3985a1d4d81027` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:12.494422 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306162be-5127-41bf-8684-9e3b3e1f431f admin admin] RBAC: Authorizing `identity:get_user(user_id=0808d1267403401f9b3985a1d4d81027)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:12.497500 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306162be-5127-41bf-8684-9e3b3e1f431f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:12.499313 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 135/262] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:39:12 2022] GET /identity/v3/users/0808d1267403401f9b3985a1d4d81027 => generated 297 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:12.501453 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306162be-5127-41bf-8684-9e3b3e1f431f admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:12.512319 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306162be-5127-41bf-8684-9e3b3e1f431f admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:12.518749 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c356e-c9ef-4915-9b27-429da113e942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:12.519714 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c356e-c9ef-4915-9b27-429da113e942 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:12.520001 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c356e-c9ef-4915-9b27-429da113e942 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:12.520503 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c356e-c9ef-4915-9b27-429da113e942 admin admin] PATH_INFO: `/v3/projects/c6f6acecb2424b65a947c7f56c378682` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:12.522494 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c356e-c9ef-4915-9b27-429da113e942 admin admin] RBAC: Authorizing `identity:get_project(project_id=c6f6acecb2424b65a947c7f56c378682)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:12.526353 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 128/263] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Jan 5 14:39:12 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:39:12.526506 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c356e-c9ef-4915-9b27-429da113e942 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:12.526583 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727d6a8-e412-43ba-bd93-e806fad069ed admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:12.527192 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 136/264] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:12 2022] GET /identity/v3/projects/c6f6acecb2424b65a947c7f56c378682 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:12.532943 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c356e-c9ef-4915-9b27-429da113e942 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:12.544717 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727d6a8-e412-43ba-bd93-e806fad069ed admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:12.545058 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c356e-c9ef-4915-9b27-429da113e942 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:12.549867 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec7f7b-fa2f-4df6-bc60-014be5a40096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:12.550070 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bdb74-4976-4635-a613-fad4fdff2858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:12.551001 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec7f7b-fa2f-4df6-bc60-014be5a40096 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:12.551131 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bdb74-4976-4635-a613-fad4fdff2858 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:12.551297 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bdb74-4976-4635-a613-fad4fdff2858 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:12.551576 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bdb74-4976-4635-a613-fad4fdff2858 admin admin] PATH_INFO: `/v3/projects/c6f6acecb2424b65a947c7f56c378682/users/4817e34788324c2ba48b2dfe3f83d5ef/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:12.551911 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec7f7b-fa2f-4df6-bc60-014be5a40096 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:12.552363 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec7f7b-fa2f-4df6-bc60-014be5a40096 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:12.554149 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997bdb74-4976-4635-a613-fad4fdff2858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6f6acecb2424b65a947c7f56c378682, user_id=4817e34788324c2ba48b2dfe3f83d5ef, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:12.557118 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997bdb74-4976-4635-a613-fad4fdff2858 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:12.564134 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec7f7b-fa2f-4df6-bc60-014be5a40096 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:12.566057 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec7f7b-fa2f-4df6-bc60-014be5a40096 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:12.576830 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 129/265] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:39:12.583169 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec7f7b-fa2f-4df6-bc60-014be5a40096 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:12.593170 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec7f7b-fa2f-4df6-bc60-014be5a40096 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:12.598017 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1ea6c-c1a5-41a5-900f-231f2df4ee22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:12.599032 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1ea6c-c1a5-41a5-900f-231f2df4ee22 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:12.599408 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1ea6c-c1a5-41a5-900f-231f2df4ee22 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:12.599751 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1ea6c-c1a5-41a5-900f-231f2df4ee22 admin admin] PATH_INFO: `/v3/projects/c6f6acecb2424b65a947c7f56c378682` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:12.601245 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1ea6c-c1a5-41a5-900f-231f2df4ee22 admin admin] RBAC: Authorizing `identity:get_project(project_id=c6f6acecb2424b65a947c7f56c378682)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:12.603513 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1ea6c-c1a5-41a5-900f-231f2df4ee22 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:12.606278 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 130/266] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:12 2022] GET /identity/v3/projects/c6f6acecb2424b65a947c7f56c378682 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:12.612402 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1ea6c-c1a5-41a5-900f-231f2df4ee22 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:12.623961 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1ea6c-c1a5-41a5-900f-231f2df4ee22 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:12.629219 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c039af-5d6c-4da7-9952-26462511eb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:12.629894 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c039af-5d6c-4da7-9952-26462511eb34 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:12.630167 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c039af-5d6c-4da7-9952-26462511eb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:12.630441 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c039af-5d6c-4da7-9952-26462511eb34 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:12.631302 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c039af-5d6c-4da7-9952-26462511eb34 admin admin] RBAC: Adding query filter params (role.id=1024abc4fc3948018b1356e4a6671464, scope.project.id=c6f6acecb2424b65a947c7f56c378682, user.id=0808d1267403401f9b3985a1d4d81027) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:12.631607 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c039af-5d6c-4da7-9952-26462511eb34 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:12.633604 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c039af-5d6c-4da7-9952-26462511eb34 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:12.640926 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 131/267] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:39:12 2022] GET /identity/v3/role_assignments?user.id=0808d1267403401f9b3985a1d4d81027&scope.project.id=c6f6acecb2424b65a947c7f56c378682&role.id=1024abc4fc3948018b1356e4a6671464 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:12.659760 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 137/268] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Jan 5 14:39:12 2022] PUT /identity/v3/projects/c6f6acecb2424b65a947c7f56c378682/users/4817e34788324c2ba48b2dfe3f83d5ef/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 14:39:15.086580 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aec866-8257-400c-9131-6f3000b0c5d1 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:15.087101 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aec866-8257-400c-9131-6f3000b0c5d1 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:15.087101 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aec866-8257-400c-9131-6f3000b0c5d1 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:15.089461 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 132/269] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:15.094979 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ab3be-ed18-44b3-88bb-a8843a3fe7f2 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:15.095409 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ab3be-ed18-44b3-88bb-a8843a3fe7f2 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:15.103577 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ab3be-ed18-44b3-88bb-a8843a3fe7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:15.114620 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-686ab3be-ed18-44b3-88bb-a8843a3fe7f2 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:15.115849 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-686ab3be-ed18-44b3-88bb-a8843a3fe7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:15.144825 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a68647-02e5-4a0f-84ca-2073c01d988e None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:15.145452 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a68647-02e5-4a0f-84ca-2073c01d988e None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:15.149617 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a68647-02e5-4a0f-84ca-2073c01d988e None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:15.149617 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 133/270] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 14:39:15.149617 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51909d-cbd0-4df5-afdd-2d7234e53c00 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:15.149617 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51909d-cbd0-4df5-afdd-2d7234e53c00 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:15.150112 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51909d-cbd0-4df5-afdd-2d7234e53c00 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:15.152636 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 134/271] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:15.153861 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3cebf-59e1-4dfb-accc-e47ca7b87953 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:15.154145 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3cebf-59e1-4dfb-accc-e47ca7b87953 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:15.154419 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3cebf-59e1-4dfb-accc-e47ca7b87953 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:15.156151 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 135/272] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:15.157124 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77abd8-f5f7-437c-974b-58f918cb9d12 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:15.157409 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77abd8-f5f7-437c-974b-58f918cb9d12 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:15.157683 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77abd8-f5f7-437c-974b-58f918cb9d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:15.175010 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 138/273] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:39:15.175687 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-cb77abd8-f5f7-437c-974b-58f918cb9d12 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:15.176279 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7fbb4-0699-48e3-bf9f-0ab73e83cd99 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:15.176567 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7fbb4-0699-48e3-bf9f-0ab73e83cd99 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:15.176840 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7fbb4-0699-48e3-bf9f-0ab73e83cd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:15.176939 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-cb77abd8-f5f7-437c-974b-58f918cb9d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:15.184633 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 136/274] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:15.189179 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81170c6a-53b3-474f-9cd0-7c424d1d579c None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:15.189179 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81170c6a-53b3-474f-9cd0-7c424d1d579c None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:15.189179 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81170c6a-53b3-474f-9cd0-7c424d1d579c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:15.193660 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-32a7fbb4-0699-48e3-bf9f-0ab73e83cd99 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:15.194792 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-32a7fbb4-0699-48e3-bf9f-0ab73e83cd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:15.202486 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 139/275] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:15.203255 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7fbb4-0699-48e3-bf9f-0ab73e83cd99 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:15.211940 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-81170c6a-53b3-474f-9cd0-7c424d1d579c None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:15.212190 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7fbb4-0699-48e3-bf9f-0ab73e83cd99 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:15.214151 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-81170c6a-53b3-474f-9cd0-7c424d1d579c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:15.216929 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f86ac5-2959-4cab-9928-16ccce2443f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:15.217732 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f86ac5-2959-4cab-9928-16ccce2443f6 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:15.218015 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f86ac5-2959-4cab-9928-16ccce2443f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:15.218289 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f86ac5-2959-4cab-9928-16ccce2443f6 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:15.222874 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 137/276] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:15.223766 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81170c6a-53b3-474f-9cd0-7c424d1d579c None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:15.231442 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f86ac5-2959-4cab-9928-16ccce2443f6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:15.233706 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81170c6a-53b3-474f-9cd0-7c424d1d579c None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:15.238080 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95992696-9c06-494e-a06e-071613f2ef97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:15.238845 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95992696-9c06-494e-a06e-071613f2ef97 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:15.238959 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-40f86ac5-2959-4cab-9928-16ccce2443f6 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 05 14:39:15.239129 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95992696-9c06-494e-a06e-071613f2ef97 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:15.239403 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95992696-9c06-494e-a06e-071613f2ef97 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:15.240019 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 140/277] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:15.240762 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f86ac5-2959-4cab-9928-16ccce2443f6 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:15.240868 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95992696-9c06-494e-a06e-071613f2ef97 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:15.242629 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95992696-9c06-494e-a06e-071613f2ef97 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:15.244299 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 138/278] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:15.250399 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95992696-9c06-494e-a06e-071613f2ef97 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:15.254569 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f86ac5-2959-4cab-9928-16ccce2443f6 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:15.259048 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d795fbe-3273-46b3-bb3a-999f94f1c1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:15.259848 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d795fbe-3273-46b3-bb3a-999f94f1c1cb admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:15.260132 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d795fbe-3273-46b3-bb3a-999f94f1c1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:15.260436 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d795fbe-3273-46b3-bb3a-999f94f1c1cb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:15.264726 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95992696-9c06-494e-a06e-071613f2ef97 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:15.269083 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fe7ae-f5b2-40d2-8f97-3f8416fb3ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:15.269734 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fe7ae-f5b2-40d2-8f97-3f8416fb3ddd admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:15.270023 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fe7ae-f5b2-40d2-8f97-3f8416fb3ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:15.270300 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fe7ae-f5b2-40d2-8f97-3f8416fb3ddd admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:15.271034 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fe7ae-f5b2-40d2-8f97-3f8416fb3ddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:15.271147 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d795fbe-3273-46b3-bb3a-999f94f1c1cb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:15.272943 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fe7ae-f5b2-40d2-8f97-3f8416fb3ddd admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:15.278870 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-2d795fbe-3273-46b3-bb3a-999f94f1c1cb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 05 14:39:15.280032 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 141/279] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:15.280775 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d795fbe-3273-46b3-bb3a-999f94f1c1cb admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:15.290142 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d795fbe-3273-46b3-bb3a-999f94f1c1cb admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:15.295057 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0010c-b189-435c-a22d-55ae32e32d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:15.295666 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0010c-b189-435c-a22d-55ae32e32d91 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:15.295949 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0010c-b189-435c-a22d-55ae32e32d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:15.296225 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0010c-b189-435c-a22d-55ae32e32d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:15.298222 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0010c-b189-435c-a22d-55ae32e32d91 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:15.298222 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0010c-b189-435c-a22d-55ae32e32d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:15.298858 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0010c-b189-435c-a22d-55ae32e32d91 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:15.306690 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 142/280] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jan 5 14:39:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:15.307460 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0010c-b189-435c-a22d-55ae32e32d91 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:15.317421 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0010c-b189-435c-a22d-55ae32e32d91 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:15.321667 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3cff16-dd6b-40b2-ae87-8fe53ee055e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:15.322399 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3cff16-dd6b-40b2-ae87-8fe53ee055e7 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:15.322685 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3cff16-dd6b-40b2-ae87-8fe53ee055e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:15.322964 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3cff16-dd6b-40b2-ae87-8fe53ee055e7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:15.333293 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3cff16-dd6b-40b2-ae87-8fe53ee055e7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:15.340913 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-de3cff16-dd6b-40b2-ae87-8fe53ee055e7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 05 14:39:15.341985 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 143/281] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:15.343812 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3cff16-dd6b-40b2-ae87-8fe53ee055e7 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:15.359118 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 139/282] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Jan 5 14:39:15 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:39:15.359118 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fe7ae-f5b2-40d2-8f97-3f8416fb3ddd admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:15.359453 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3cff16-dd6b-40b2-ae87-8fe53ee055e7 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:15.363351 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7de83-1bde-448b-aa7a-65398a233ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:15.364178 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7de83-1bde-448b-aa7a-65398a233ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:15.364462 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7de83-1bde-448b-aa7a-65398a233ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:15.364737 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7de83-1bde-448b-aa7a-65398a233ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:15.365545 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7de83-1bde-448b-aa7a-65398a233ae1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:15.365850 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7de83-1bde-448b-aa7a-65398a233ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:15.367762 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7de83-1bde-448b-aa7a-65398a233ae1 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:15.371146 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fe7ae-f5b2-40d2-8f97-3f8416fb3ddd admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:15.376569 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14905b-d4a4-4feb-ba9d-943a061e6d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:15.377200 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 144/283] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jan 5 14:39:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:15.377934 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14905b-d4a4-4feb-ba9d-943a061e6d39 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:15.378670 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14905b-d4a4-4feb-ba9d-943a061e6d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:15.379113 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14905b-d4a4-4feb-ba9d-943a061e6d39 admin admin] PATH_INFO: `/v3/users/0808d1267403401f9b3985a1d4d81027` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:15.380724 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14905b-d4a4-4feb-ba9d-943a061e6d39 admin admin] RBAC: Authorizing `identity:get_user(user_id=0808d1267403401f9b3985a1d4d81027)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:15.383116 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14905b-d4a4-4feb-ba9d-943a061e6d39 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:15.383232 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7de83-1bde-448b-aa7a-65398a233ae1 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:15.389743 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 140/284] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:39:15 2022] GET /identity/v3/users/0808d1267403401f9b3985a1d4d81027 => generated 297 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:15.389743 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14905b-d4a4-4feb-ba9d-943a061e6d39 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:15.393821 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7de83-1bde-448b-aa7a-65398a233ae1 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:15.399066 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28174e-786e-481a-8172-9cf038fd2520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:15.399754 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28174e-786e-481a-8172-9cf038fd2520 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:15.400040 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28174e-786e-481a-8172-9cf038fd2520 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:15.400317 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28174e-786e-481a-8172-9cf038fd2520 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:15.400794 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14905b-d4a4-4feb-ba9d-943a061e6d39 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:15.401636 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28174e-786e-481a-8172-9cf038fd2520 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:15.401978 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28174e-786e-481a-8172-9cf038fd2520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:15.403591 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28174e-786e-481a-8172-9cf038fd2520 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:15.405865 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fac52-79e7-4d44-91a0-73d31c89dc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:15.407445 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fac52-79e7-4d44-91a0-73d31c89dc9b admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:15.407445 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fac52-79e7-4d44-91a0-73d31c89dc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:15.407445 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fac52-79e7-4d44-91a0-73d31c89dc9b admin admin] PATH_INFO: `/v3/users/4817e34788324c2ba48b2dfe3f83d5ef` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:15.408923 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362fac52-79e7-4d44-91a0-73d31c89dc9b admin admin] RBAC: Authorizing `identity:get_user(user_id=4817e34788324c2ba48b2dfe3f83d5ef)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:15.411265 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362fac52-79e7-4d44-91a0-73d31c89dc9b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:15.418350 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 145/285] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jan 5 14:39:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:15.418540 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 141/286] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:39:15 2022] GET /identity/v3/users/4817e34788324c2ba48b2dfe3f83d5ef => generated 297 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:15.418617 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28174e-786e-481a-8172-9cf038fd2520 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:15.419926 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fac52-79e7-4d44-91a0-73d31c89dc9b admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:15.428520 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28174e-786e-481a-8172-9cf038fd2520 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:15.429669 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fac52-79e7-4d44-91a0-73d31c89dc9b admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:15.433222 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c391f-9d0f-461e-a6bf-c2085b4c2814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:15.434138 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c8e36-98cc-44a9-a042-be9c64529fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:15.434252 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c391f-9d0f-461e-a6bf-c2085b4c2814 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:15.434474 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c391f-9d0f-461e-a6bf-c2085b4c2814 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:15.434754 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c391f-9d0f-461e-a6bf-c2085b4c2814 admin admin] PATH_INFO: `/v3/projects/c6f6acecb2424b65a947c7f56c378682` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:15.435010 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c8e36-98cc-44a9-a042-be9c64529fac admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:15.435321 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c8e36-98cc-44a9-a042-be9c64529fac admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:15.435727 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c8e36-98cc-44a9-a042-be9c64529fac admin admin] PATH_INFO: `/v3/users/e918037671a94e90b50492f19626341b` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:15.436123 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c391f-9d0f-461e-a6bf-c2085b4c2814 admin admin] RBAC: Authorizing `identity:get_project(project_id=c6f6acecb2424b65a947c7f56c378682)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:15.438301 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c391f-9d0f-461e-a6bf-c2085b4c2814 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:15.444996 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 146/287] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:15 2022] GET /identity/v3/projects/c6f6acecb2424b65a947c7f56c378682 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:15.444996 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c391f-9d0f-461e-a6bf-c2085b4c2814 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:15.452611 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c8e36-98cc-44a9-a042-be9c64529fac admin admin] RBAC: Authorizing `identity:get_user(user_id=e918037671a94e90b50492f19626341b)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:15.454948 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c8e36-98cc-44a9-a042-be9c64529fac admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:15.455839 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c391f-9d0f-461e-a6bf-c2085b4c2814 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:15.461908 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 142/288] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:39:15 2022] GET /identity/v3/users/e918037671a94e90b50492f19626341b => generated 293 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:15.461908 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c8e36-98cc-44a9-a042-be9c64529fac admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:15.466042 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45997260-a20e-42c8-ad93-c8ede34a42eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:15.466706 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45997260-a20e-42c8-ad93-c8ede34a42eb admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:15.467049 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45997260-a20e-42c8-ad93-c8ede34a42eb admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:15.467328 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45997260-a20e-42c8-ad93-c8ede34a42eb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:15.472055 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c8e36-98cc-44a9-a042-be9c64529fac admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:15.476058 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45997260-a20e-42c8-ad93-c8ede34a42eb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:15.476656 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e26308-ba68-4ea2-8613-bc41f51dbb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:15.477663 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e26308-ba68-4ea2-8613-bc41f51dbb53 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:15.477923 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45997260-a20e-42c8-ad93-c8ede34a42eb admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:15.478061 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e26308-ba68-4ea2-8613-bc41f51dbb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:15.478392 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e26308-ba68-4ea2-8613-bc41f51dbb53 admin admin] PATH_INFO: `/v3/projects/c6f6acecb2424b65a947c7f56c378682/users/0808d1267403401f9b3985a1d4d81027/roles/1024abc4fc3948018b1356e4a6671464` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:15.480555 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e26308-ba68-4ea2-8613-bc41f51dbb53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6f6acecb2424b65a947c7f56c378682, user_id=0808d1267403401f9b3985a1d4d81027, role_id=1024abc4fc3948018b1356e4a6671464)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:15.483354 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e26308-ba68-4ea2-8613-bc41f51dbb53 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:15.487980 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 147/289] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:39:15.492790 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45997260-a20e-42c8-ad93-c8ede34a42eb admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:15.498831 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45997260-a20e-42c8-ad93-c8ede34a42eb admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:15.503698 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b74fb7-04b0-4efe-af5c-ef13b8bc400a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:15.504357 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b74fb7-04b0-4efe-af5c-ef13b8bc400a admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:15.504645 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b74fb7-04b0-4efe-af5c-ef13b8bc400a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:15.504926 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b74fb7-04b0-4efe-af5c-ef13b8bc400a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:15.505836 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b74fb7-04b0-4efe-af5c-ef13b8bc400a admin admin] RBAC: Adding query filter params (role.id=eaba1e26bf0040868b08b042a7859698, user.id=e918037671a94e90b50492f19626341b, scope.system=all) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:15.506153 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b74fb7-04b0-4efe-af5c-ef13b8bc400a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:15.508120 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b74fb7-04b0-4efe-af5c-ef13b8bc400a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:15.517812 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 148/290] 10.222.0.30 () {56 vars in 1329 bytes} [Wed Jan 5 14:39:15 2022] GET /identity/v3/role_assignments?user.id=e918037671a94e90b50492f19626341b&scope.system=all&role.id=eaba1e26bf0040868b08b042a7859698 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:15.519544 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b74fb7-04b0-4efe-af5c-ef13b8bc400a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:15.539860 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b74fb7-04b0-4efe-af5c-ef13b8bc400a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:15.544808 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9547c7fa-4ec2-43b2-a96d-419b3a8288ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:15.545742 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547c7fa-4ec2-43b2-a96d-419b3a8288ae admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:15.546026 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547c7fa-4ec2-43b2-a96d-419b3a8288ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:15.546332 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547c7fa-4ec2-43b2-a96d-419b3a8288ae admin admin] PATH_INFO: `/v3/projects/c6f6acecb2424b65a947c7f56c378682` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:15.547666 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9547c7fa-4ec2-43b2-a96d-419b3a8288ae admin admin] RBAC: Authorizing `identity:get_project(project_id=c6f6acecb2424b65a947c7f56c378682)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:15.549959 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9547c7fa-4ec2-43b2-a96d-419b3a8288ae admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:15.552031 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 149/291] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:15 2022] GET /identity/v3/projects/c6f6acecb2424b65a947c7f56c378682 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:15.558516 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9547c7fa-4ec2-43b2-a96d-419b3a8288ae admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:15.569744 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9547c7fa-4ec2-43b2-a96d-419b3a8288ae admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:15.581496 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 143/292] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Jan 5 14:39:15 2022] PUT /identity/v3/projects/c6f6acecb2424b65a947c7f56c378682/users/0808d1267403401f9b3985a1d4d81027/roles/1024abc4fc3948018b1356e4a6671464 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:39:15.581828 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc65c7e-0ccd-4ba0-9fb4-bbd83e7a8410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:15.582500 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc65c7e-0ccd-4ba0-9fb4-bbd83e7a8410 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:15.582781 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc65c7e-0ccd-4ba0-9fb4-bbd83e7a8410 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:15.586123 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc65c7e-0ccd-4ba0-9fb4-bbd83e7a8410 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:15.586123 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc65c7e-0ccd-4ba0-9fb4-bbd83e7a8410 admin admin] RBAC: Adding query filter params (role.id=eaba1e26bf0040868b08b042a7859698, scope.project.id=c6f6acecb2424b65a947c7f56c378682, user.id=4817e34788324c2ba48b2dfe3f83d5ef) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:15.586123 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc65c7e-0ccd-4ba0-9fb4-bbd83e7a8410 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:15.586363 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc65c7e-0ccd-4ba0-9fb4-bbd83e7a8410 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:15.593867 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 150/293] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:39:15 2022] GET /identity/v3/role_assignments?user.id=4817e34788324c2ba48b2dfe3f83d5ef&scope.project.id=c6f6acecb2424b65a947c7f56c378682&role.id=eaba1e26bf0040868b08b042a7859698 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:17.990856 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20d3f0-540e-4891-a511-16f5be9c7e4c None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:17.991378 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20d3f0-540e-4891-a511-16f5be9c7e4c None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:17.991681 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20d3f0-540e-4891-a511-16f5be9c7e4c None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:17.993690 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 144/294] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 14:39:17.998983 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0b69d-f2af-4148-b3f8-b0a98e08bc26 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:17.999392 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0b69d-f2af-4148-b3f8-b0a98e08bc26 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:17.999726 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0b69d-f2af-4148-b3f8-b0a98e08bc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:18.012591 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992d2fc-2d78-4d8d-ba89-4927ff4d373e None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:18.012892 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992d2fc-2d78-4d8d-ba89-4927ff4d373e None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:18.013191 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992d2fc-2d78-4d8d-ba89-4927ff4d373e None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:18.015136 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 145/295] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 14:39:18.023018 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43645acc-f4b6-44b3-b3b1-2a6b72839165 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:18.023018 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43645acc-f4b6-44b3-b3b1-2a6b72839165 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:18.023018 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43645acc-f4b6-44b3-b3b1-2a6b72839165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:18.023274 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-1cc0b69d-f2af-4148-b3f8-b0a98e08bc26 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:18.023947 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-1cc0b69d-f2af-4148-b3f8-b0a98e08bc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:18.041158 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-43645acc-f4b6-44b3-b3b1-2a6b72839165 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:18.043323 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-43645acc-f4b6-44b3-b3b1-2a6b72839165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:18.087978 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 151/296] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:18.090462 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d526323-bed8-40ec-bba1-b9dcb86fb46e None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:18.091029 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d526323-bed8-40ec-bba1-b9dcb86fb46e None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:18.091606 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d526323-bed8-40ec-bba1-b9dcb86fb46e None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:18.093629 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 152/297] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:18.094785 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535f488-e58a-45c1-9305-72d2fc7a9eb5 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:18.095131 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535f488-e58a-45c1-9305-72d2fc7a9eb5 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:18.095420 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535f488-e58a-45c1-9305-72d2fc7a9eb5 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:18.097342 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 153/298] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:18.100371 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396e547-8570-4413-b9d8-34005f3618b2 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:18.100665 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396e547-8570-4413-b9d8-34005f3618b2 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:18.101318 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396e547-8570-4413-b9d8-34005f3618b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:18.114320 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 146/299] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:39:18.115589 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589692c9-1362-48a6-99b4-a5945f783266 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:18.115875 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589692c9-1362-48a6-99b4-a5945f783266 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:18.116151 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589692c9-1362-48a6-99b4-a5945f783266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:18.120774 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-f396e547-8570-4413-b9d8-34005f3618b2 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:18.122030 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-f396e547-8570-4413-b9d8-34005f3618b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:18.131409 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 154/300] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:39:18.133868 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396e547-8570-4413-b9d8-34005f3618b2 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:18.142143 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-589692c9-1362-48a6-99b4-a5945f783266 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:18.143342 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-589692c9-1362-48a6-99b4-a5945f783266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:18.143782 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396e547-8570-4413-b9d8-34005f3618b2 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:18.148028 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f0290-1ffd-4880-b8be-b7544bb821c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:18.148831 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f0290-1ffd-4880-b8be-b7544bb821c4 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:18.149171 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f0290-1ffd-4880-b8be-b7544bb821c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:18.149406 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f0290-1ffd-4880-b8be-b7544bb821c4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:18.153293 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 147/301] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:18.153293 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589692c9-1362-48a6-99b4-a5945f783266 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:18.160629 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589692c9-1362-48a6-99b4-a5945f783266 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:18.162998 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f0290-1ffd-4880-b8be-b7544bb821c4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:18.164936 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1190af-86fc-401a-a9a0-e486682a32dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:18.165764 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1190af-86fc-401a-a9a0-e486682a32dc admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:18.166048 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1190af-86fc-401a-a9a0-e486682a32dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:18.166320 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1190af-86fc-401a-a9a0-e486682a32dc admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:18.171179 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-1c0f0290-1ffd-4880-b8be-b7544bb821c4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 05 14:39:18.172555 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 155/302] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:18.173540 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f0290-1ffd-4880-b8be-b7544bb821c4 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:18.180864 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1190af-86fc-401a-a9a0-e486682a32dc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:18.183705 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f0290-1ffd-4880-b8be-b7544bb821c4 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:18.187967 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7443cb-83bb-47b8-af8b-efbcda1e7498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:18.188510 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-9e1190af-86fc-401a-a9a0-e486682a32dc admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 05 14:39:18.188687 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7443cb-83bb-47b8-af8b-efbcda1e7498 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:18.188977 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7443cb-83bb-47b8-af8b-efbcda1e7498 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:18.189292 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7443cb-83bb-47b8-af8b-efbcda1e7498 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:18.194310 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 148/303] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:18.194310 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1190af-86fc-401a-a9a0-e486682a32dc admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:18.194517 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7443cb-83bb-47b8-af8b-efbcda1e7498 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:18.194517 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7443cb-83bb-47b8-af8b-efbcda1e7498 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:18.194517 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 156/304] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:18.194701 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7443cb-83bb-47b8-af8b-efbcda1e7498 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:18.199555 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1190af-86fc-401a-a9a0-e486682a32dc admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:18.203844 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf55b3-d655-4ff2-9c66-429234cabaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:18.204569 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf55b3-d655-4ff2-9c66-429234cabaa2 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:18.204682 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7443cb-83bb-47b8-af8b-efbcda1e7498 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:18.204846 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf55b3-d655-4ff2-9c66-429234cabaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:18.205144 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf55b3-d655-4ff2-9c66-429234cabaa2 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:18.209015 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914dccc6-ef93-4b4b-9175-b6088828f56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:18.209667 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914dccc6-ef93-4b4b-9175-b6088828f56a admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:18.209951 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914dccc6-ef93-4b4b-9175-b6088828f56a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:18.210228 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914dccc6-ef93-4b4b-9175-b6088828f56a admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:18.210966 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914dccc6-ef93-4b4b-9175-b6088828f56a admin admin] RBAC: Adding query filter params (name=member) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:18.211270 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914dccc6-ef93-4b4b-9175-b6088828f56a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:18.212815 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914dccc6-ef93-4b4b-9175-b6088828f56a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:18.216579 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf55b3-d655-4ff2-9c66-429234cabaa2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:18.221337 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 157/305] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jan 5 14:39:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:18.221337 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914dccc6-ef93-4b4b-9175-b6088828f56a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:18.225888 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-45bf55b3-d655-4ff2-9c66-429234cabaa2 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 05 14:39:18.225888 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 149/306] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:18.225888 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf55b3-d655-4ff2-9c66-429234cabaa2 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:18.232114 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914dccc6-ef93-4b4b-9175-b6088828f56a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:18.235632 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf55b3-d655-4ff2-9c66-429234cabaa2 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:18.236386 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f8d3b-fca6-474b-9af3-d18a8237616b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:18.237009 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f8d3b-fca6-474b-9af3-d18a8237616b admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:18.237326 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f8d3b-fca6-474b-9af3-d18a8237616b admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:18.237714 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f8d3b-fca6-474b-9af3-d18a8237616b admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:18.238459 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f8d3b-fca6-474b-9af3-d18a8237616b admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:18.238764 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f8d3b-fca6-474b-9af3-d18a8237616b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:18.239907 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8668f-7917-43e2-9c5f-63a637ef9d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:18.240309 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f8d3b-fca6-474b-9af3-d18a8237616b admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:18.240508 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8668f-7917-43e2-9c5f-63a637ef9d27 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:18.240789 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8668f-7917-43e2-9c5f-63a637ef9d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:18.241138 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8668f-7917-43e2-9c5f-63a637ef9d27 admin admin] PATH_INFO: `/v3/groups` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:18.241776 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8668f-7917-43e2-9c5f-63a637ef9d27 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:18.242794 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING py.warnings [None req-d4e8668f-7917-43e2-9c5f-63a637ef9d27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:39:18.242794 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: warnings.warn(msg) Jan 05 14:39:18.242794 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: Jan 05 14:39:18.243957 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8668f-7917-43e2-9c5f-63a637ef9d27 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:18.248576 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 158/307] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jan 5 14:39:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:18.249456 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f8d3b-fca6-474b-9af3-d18a8237616b admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:18.258647 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f8d3b-fca6-474b-9af3-d18a8237616b admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:18.265450 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95470dc5-92fc-4c63-afad-e8b04565aaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:18.267367 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95470dc5-92fc-4c63-afad-e8b04565aaa4 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:18.268071 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95470dc5-92fc-4c63-afad-e8b04565aaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:18.268360 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95470dc5-92fc-4c63-afad-e8b04565aaa4 admin admin] PATH_INFO: `/v3/users/e918037671a94e90b50492f19626341b` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:18.269634 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95470dc5-92fc-4c63-afad-e8b04565aaa4 admin admin] RBAC: Authorizing `identity:get_user(user_id=e918037671a94e90b50492f19626341b)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:18.271727 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95470dc5-92fc-4c63-afad-e8b04565aaa4 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:18.273716 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 159/308] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:39:18 2022] GET /identity/v3/users/e918037671a94e90b50492f19626341b => generated 293 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:18.274510 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95470dc5-92fc-4c63-afad-e8b04565aaa4 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:18.284330 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95470dc5-92fc-4c63-afad-e8b04565aaa4 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:18.288579 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25601d-fb41-4315-bd39-5b07f5b57492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:18.292330 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25601d-fb41-4315-bd39-5b07f5b57492 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:18.292330 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25601d-fb41-4315-bd39-5b07f5b57492 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:18.292330 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25601d-fb41-4315-bd39-5b07f5b57492 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:18.292330 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25601d-fb41-4315-bd39-5b07f5b57492 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:18.292330 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25601d-fb41-4315-bd39-5b07f5b57492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:18.292890 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25601d-fb41-4315-bd39-5b07f5b57492 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:18.300703 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 160/309] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jan 5 14:39:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:18.301534 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25601d-fb41-4315-bd39-5b07f5b57492 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:18.310489 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25601d-fb41-4315-bd39-5b07f5b57492 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:18.314734 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911b028-e5ab-4d40-ac0d-4c79418903d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:18.315651 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911b028-e5ab-4d40-ac0d-4c79418903d3 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:18.320658 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 150/310] 10.222.0.30 () {60 vars in 1155 bytes} [Wed Jan 5 14:39:18 2022] POST /identity/v3/groups => generated 229 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:39:18.320795 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911b028-e5ab-4d40-ac0d-4c79418903d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:18.320795 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911b028-e5ab-4d40-ac0d-4c79418903d3 admin admin] PATH_INFO: `/v3/users/75a904d145ca4accbec823fb3ffab617` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:18.320943 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8668f-7917-43e2-9c5f-63a637ef9d27 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:18.330434 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8668f-7917-43e2-9c5f-63a637ef9d27 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:18.335090 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e401d-1a48-4e4f-aced-2d343aab41a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:18.336041 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e401d-1a48-4e4f-aced-2d343aab41a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:18.336212 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911b028-e5ab-4d40-ac0d-4c79418903d3 admin admin] RBAC: Authorizing `identity:get_user(user_id=75a904d145ca4accbec823fb3ffab617)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:18.336332 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e401d-1a48-4e4f-aced-2d343aab41a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:18.336586 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e401d-1a48-4e4f-aced-2d343aab41a0 admin admin] PATH_INFO: `/v3/system/users/e918037671a94e90b50492f19626341b/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:18.338205 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e401d-1a48-4e4f-aced-2d343aab41a0 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e918037671a94e90b50492f19626341b, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:18.339259 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911b028-e5ab-4d40-ac0d-4c79418903d3 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:18.339824 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING py.warnings [None req-007e401d-1a48-4e4f-aced-2d343aab41a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:39:18.339824 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: warnings.warn(msg) Jan 05 14:39:18.339824 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: Jan 05 14:39:18.344299 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e401d-1a48-4e4f-aced-2d343aab41a0 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:18.344376 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 161/311] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:39:18 2022] GET /identity/v3/users/75a904d145ca4accbec823fb3ffab617 => generated 293 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:18.344376 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911b028-e5ab-4d40-ac0d-4c79418903d3 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:18.356711 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911b028-e5ab-4d40-ac0d-4c79418903d3 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:18.361351 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb8439-dd7f-4821-a029-5ed41bc36183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:18.362237 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb8439-dd7f-4821-a029-5ed41bc36183 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:18.362522 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb8439-dd7f-4821-a029-5ed41bc36183 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:18.362801 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb8439-dd7f-4821-a029-5ed41bc36183 admin admin] PATH_INFO: `/v3/users/0808d1267403401f9b3985a1d4d81027` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:18.364029 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb8439-dd7f-4821-a029-5ed41bc36183 admin admin] RBAC: Authorizing `identity:get_user(user_id=0808d1267403401f9b3985a1d4d81027)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:18.366226 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb8439-dd7f-4821-a029-5ed41bc36183 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:18.367916 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 162/312] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:39:18 2022] GET /identity/v3/users/0808d1267403401f9b3985a1d4d81027 => generated 297 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:18.368687 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb8439-dd7f-4821-a029-5ed41bc36183 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:18.382553 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb8439-dd7f-4821-a029-5ed41bc36183 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:18.387199 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d0a7e-092b-4523-a960-98123952b23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:18.387860 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d0a7e-092b-4523-a960-98123952b23b admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:18.388147 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d0a7e-092b-4523-a960-98123952b23b admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:18.388423 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d0a7e-092b-4523-a960-98123952b23b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:18.389308 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d0a7e-092b-4523-a960-98123952b23b admin admin] RBAC: Adding query filter params (role.id=1024abc4fc3948018b1356e4a6671464, user.id=75a904d145ca4accbec823fb3ffab617, scope.system=all) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:18.389629 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d0a7e-092b-4523-a960-98123952b23b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:18.391531 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d0a7e-092b-4523-a960-98123952b23b admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:18.397312 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 163/313] 10.222.0.30 () {56 vars in 1329 bytes} [Wed Jan 5 14:39:18 2022] GET /identity/v3/role_assignments?user.id=75a904d145ca4accbec823fb3ffab617&scope.system=all&role.id=1024abc4fc3948018b1356e4a6671464 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:18.398161 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d0a7e-092b-4523-a960-98123952b23b admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:18.415285 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d0a7e-092b-4523-a960-98123952b23b admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:18.420699 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7f22e-ac59-42f2-b7ea-8aa04b293230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:18.421408 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7f22e-ac59-42f2-b7ea-8aa04b293230 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:18.421697 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7f22e-ac59-42f2-b7ea-8aa04b293230 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:18.421976 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7f22e-ac59-42f2-b7ea-8aa04b293230 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:18.431180 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7f22e-ac59-42f2-b7ea-8aa04b293230 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:18.433167 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7f22e-ac59-42f2-b7ea-8aa04b293230 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:18.437811 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 151/314] 10.222.0.30 () {58 vars in 1355 bytes} [Wed Jan 5 14:39:18 2022] PUT /identity/v3/system/users/e918037671a94e90b50492f19626341b/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:39:18.447175 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 164/315] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:39:18.453414 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e401d-1a48-4e4f-aced-2d343aab41a0 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:18.466193 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e401d-1a48-4e4f-aced-2d343aab41a0 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:18.471435 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725ff69-30f7-4019-9248-35bbf0b8179b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:18.472405 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725ff69-30f7-4019-9248-35bbf0b8179b admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:18.472698 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725ff69-30f7-4019-9248-35bbf0b8179b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:18.473102 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725ff69-30f7-4019-9248-35bbf0b8179b admin admin] PATH_INFO: `/v3/projects/c6f6acecb2424b65a947c7f56c378682` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:18.474632 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725ff69-30f7-4019-9248-35bbf0b8179b admin admin] RBAC: Authorizing `identity:get_project(project_id=c6f6acecb2424b65a947c7f56c378682)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:18.476895 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725ff69-30f7-4019-9248-35bbf0b8179b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:18.479342 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 152/316] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:18 2022] GET /identity/v3/projects/c6f6acecb2424b65a947c7f56c378682 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:18.485600 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7f22e-ac59-42f2-b7ea-8aa04b293230 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:18.498338 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7f22e-ac59-42f2-b7ea-8aa04b293230 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:18.503685 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80923990-7b68-4988-8af3-8c178a7be4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:18.504429 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80923990-7b68-4988-8af3-8c178a7be4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:18.504720 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80923990-7b68-4988-8af3-8c178a7be4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:18.505025 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80923990-7b68-4988-8af3-8c178a7be4b1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:18.506090 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80923990-7b68-4988-8af3-8c178a7be4b1 admin admin] RBAC: Adding query filter params (role.id=1024abc4fc3948018b1356e4a6671464, scope.project.id=c6f6acecb2424b65a947c7f56c378682, user.id=0808d1267403401f9b3985a1d4d81027) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:18.506405 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80923990-7b68-4988-8af3-8c178a7be4b1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:18.511285 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80923990-7b68-4988-8af3-8c178a7be4b1 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:18.516599 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 165/317] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:39:18 2022] GET /identity/v3/role_assignments?user.id=0808d1267403401f9b3985a1d4d81027&scope.project.id=c6f6acecb2424b65a947c7f56c378682&role.id=1024abc4fc3948018b1356e4a6671464 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:20.764683 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae4302-0662-4f97-b642-915a3cd818e3 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:20.765386 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae4302-0662-4f97-b642-915a3cd818e3 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:20.765386 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae4302-0662-4f97-b642-915a3cd818e3 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:20.767087 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 153/318] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:20.772014 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e1e37-66f6-40a3-af42-805f1485d044 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:20.772386 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e1e37-66f6-40a3-af42-805f1485d044 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:20.772579 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e1e37-66f6-40a3-af42-805f1485d044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:20.789739 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-9b7e1e37-66f6-40a3-af42-805f1485d044 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:20.790889 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-9b7e1e37-66f6-40a3-af42-805f1485d044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:20.798874 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 166/319] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:20.822400 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae4302-0662-4f97-b642-915a3cd818e3 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:20.834625 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae4302-0662-4f97-b642-915a3cd818e3 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:20.838842 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c2d84-c211-4822-938b-61255897ec56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:20.839610 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c2d84-c211-4822-938b-61255897ec56 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:20.839888 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c2d84-c211-4822-938b-61255897ec56 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:20.840162 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c2d84-c211-4822-938b-61255897ec56 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:20.841355 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c2d84-c211-4822-938b-61255897ec56 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:20.843050 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c2d84-c211-4822-938b-61255897ec56 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:20.844796 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 154/320] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:20.847971 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894192b1-fa7d-4de7-9956-75a6e3cab57b None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:20.848264 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894192b1-fa7d-4de7-9956-75a6e3cab57b None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:20.848579 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894192b1-fa7d-4de7-9956-75a6e3cab57b None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:20.849868 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c2d84-c211-4822-938b-61255897ec56 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:20.850349 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 167/321] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:20.855709 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc33a4-9884-4386-88d0-08cc68efc9f0 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:20.855992 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc33a4-9884-4386-88d0-08cc68efc9f0 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:20.856263 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc33a4-9884-4386-88d0-08cc68efc9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:20.860496 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c2d84-c211-4822-938b-61255897ec56 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:20.865983 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca812e6a-22ef-44ba-853a-60c2e9270bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:20.866628 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca812e6a-22ef-44ba-853a-60c2e9270bcc admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:20.866913 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca812e6a-22ef-44ba-853a-60c2e9270bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:20.867190 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca812e6a-22ef-44ba-853a-60c2e9270bcc admin admin] PATH_INFO: `/v3/groups` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:20.867890 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca812e6a-22ef-44ba-853a-60c2e9270bcc admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:20.870430 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca812e6a-22ef-44ba-853a-60c2e9270bcc admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:20.874855 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-29bc33a4-9884-4386-88d0-08cc68efc9f0 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:20.876024 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-29bc33a4-9884-4386-88d0-08cc68efc9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:20.884420 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 168/322] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:39:20.885858 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a2914-6403-4023-80ae-808c663b6775 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:20.886136 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a2914-6403-4023-80ae-808c663b6775 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:20.886407 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a2914-6403-4023-80ae-808c663b6775 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:20.888045 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 169/323] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:20.892805 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a25a89-a21f-43b3-bd85-dccc2c12cede None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:20.893110 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a25a89-a21f-43b3-bd85-dccc2c12cede None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:20.893386 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a25a89-a21f-43b3-bd85-dccc2c12cede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:20.911569 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-f7a25a89-a21f-43b3-bd85-dccc2c12cede None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:20.912722 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-f7a25a89-a21f-43b3-bd85-dccc2c12cede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:20.920675 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 170/324] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:39:20.921437 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a25a89-a21f-43b3-bd85-dccc2c12cede None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:20.929965 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a25a89-a21f-43b3-bd85-dccc2c12cede None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:20.934746 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc2757-5e79-416e-8f4b-a88cc47d7299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:20.935483 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc2757-5e79-416e-8f4b-a88cc47d7299 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:20.935756 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc2757-5e79-416e-8f4b-a88cc47d7299 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:20.936027 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc2757-5e79-416e-8f4b-a88cc47d7299 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:20.946194 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc2757-5e79-416e-8f4b-a88cc47d7299 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:20.953588 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-42fc2757-5e79-416e-8f4b-a88cc47d7299 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 05 14:39:20.954720 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 171/325] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:20.955561 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc2757-5e79-416e-8f4b-a88cc47d7299 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:20.964485 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc2757-5e79-416e-8f4b-a88cc47d7299 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:20.968761 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620b9e8-5819-4888-be98-e458a6b9b36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:20.969476 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620b9e8-5819-4888-be98-e458a6b9b36a admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:20.969761 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620b9e8-5819-4888-be98-e458a6b9b36a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:20.970036 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620b9e8-5819-4888-be98-e458a6b9b36a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:20.978892 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 155/326] 10.222.0.30 () {60 vars in 1155 bytes} [Wed Jan 5 14:39:20 2022] POST /identity/v3/groups => generated 226 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 14:39:20.980233 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca812e6a-22ef-44ba-853a-60c2e9270bcc admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:20.980963 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620b9e8-5819-4888-be98-e458a6b9b36a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:20.988357 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-7620b9e8-5819-4888-be98-e458a6b9b36a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 05 14:39:20.989854 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 172/327] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:20.990291 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca812e6a-22ef-44ba-853a-60c2e9270bcc admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:20.995937 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fb67b-8a27-40fa-b305-bd82eabb6973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:20.996289 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620b9e8-5819-4888-be98-e458a6b9b36a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:20.996634 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fb67b-8a27-40fa-b305-bd82eabb6973 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:20.996914 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fb67b-8a27-40fa-b305-bd82eabb6973 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:20.997230 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fb67b-8a27-40fa-b305-bd82eabb6973 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:20.998018 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9fb67b-8a27-40fa-b305-bd82eabb6973 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:20.998328 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9fb67b-8a27-40fa-b305-bd82eabb6973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:20.999995 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9fb67b-8a27-40fa-b305-bd82eabb6973 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:21.007252 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620b9e8-5819-4888-be98-e458a6b9b36a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:21.015020 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 156/328] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jan 5 14:39:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:21.016022 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fb67b-8a27-40fa-b305-bd82eabb6973 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:21.018745 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444b563-757d-4d8c-85ba-9f7aae54db17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:21.019431 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444b563-757d-4d8c-85ba-9f7aae54db17 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:21.019714 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444b563-757d-4d8c-85ba-9f7aae54db17 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:21.019988 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444b563-757d-4d8c-85ba-9f7aae54db17 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:21.020769 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444b563-757d-4d8c-85ba-9f7aae54db17 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:21.021091 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444b563-757d-4d8c-85ba-9f7aae54db17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:21.022786 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444b563-757d-4d8c-85ba-9f7aae54db17 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:21.026863 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fb67b-8a27-40fa-b305-bd82eabb6973 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:21.031498 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374e1c7-a887-46ae-a4e2-9b34f7fb8d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:21.032380 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374e1c7-a887-46ae-a4e2-9b34f7fb8d30 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:21.032666 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374e1c7-a887-46ae-a4e2-9b34f7fb8d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:21.032942 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374e1c7-a887-46ae-a4e2-9b34f7fb8d30 admin admin] PATH_INFO: `/v3/users/75a904d145ca4accbec823fb3ffab617` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:21.034447 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374e1c7-a887-46ae-a4e2-9b34f7fb8d30 admin admin] RBAC: Authorizing `identity:get_user(user_id=75a904d145ca4accbec823fb3ffab617)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:21.036706 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374e1c7-a887-46ae-a4e2-9b34f7fb8d30 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:21.037307 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 173/329] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jan 5 14:39:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:21.038277 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444b563-757d-4d8c-85ba-9f7aae54db17 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:21.038688 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 157/330] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:39:21 2022] GET /identity/v3/users/75a904d145ca4accbec823fb3ffab617 => generated 293 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:21.045019 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374e1c7-a887-46ae-a4e2-9b34f7fb8d30 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:21.054175 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444b563-757d-4d8c-85ba-9f7aae54db17 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:21.054992 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374e1c7-a887-46ae-a4e2-9b34f7fb8d30 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:21.059631 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a38c95-f366-4983-825c-ce82cdabc890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:21.060210 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccdee97-85f3-440b-92b9-50c38272f1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:21.060527 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a38c95-f366-4983-825c-ce82cdabc890 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:21.060808 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a38c95-f366-4983-825c-ce82cdabc890 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:21.061087 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdee97-85f3-440b-92b9-50c38272f1c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:21.061208 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a38c95-f366-4983-825c-ce82cdabc890 admin admin] PATH_INFO: `/v3/users/e918037671a94e90b50492f19626341b` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:21.061394 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdee97-85f3-440b-92b9-50c38272f1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:21.061679 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdee97-85f3-440b-92b9-50c38272f1c8 admin admin] PATH_INFO: `/v3/system/users/75a904d145ca4accbec823fb3ffab617/roles/1024abc4fc3948018b1356e4a6671464` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:21.062525 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a38c95-f366-4983-825c-ce82cdabc890 admin admin] RBAC: Authorizing `identity:get_user(user_id=e918037671a94e90b50492f19626341b)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:21.063271 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccdee97-85f3-440b-92b9-50c38272f1c8 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=75a904d145ca4accbec823fb3ffab617, role_id=1024abc4fc3948018b1356e4a6671464)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:21.064846 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a38c95-f366-4983-825c-ce82cdabc890 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:21.064963 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccdee97-85f3-440b-92b9-50c38272f1c8 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:21.066680 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 174/331] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:39:21 2022] GET /identity/v3/users/e918037671a94e90b50492f19626341b => generated 293 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:21.072756 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a38c95-f366-4983-825c-ce82cdabc890 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:21.082934 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a38c95-f366-4983-825c-ce82cdabc890 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:21.087586 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0906b-b5a4-4b03-842b-2aac4c249d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:21.088246 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0906b-b5a4-4b03-842b-2aac4c249d56 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:21.089049 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0906b-b5a4-4b03-842b-2aac4c249d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:21.089357 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0906b-b5a4-4b03-842b-2aac4c249d56 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:21.090204 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0906b-b5a4-4b03-842b-2aac4c249d56 admin admin] RBAC: Adding query filter params (role.id=eaba1e26bf0040868b08b042a7859698, user.id=e918037671a94e90b50492f19626341b, scope.system=all) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:21.090515 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0906b-b5a4-4b03-842b-2aac4c249d56 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:21.092451 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0906b-b5a4-4b03-842b-2aac4c249d56 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:21.108890 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 175/332] 10.222.0.30 () {56 vars in 1329 bytes} [Wed Jan 5 14:39:21 2022] GET /identity/v3/role_assignments?user.id=e918037671a94e90b50492f19626341b&scope.system=all&role.id=eaba1e26bf0040868b08b042a7859698 => generated 510 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:21.140263 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 158/333] 10.222.0.30 () {58 vars in 1355 bytes} [Wed Jan 5 14:39:21 2022] PUT /identity/v3/system/users/75a904d145ca4accbec823fb3ffab617/roles/1024abc4fc3948018b1356e4a6671464 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:39:24.038487 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72732b-526a-4c5f-84ea-827cf7707a85 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:24.039013 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72732b-526a-4c5f-84ea-827cf7707a85 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:24.039314 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72732b-526a-4c5f-84ea-827cf7707a85 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:24.042002 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 176/334] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:24.047511 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b8c1a-8e41-4ed1-91d9-0277b350c8a0 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:24.047967 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b8c1a-8e41-4ed1-91d9-0277b350c8a0 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:24.048174 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b8c1a-8e41-4ed1-91d9-0277b350c8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:24.074150 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-494b8c1a-8e41-4ed1-91d9-0277b350c8a0 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:24.075355 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-494b8c1a-8e41-4ed1-91d9-0277b350c8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:24.083673 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 159/335] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:39:24.118434 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72732b-526a-4c5f-84ea-827cf7707a85 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:24.135333 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72732b-526a-4c5f-84ea-827cf7707a85 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:24.141332 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bed37e-626d-462f-8fa7-53d93fe149d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:24.142152 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bed37e-626d-462f-8fa7-53d93fe149d4 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:24.142441 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bed37e-626d-462f-8fa7-53d93fe149d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:24.142683 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bed37e-626d-462f-8fa7-53d93fe149d4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:24.159433 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bed37e-626d-462f-8fa7-53d93fe149d4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:24.166988 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-b0bed37e-626d-462f-8fa7-53d93fe149d4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 05 14:39:24.168556 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 177/336] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:24.173992 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b8c1a-8e41-4ed1-91d9-0277b350c8a0 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:24.185751 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92421688-c09a-481a-9f60-23a5ef584e18 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:24.186054 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92421688-c09a-481a-9f60-23a5ef584e18 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:24.186288 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92421688-c09a-481a-9f60-23a5ef584e18 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:24.188332 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 178/337] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 14:39:24.190877 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b8c1a-8e41-4ed1-91d9-0277b350c8a0 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:24.193460 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085ca6f-a0b2-4e1a-b4c9-8f30af48ef43 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:24.193736 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085ca6f-a0b2-4e1a-b4c9-8f30af48ef43 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:24.194011 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085ca6f-a0b2-4e1a-b4c9-8f30af48ef43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:24.205398 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b74ab2-ad92-4db4-80ad-af4ecac3f3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:24.206737 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b74ab2-ad92-4db4-80ad-af4ecac3f3ce admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:24.206737 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b74ab2-ad92-4db4-80ad-af4ecac3f3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:24.206737 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b74ab2-ad92-4db4-80ad-af4ecac3f3ce admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:24.207383 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b74ab2-ad92-4db4-80ad-af4ecac3f3ce admin admin] RBAC: Adding query filter params (name=member) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:24.207688 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b74ab2-ad92-4db4-80ad-af4ecac3f3ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:24.209353 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b74ab2-ad92-4db4-80ad-af4ecac3f3ce admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:24.223758 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-3085ca6f-a0b2-4e1a-b4c9-8f30af48ef43 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:24.224964 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-3085ca6f-a0b2-4e1a-b4c9-8f30af48ef43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:24.225165 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 160/338] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jan 5 14:39:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:24.230484 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b74ab2-ad92-4db4-80ad-af4ecac3f3ce admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:24.238649 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 179/339] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:39:24.250145 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b74ab2-ad92-4db4-80ad-af4ecac3f3ce admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:24.257203 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b6f84-43f1-4fc5-900a-ac1bb28023b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:24.257851 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b6f84-43f1-4fc5-900a-ac1bb28023b4 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:24.258136 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b6f84-43f1-4fc5-900a-ac1bb28023b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:24.258414 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b6f84-43f1-4fc5-900a-ac1bb28023b4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:24.279451 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b6f84-43f1-4fc5-900a-ac1bb28023b4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:24.281268 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b6f84-43f1-4fc5-900a-ac1bb28023b4 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:24.283695 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085ca6f-a0b2-4e1a-b4c9-8f30af48ef43 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:24.298742 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 161/340] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:39:24.299015 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085ca6f-a0b2-4e1a-b4c9-8f30af48ef43 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:24.303331 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b6f84-43f1-4fc5-900a-ac1bb28023b4 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:24.308331 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21656d4-164e-4283-80b7-c57b5a048b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:24.309187 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21656d4-164e-4283-80b7-c57b5a048b26 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:24.309464 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21656d4-164e-4283-80b7-c57b5a048b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:24.309731 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21656d4-164e-4283-80b7-c57b5a048b26 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:24.318253 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b6f84-43f1-4fc5-900a-ac1bb28023b4 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:24.332627 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21656d4-164e-4283-80b7-c57b5a048b26 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:24.333690 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac4aa2-1324-49ac-9a16-58268dc4e276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:24.334559 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac4aa2-1324-49ac-9a16-58268dc4e276 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:24.334848 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac4aa2-1324-49ac-9a16-58268dc4e276 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:24.335125 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac4aa2-1324-49ac-9a16-58268dc4e276 admin admin] PATH_INFO: `/v3/projects/c6f6acecb2424b65a947c7f56c378682` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:24.340452 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-c21656d4-164e-4283-80b7-c57b5a048b26 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 05 14:39:24.341827 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac4aa2-1324-49ac-9a16-58268dc4e276 admin admin] RBAC: Authorizing `identity:get_project(project_id=c6f6acecb2424b65a947c7f56c378682)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:24.342016 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 180/341] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Jan 5 14:39:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:39:24.343233 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b0ef1-a954-448c-9722-154a20693099 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:24.343512 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b0ef1-a954-448c-9722-154a20693099 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:24.343785 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b0ef1-a954-448c-9722-154a20693099 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:24.344046 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac4aa2-1324-49ac-9a16-58268dc4e276 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:24.345868 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 181/342] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:24.346115 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 162/343] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:24 2022] GET /identity/v3/projects/c6f6acecb2424b65a947c7f56c378682 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:24.351012 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac4aa2-1324-49ac-9a16-58268dc4e276 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:24.351228 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4539c5-a581-4018-a9ae-3b992fd96fca None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:24.351480 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4539c5-a581-4018-a9ae-3b992fd96fca None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:24.351632 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4539c5-a581-4018-a9ae-3b992fd96fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:24.365994 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac4aa2-1324-49ac-9a16-58268dc4e276 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:24.371656 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-7e4539c5-a581-4018-a9ae-3b992fd96fca None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:24.372819 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-7e4539c5-a581-4018-a9ae-3b992fd96fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:24.376732 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700c362-b11d-4111-8552-886df1f4c123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:24.377615 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700c362-b11d-4111-8552-886df1f4c123 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:24.378151 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700c362-b11d-4111-8552-886df1f4c123 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:24.378431 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700c362-b11d-4111-8552-886df1f4c123 admin admin] PATH_INFO: `/v3/groups/f64f7d45aab34a96ad844fb3daf34bcb` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:24.388169 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700c362-b11d-4111-8552-886df1f4c123 admin admin] RBAC: Authorizing `identity:get_group(group_id=f64f7d45aab34a96ad844fb3daf34bcb)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:24.389243 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING py.warnings [None req-b700c362-b11d-4111-8552-886df1f4c123 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:39:24.389243 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: warnings.warn(msg) Jan 05 14:39:24.389243 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: Jan 05 14:39:24.390432 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700c362-b11d-4111-8552-886df1f4c123 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:24.395398 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 163/344] 10.222.0.30 () {56 vars in 1201 bytes} [Wed Jan 5 14:39:24 2022] GET /identity/v3/groups/f64f7d45aab34a96ad844fb3daf34bcb => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:24.396184 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700c362-b11d-4111-8552-886df1f4c123 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:24.397748 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 182/345] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:24.398571 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4539c5-a581-4018-a9ae-3b992fd96fca None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:24.418792 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4539c5-a581-4018-a9ae-3b992fd96fca None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:24.425447 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700c362-b11d-4111-8552-886df1f4c123 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:24.432457 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c72887-30d0-40d1-99a6-f58f5a7a7c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:24.433136 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c72887-30d0-40d1-99a6-f58f5a7a7c97 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:24.433427 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c72887-30d0-40d1-99a6-f58f5a7a7c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:24.433704 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c72887-30d0-40d1-99a6-f58f5a7a7c97 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:24.434550 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c72887-30d0-40d1-99a6-f58f5a7a7c97 admin admin] RBAC: Adding query filter params (group.id=f64f7d45aab34a96ad844fb3daf34bcb, role.id=eaba1e26bf0040868b08b042a7859698, scope.project.id=c6f6acecb2424b65a947c7f56c378682) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:24.434859 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c72887-30d0-40d1-99a6-f58f5a7a7c97 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:24.436712 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c72887-30d0-40d1-99a6-f58f5a7a7c97 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:24.439619 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1de128-0ab7-45d4-9696-71b913376e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:24.440274 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1de128-0ab7-45d4-9696-71b913376e4d admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:24.440551 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1de128-0ab7-45d4-9696-71b913376e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:24.440824 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1de128-0ab7-45d4-9696-71b913376e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:24.441608 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1de128-0ab7-45d4-9696-71b913376e4d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:24.441909 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1de128-0ab7-45d4-9696-71b913376e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:24.443500 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1de128-0ab7-45d4-9696-71b913376e4d admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:24.455249 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 183/346] 10.222.0.30 () {56 vars in 1397 bytes} [Wed Jan 5 14:39:24 2022] GET /identity/v3/role_assignments?group.id=f64f7d45aab34a96ad844fb3daf34bcb&scope.project.id=c6f6acecb2424b65a947c7f56c378682&role.id=eaba1e26bf0040868b08b042a7859698 => generated 260 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:24.457098 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 164/347] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:39:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:24.466222 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c72887-30d0-40d1-99a6-f58f5a7a7c97 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:24.473850 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1de128-0ab7-45d4-9696-71b913376e4d admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:24.479908 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c72887-30d0-40d1-99a6-f58f5a7a7c97 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:24.485422 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1de128-0ab7-45d4-9696-71b913376e4d admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:24.489091 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd319f24-17e2-4e48-ad7a-ca065934eb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:24.489973 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd319f24-17e2-4e48-ad7a-ca065934eb90 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:24.490343 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd319f24-17e2-4e48-ad7a-ca065934eb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:24.490789 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd319f24-17e2-4e48-ad7a-ca065934eb90 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:24.501667 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffb50c-4ff1-45d8-8396-1b51f8972615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:24.502835 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffb50c-4ff1-45d8-8396-1b51f8972615 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:24.503561 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffb50c-4ff1-45d8-8396-1b51f8972615 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:24.504046 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffb50c-4ff1-45d8-8396-1b51f8972615 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:24.504860 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd319f24-17e2-4e48-ad7a-ca065934eb90 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:24.506817 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd319f24-17e2-4e48-ad7a-ca065934eb90 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:24.522920 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbffb50c-4ff1-45d8-8396-1b51f8972615 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:24.523446 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 184/348] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:39:24.531976 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd319f24-17e2-4e48-ad7a-ca065934eb90 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:24.537238 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-bbffb50c-4ff1-45d8-8396-1b51f8972615 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 05 14:39:24.538687 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 165/349] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:39:24.545390 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd319f24-17e2-4e48-ad7a-ca065934eb90 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:24.545895 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffb50c-4ff1-45d8-8396-1b51f8972615 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:24.550766 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d3f98-c509-4e70-826e-18e229118c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:24.551620 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d3f98-c509-4e70-826e-18e229118c19 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:24.551910 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d3f98-c509-4e70-826e-18e229118c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:24.552201 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d3f98-c509-4e70-826e-18e229118c19 admin admin] PATH_INFO: `/v3/projects/0c3d9801ad754740ae4b7891d05c103f` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:24.553442 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d3f98-c509-4e70-826e-18e229118c19 admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3d9801ad754740ae4b7891d05c103f)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:24.555531 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d3f98-c509-4e70-826e-18e229118c19 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:24.561728 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 185/350] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:24 2022] GET /identity/v3/projects/0c3d9801ad754740ae4b7891d05c103f => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:24.565958 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffb50c-4ff1-45d8-8396-1b51f8972615 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:24.570398 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d3f98-c509-4e70-826e-18e229118c19 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:24.579767 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d3f98-c509-4e70-826e-18e229118c19 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:24.580703 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298af934-1e73-4fe4-93e3-c50f67abd98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:24.581635 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af934-1e73-4fe4-93e3-c50f67abd98c admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:24.582118 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af934-1e73-4fe4-93e3-c50f67abd98c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:24.582586 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af934-1e73-4fe4-93e3-c50f67abd98c admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:24.583577 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298af934-1e73-4fe4-93e3-c50f67abd98c admin admin] RBAC: Adding query filter params (name=member) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:24.584085 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298af934-1e73-4fe4-93e3-c50f67abd98c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:24.584407 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74aafbd-e70f-4f20-896c-1795848ba4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:24.586296 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298af934-1e73-4fe4-93e3-c50f67abd98c admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:24.586827 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74aafbd-e70f-4f20-896c-1795848ba4db admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:24.587124 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74aafbd-e70f-4f20-896c-1795848ba4db admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:24.587411 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74aafbd-e70f-4f20-896c-1795848ba4db admin admin] PATH_INFO: `/v3/groups/f64f7d45aab34a96ad844fb3daf34bcb` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:24.589510 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74aafbd-e70f-4f20-896c-1795848ba4db admin admin] RBAC: Authorizing `identity:get_group(group_id=f64f7d45aab34a96ad844fb3daf34bcb)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:24.590400 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING py.warnings [None req-e74aafbd-e70f-4f20-896c-1795848ba4db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:39:24.590400 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: warnings.warn(msg) Jan 05 14:39:24.590400 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: Jan 05 14:39:24.591592 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74aafbd-e70f-4f20-896c-1795848ba4db admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:24.593298 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 186/351] 10.222.0.30 () {56 vars in 1201 bytes} [Wed Jan 5 14:39:24 2022] GET /identity/v3/groups/f64f7d45aab34a96ad844fb3daf34bcb => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:24.599222 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74aafbd-e70f-4f20-896c-1795848ba4db admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:24.604306 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 166/352] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jan 5 14:39:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:24.609862 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298af934-1e73-4fe4-93e3-c50f67abd98c admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:24.610779 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74aafbd-e70f-4f20-896c-1795848ba4db admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:24.615754 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33cd1e-e329-4f1e-a854-032d9e1fe077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:24.616687 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33cd1e-e329-4f1e-a854-032d9e1fe077 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:24.617170 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33cd1e-e329-4f1e-a854-032d9e1fe077 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:24.617625 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33cd1e-e329-4f1e-a854-032d9e1fe077 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:24.618674 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33cd1e-e329-4f1e-a854-032d9e1fe077 admin admin] RBAC: Adding query filter params (group.id=f64f7d45aab34a96ad844fb3daf34bcb, role.id=78b87341e5464907bcce0d16dca76299, scope.project.id=0c3d9801ad754740ae4b7891d05c103f) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:24.619166 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33cd1e-e329-4f1e-a854-032d9e1fe077 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:24.621002 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298af934-1e73-4fe4-93e3-c50f67abd98c admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:24.621451 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33cd1e-e329-4f1e-a854-032d9e1fe077 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:24.628871 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 187/353] 10.222.0.30 () {56 vars in 1397 bytes} [Wed Jan 5 14:39:24 2022] GET /identity/v3/role_assignments?group.id=f64f7d45aab34a96ad844fb3daf34bcb&scope.project.id=0c3d9801ad754740ae4b7891d05c103f&role.id=78b87341e5464907bcce0d16dca76299 => generated 260 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:24.634555 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efc10d-53fd-496f-8ed2-74a1373922c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:24.635976 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efc10d-53fd-496f-8ed2-74a1373922c5 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:24.636327 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efc10d-53fd-496f-8ed2-74a1373922c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:24.636671 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efc10d-53fd-496f-8ed2-74a1373922c5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:24.650135 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efc10d-53fd-496f-8ed2-74a1373922c5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:24.652982 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efc10d-53fd-496f-8ed2-74a1373922c5 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:24.668144 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 167/354] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 05 14:39:24.673656 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33cd1e-e329-4f1e-a854-032d9e1fe077 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:24.684030 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33cd1e-e329-4f1e-a854-032d9e1fe077 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:24.689048 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd496e1-9efb-4a0f-a415-79a4e094759e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:24.694011 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd496e1-9efb-4a0f-a415-79a4e094759e admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:24.694513 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd496e1-9efb-4a0f-a415-79a4e094759e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:24.694993 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd496e1-9efb-4a0f-a415-79a4e094759e admin admin] PATH_INFO: `/v3/projects/0c3d9801ad754740ae4b7891d05c103f` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:24.696650 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd496e1-9efb-4a0f-a415-79a4e094759e admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3d9801ad754740ae4b7891d05c103f)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:24.699660 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd496e1-9efb-4a0f-a415-79a4e094759e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:24.701796 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 188/355] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:24 2022] GET /identity/v3/projects/0c3d9801ad754740ae4b7891d05c103f => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:24.707854 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efc10d-53fd-496f-8ed2-74a1373922c5 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:24.717964 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efc10d-53fd-496f-8ed2-74a1373922c5 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:24.730347 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf04f18-945a-4951-9384-551ad3f6d5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:24.731216 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf04f18-945a-4951-9384-551ad3f6d5eb admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:24.731497 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf04f18-945a-4951-9384-551ad3f6d5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:24.731774 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf04f18-945a-4951-9384-551ad3f6d5eb admin admin] PATH_INFO: `/v3/groups/f64f7d45aab34a96ad844fb3daf34bcb` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:24.733861 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf04f18-945a-4951-9384-551ad3f6d5eb admin admin] RBAC: Authorizing `identity:get_group(group_id=f64f7d45aab34a96ad844fb3daf34bcb)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:24.736060 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf04f18-945a-4951-9384-551ad3f6d5eb admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:24.737974 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 168/356] 10.222.0.30 () {56 vars in 1201 bytes} [Wed Jan 5 14:39:24 2022] GET /identity/v3/groups/f64f7d45aab34a96ad844fb3daf34bcb => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:24.744286 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd496e1-9efb-4a0f-a415-79a4e094759e admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:24.756218 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd496e1-9efb-4a0f-a415-79a4e094759e admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:24.765329 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1894c-418f-4d88-91b7-97081c60aa3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:24.766317 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1894c-418f-4d88-91b7-97081c60aa3f admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:24.766833 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1894c-418f-4d88-91b7-97081c60aa3f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:24.767337 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1894c-418f-4d88-91b7-97081c60aa3f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:24.768381 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1894c-418f-4d88-91b7-97081c60aa3f admin admin] RBAC: Adding query filter params (group.id=f64f7d45aab34a96ad844fb3daf34bcb, role.id=eaba1e26bf0040868b08b042a7859698, scope.project.id=0c3d9801ad754740ae4b7891d05c103f) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:24.768895 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1894c-418f-4d88-91b7-97081c60aa3f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:24.771017 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1894c-418f-4d88-91b7-97081c60aa3f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:24.781873 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 189/357] 10.222.0.30 () {56 vars in 1397 bytes} [Wed Jan 5 14:39:24 2022] GET /identity/v3/role_assignments?group.id=f64f7d45aab34a96ad844fb3daf34bcb&scope.project.id=0c3d9801ad754740ae4b7891d05c103f&role.id=eaba1e26bf0040868b08b042a7859698 => generated 260 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:24.886654 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ea8f6-42bd-41f9-9e11-18c081145d4c None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:24.887016 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ea8f6-42bd-41f9-9e11-18c081145d4c None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:24.887221 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ea8f6-42bd-41f9-9e11-18c081145d4c None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:24.889421 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 169/358] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:24.896330 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f1e5d-b031-4025-a5bd-a8f81a22b30e None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:24.896671 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f1e5d-b031-4025-a5bd-a8f81a22b30e None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:24.896916 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f1e5d-b031-4025-a5bd-a8f81a22b30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:24.919280 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-547f1e5d-b031-4025-a5bd-a8f81a22b30e None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:24.920546 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-547f1e5d-b031-4025-a5bd-a8f81a22b30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:24.928822 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 190/359] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:39:24.974821 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ea8f6-42bd-41f9-9e11-18c081145d4c None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:24.991615 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ea8f6-42bd-41f9-9e11-18c081145d4c None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:24.996310 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef60e2-be7b-4202-a138-6bdb24a6e513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:24.997161 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef60e2-be7b-4202-a138-6bdb24a6e513 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:24.997449 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef60e2-be7b-4202-a138-6bdb24a6e513 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:24.997726 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef60e2-be7b-4202-a138-6bdb24a6e513 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:25.015962 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef60e2-be7b-4202-a138-6bdb24a6e513 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:25.023507 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-d6ef60e2-be7b-4202-a138-6bdb24a6e513 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 05 14:39:25.025154 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 170/360] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:25.031968 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f1e5d-b031-4025-a5bd-a8f81a22b30e None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:25.041533 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f1e5d-b031-4025-a5bd-a8f81a22b30e None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:25.046178 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87a6e2-928b-4cb6-9040-58e280ccf737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:25.046929 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87a6e2-928b-4cb6-9040-58e280ccf737 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:25.047218 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87a6e2-928b-4cb6-9040-58e280ccf737 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:25.047496 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87a6e2-928b-4cb6-9040-58e280ccf737 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:25.048283 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87a6e2-928b-4cb6-9040-58e280ccf737 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:25.048592 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87a6e2-928b-4cb6-9040-58e280ccf737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:25.052858 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87a6e2-928b-4cb6-9040-58e280ccf737 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:25.063272 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 191/361] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jan 5 14:39:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:25.069884 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef60e2-be7b-4202-a138-6bdb24a6e513 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:25.081395 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef60e2-be7b-4202-a138-6bdb24a6e513 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:25.086021 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc0419-e568-442a-8fb1-032133991799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:25.086908 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc0419-e568-442a-8fb1-032133991799 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:25.087190 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc0419-e568-442a-8fb1-032133991799 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:25.087468 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc0419-e568-442a-8fb1-032133991799 admin admin] PATH_INFO: `/v3/users/75a904d145ca4accbec823fb3ffab617` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:25.089283 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc0419-e568-442a-8fb1-032133991799 admin admin] RBAC: Authorizing `identity:get_user(user_id=75a904d145ca4accbec823fb3ffab617)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:25.091437 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc0419-e568-442a-8fb1-032133991799 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:25.093460 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 171/362] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:39:25 2022] GET /identity/v3/users/75a904d145ca4accbec823fb3ffab617 => generated 293 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:25.099435 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87a6e2-928b-4cb6-9040-58e280ccf737 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:25.109512 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87a6e2-928b-4cb6-9040-58e280ccf737 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:25.113967 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b32c1-200d-42da-9b44-0c52f0d54073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:25.114617 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b32c1-200d-42da-9b44-0c52f0d54073 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:25.114905 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b32c1-200d-42da-9b44-0c52f0d54073 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:25.115187 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b32c1-200d-42da-9b44-0c52f0d54073 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:25.116032 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b32c1-200d-42da-9b44-0c52f0d54073 admin admin] RBAC: Adding query filter params (role.id=1024abc4fc3948018b1356e4a6671464, user.id=75a904d145ca4accbec823fb3ffab617, scope.system=all) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:25.116373 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b32c1-200d-42da-9b44-0c52f0d54073 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:25.118454 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b32c1-200d-42da-9b44-0c52f0d54073 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:25.132165 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 192/363] 10.222.0.30 () {56 vars in 1329 bytes} [Wed Jan 5 14:39:25 2022] GET /identity/v3/role_assignments?user.id=75a904d145ca4accbec823fb3ffab617&scope.system=all&role.id=1024abc4fc3948018b1356e4a6671464 => generated 510 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:25.885968 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec4a2f-2fe3-4e77-a795-bacbd083d411 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:25.886271 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec4a2f-2fe3-4e77-a795-bacbd083d411 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:25.886516 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec4a2f-2fe3-4e77-a795-bacbd083d411 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:25.888511 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 172/364] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:25.894849 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a148e45-0020-4837-94a2-7155cb0ac883 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:25.895133 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a148e45-0020-4837-94a2-7155cb0ac883 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:25.895408 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a148e45-0020-4837-94a2-7155cb0ac883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:25.917246 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-1a148e45-0020-4837-94a2-7155cb0ac883 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:25.918419 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-1a148e45-0020-4837-94a2-7155cb0ac883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:25.932275 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 193/365] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:25.960722 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec4a2f-2fe3-4e77-a795-bacbd083d411 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:25.973966 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec4a2f-2fe3-4e77-a795-bacbd083d411 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:25.981342 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3cce0-209a-47df-bd63-a962deeac11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:25.982313 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3cce0-209a-47df-bd63-a962deeac11c admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:25.982594 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3cce0-209a-47df-bd63-a962deeac11c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:25.982865 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3cce0-209a-47df-bd63-a962deeac11c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:25.997344 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3cce0-209a-47df-bd63-a962deeac11c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:26.004622 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-c9b3cce0-209a-47df-bd63-a962deeac11c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 05 14:39:26.006147 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 173/366] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:39:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:26.014352 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a148e45-0020-4837-94a2-7155cb0ac883 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:26.023286 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a148e45-0020-4837-94a2-7155cb0ac883 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:26.027782 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8a465-af3f-4329-aa2e-d658058a8de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:26.028436 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8a465-af3f-4329-aa2e-d658058a8de5 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:26.028716 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8a465-af3f-4329-aa2e-d658058a8de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:26.028992 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8a465-af3f-4329-aa2e-d658058a8de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:26.029781 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8a465-af3f-4329-aa2e-d658058a8de5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:26.030084 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8a465-af3f-4329-aa2e-d658058a8de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:26.031662 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8a465-af3f-4329-aa2e-d658058a8de5 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:26.048357 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 194/367] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:26.053983 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3cce0-209a-47df-bd63-a962deeac11c admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:26.071441 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3cce0-209a-47df-bd63-a962deeac11c admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:26.076661 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa827751-11ec-4256-8aaf-776701874145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:26.077566 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa827751-11ec-4256-8aaf-776701874145 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:26.078065 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa827751-11ec-4256-8aaf-776701874145 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:26.078562 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa827751-11ec-4256-8aaf-776701874145 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:26.097528 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa827751-11ec-4256-8aaf-776701874145 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:26.099636 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa827751-11ec-4256-8aaf-776701874145 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:26.114664 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 174/368] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:39:26.120896 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8a465-af3f-4329-aa2e-d658058a8de5 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:26.138833 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8a465-af3f-4329-aa2e-d658058a8de5 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:26.149163 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada789c-849c-421c-93f9-21d273a3c978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:26.150031 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada789c-849c-421c-93f9-21d273a3c978 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:26.150310 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada789c-849c-421c-93f9-21d273a3c978 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:26.150588 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada789c-849c-421c-93f9-21d273a3c978 admin admin] PATH_INFO: `/v3/projects/df4f5a399f0847ef9e872ee655a1354c` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:26.155145 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada789c-849c-421c-93f9-21d273a3c978 admin admin] RBAC: Authorizing `identity:get_project(project_id=df4f5a399f0847ef9e872ee655a1354c)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:26.156957 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada789c-849c-421c-93f9-21d273a3c978 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:26.158978 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 195/369] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:26 2022] GET /identity/v3/projects/df4f5a399f0847ef9e872ee655a1354c => generated 344 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:26.164233 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa827751-11ec-4256-8aaf-776701874145 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:26.174062 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa827751-11ec-4256-8aaf-776701874145 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:26.178640 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d37d79-9ac3-4a95-a332-aca6929fbdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:26.179485 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d37d79-9ac3-4a95-a332-aca6929fbdec admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:26.179763 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d37d79-9ac3-4a95-a332-aca6929fbdec admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:26.180034 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d37d79-9ac3-4a95-a332-aca6929fbdec admin admin] PATH_INFO: `/v3/groups/f9b3b1820a054476a444a9cc583e58e0` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:26.190578 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d37d79-9ac3-4a95-a332-aca6929fbdec admin admin] RBAC: Authorizing `identity:get_group(group_id=f9b3b1820a054476a444a9cc583e58e0)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:26.192579 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d37d79-9ac3-4a95-a332-aca6929fbdec admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:26.194389 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 175/370] 10.222.0.30 () {56 vars in 1201 bytes} [Wed Jan 5 14:39:26 2022] GET /identity/v3/groups/f9b3b1820a054476a444a9cc583e58e0 => generated 229 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:26.201867 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada789c-849c-421c-93f9-21d273a3c978 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:26.214206 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada789c-849c-421c-93f9-21d273a3c978 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:26.222538 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f01674-6657-4e21-b940-75b017a78bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:26.223185 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f01674-6657-4e21-b940-75b017a78bef admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:26.223466 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f01674-6657-4e21-b940-75b017a78bef admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:26.223741 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f01674-6657-4e21-b940-75b017a78bef admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:26.224576 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f01674-6657-4e21-b940-75b017a78bef admin admin] RBAC: Adding query filter params (group.id=f9b3b1820a054476a444a9cc583e58e0, role.id=494131614fcf424f92e0817fa7ff6961, scope.project.id=df4f5a399f0847ef9e872ee655a1354c) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:26.224881 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f01674-6657-4e21-b940-75b017a78bef admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:26.226750 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f01674-6657-4e21-b940-75b017a78bef admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:26.237437 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 196/371] 10.222.0.30 () {56 vars in 1397 bytes} [Wed Jan 5 14:39:26 2022] GET /identity/v3/role_assignments?group.id=f9b3b1820a054476a444a9cc583e58e0&scope.project.id=df4f5a399f0847ef9e872ee655a1354c&role.id=494131614fcf424f92e0817fa7ff6961 => generated 260 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:26.361409 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89531875-9821-4cb5-aa70-7c7531897446 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:26.361759 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89531875-9821-4cb5-aa70-7c7531897446 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:26.361970 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89531875-9821-4cb5-aa70-7c7531897446 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:26.364096 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 176/372] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:26.369570 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453eb7ef-6570-420e-a266-3898ef01e141 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:26.369856 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453eb7ef-6570-420e-a266-3898ef01e141 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:26.370134 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453eb7ef-6570-420e-a266-3898ef01e141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:26.400537 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-453eb7ef-6570-420e-a266-3898ef01e141 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:26.402276 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-453eb7ef-6570-420e-a266-3898ef01e141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:26.411386 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 197/373] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:39:26.451742 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89531875-9821-4cb5-aa70-7c7531897446 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:26.470825 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89531875-9821-4cb5-aa70-7c7531897446 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:26.477106 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fc6d4-439a-4357-a4ac-1b74b98e7606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:26.477938 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fc6d4-439a-4357-a4ac-1b74b98e7606 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:26.478216 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fc6d4-439a-4357-a4ac-1b74b98e7606 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:26.478488 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fc6d4-439a-4357-a4ac-1b74b98e7606 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:26.498421 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267fc6d4-439a-4357-a4ac-1b74b98e7606 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:26.506158 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-267fc6d4-439a-4357-a4ac-1b74b98e7606 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 05 14:39:26.507685 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 177/374] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Jan 5 14:39:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:26.514120 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453eb7ef-6570-420e-a266-3898ef01e141 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:26.526852 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453eb7ef-6570-420e-a266-3898ef01e141 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:26.537879 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10743a65-ff91-4508-80af-c2e3b7db9db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:26.538561 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10743a65-ff91-4508-80af-c2e3b7db9db1 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:26.538892 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10743a65-ff91-4508-80af-c2e3b7db9db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:26.539167 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10743a65-ff91-4508-80af-c2e3b7db9db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:26.539932 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10743a65-ff91-4508-80af-c2e3b7db9db1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:26.540234 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10743a65-ff91-4508-80af-c2e3b7db9db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:26.542175 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10743a65-ff91-4508-80af-c2e3b7db9db1 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:26.558017 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 198/375] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:39:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:26.563510 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fc6d4-439a-4357-a4ac-1b74b98e7606 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:26.577887 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fc6d4-439a-4357-a4ac-1b74b98e7606 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:26.585459 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33909b4-49d5-4b5f-abfd-f8ced84d0cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:26.586095 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33909b4-49d5-4b5f-abfd-f8ced84d0cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:26.586372 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33909b4-49d5-4b5f-abfd-f8ced84d0cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:26.586641 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33909b4-49d5-4b5f-abfd-f8ced84d0cc1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:26.601173 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33909b4-49d5-4b5f-abfd-f8ced84d0cc1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:26.602960 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33909b4-49d5-4b5f-abfd-f8ced84d0cc1 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:26.618874 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 178/376] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:39:26.624276 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10743a65-ff91-4508-80af-c2e3b7db9db1 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:26.638525 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10743a65-ff91-4508-80af-c2e3b7db9db1 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:26.645797 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8448e-fc62-4d0a-a8cc-0ec6f05b440f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:26.646706 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8448e-fc62-4d0a-a8cc-0ec6f05b440f admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:26.646982 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8448e-fc62-4d0a-a8cc-0ec6f05b440f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:26.647253 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8448e-fc62-4d0a-a8cc-0ec6f05b440f admin admin] PATH_INFO: `/v3/projects/c6f6acecb2424b65a947c7f56c378682` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:26.653882 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8448e-fc62-4d0a-a8cc-0ec6f05b440f admin admin] RBAC: Authorizing `identity:get_project(project_id=c6f6acecb2424b65a947c7f56c378682)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:26.656008 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8448e-fc62-4d0a-a8cc-0ec6f05b440f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:26.657757 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 199/377] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:26 2022] GET /identity/v3/projects/c6f6acecb2424b65a947c7f56c378682 => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:26.663217 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33909b4-49d5-4b5f-abfd-f8ced84d0cc1 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:26.678065 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33909b4-49d5-4b5f-abfd-f8ced84d0cc1 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:26.685102 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a03d0f-e6ce-4397-9d8f-07e5f116c90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:26.685950 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a03d0f-e6ce-4397-9d8f-07e5f116c90a admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:26.686225 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a03d0f-e6ce-4397-9d8f-07e5f116c90a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:26.686500 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a03d0f-e6ce-4397-9d8f-07e5f116c90a admin admin] PATH_INFO: `/v3/groups/f64f7d45aab34a96ad844fb3daf34bcb` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:26.692896 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a03d0f-e6ce-4397-9d8f-07e5f116c90a admin admin] RBAC: Authorizing `identity:get_group(group_id=f64f7d45aab34a96ad844fb3daf34bcb)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:26.694848 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a03d0f-e6ce-4397-9d8f-07e5f116c90a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:26.696762 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 179/378] 10.222.0.30 () {56 vars in 1201 bytes} [Wed Jan 5 14:39:26 2022] GET /identity/v3/groups/f64f7d45aab34a96ad844fb3daf34bcb => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:26.702909 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8448e-fc62-4d0a-a8cc-0ec6f05b440f admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:26.716085 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8448e-fc62-4d0a-a8cc-0ec6f05b440f admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:26.723175 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c40d5c-f870-483e-bce3-916b1f1b38e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:26.723865 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c40d5c-f870-483e-bce3-916b1f1b38e5 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:26.724145 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c40d5c-f870-483e-bce3-916b1f1b38e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:26.724473 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c40d5c-f870-483e-bce3-916b1f1b38e5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:26.725348 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c40d5c-f870-483e-bce3-916b1f1b38e5 admin admin] RBAC: Adding query filter params (group.id=f64f7d45aab34a96ad844fb3daf34bcb, role.id=78b87341e5464907bcce0d16dca76299, scope.project.id=c6f6acecb2424b65a947c7f56c378682) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:26.725711 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c40d5c-f870-483e-bce3-916b1f1b38e5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:26.727625 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c40d5c-f870-483e-bce3-916b1f1b38e5 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:26.737266 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 200/379] 10.222.0.30 () {56 vars in 1397 bytes} [Wed Jan 5 14:39:26 2022] GET /identity/v3/role_assignments?group.id=f64f7d45aab34a96ad844fb3daf34bcb&scope.project.id=c6f6acecb2424b65a947c7f56c378682&role.id=78b87341e5464907bcce0d16dca76299 => generated 260 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:27.811710 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f3c4c-5256-49f2-92d1-6e399a4f8e47 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:27.812372 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f3c4c-5256-49f2-92d1-6e399a4f8e47 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:27.812372 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f3c4c-5256-49f2-92d1-6e399a4f8e47 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:27.814235 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 180/380] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:27.819518 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac71ac0-d9ea-498a-9e81-efa24968dcc5 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:27.820000 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac71ac0-d9ea-498a-9e81-efa24968dcc5 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:27.820159 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac71ac0-d9ea-498a-9e81-efa24968dcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:27.838862 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-1ac71ac0-d9ea-498a-9e81-efa24968dcc5 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:27.840095 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-1ac71ac0-d9ea-498a-9e81-efa24968dcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:27.857434 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 201/381] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:39:27.902883 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f3c4c-5256-49f2-92d1-6e399a4f8e47 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:27.915726 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f3c4c-5256-49f2-92d1-6e399a4f8e47 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:27.924598 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84cefc-911e-4829-8798-6df1b7e4e343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:27.925711 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84cefc-911e-4829-8798-6df1b7e4e343 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:27.926225 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84cefc-911e-4829-8798-6df1b7e4e343 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:27.926668 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84cefc-911e-4829-8798-6df1b7e4e343 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:27.942274 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c84cefc-911e-4829-8798-6df1b7e4e343 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:27.954454 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-6c84cefc-911e-4829-8798-6df1b7e4e343 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 05 14:39:27.955976 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 181/382] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:27.962328 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac71ac0-d9ea-498a-9e81-efa24968dcc5 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:27.972671 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac71ac0-d9ea-498a-9e81-efa24968dcc5 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:27.977404 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781667c6-2dc1-48d6-a65f-d61bdb4935e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:27.978268 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781667c6-2dc1-48d6-a65f-d61bdb4935e7 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:27.978797 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781667c6-2dc1-48d6-a65f-d61bdb4935e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:27.979270 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781667c6-2dc1-48d6-a65f-d61bdb4935e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:27.981261 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051ecf3-e525-4fe7-8c3b-58bc2582aef9 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:27.981727 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051ecf3-e525-4fe7-8c3b-58bc2582aef9 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:27.981963 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781667c6-2dc1-48d6-a65f-d61bdb4935e7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:27.982355 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781667c6-2dc1-48d6-a65f-d61bdb4935e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:27.982542 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051ecf3-e525-4fe7-8c3b-58bc2582aef9 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:27.984154 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781667c6-2dc1-48d6-a65f-d61bdb4935e7 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:27.984651 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 182/383] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 14:39:27.989845 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198d72d-8532-4be3-8796-929d8cb087db None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:27.990323 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198d72d-8532-4be3-8796-929d8cb087db None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:27.990797 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198d72d-8532-4be3-8796-929d8cb087db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:27.993790 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 202/384] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jan 5 14:39:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:28.010979 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781667c6-2dc1-48d6-a65f-d61bdb4935e7 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:28.016504 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-4198d72d-8532-4be3-8796-929d8cb087db None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:28.023053 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-4198d72d-8532-4be3-8796-929d8cb087db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:28.032606 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781667c6-2dc1-48d6-a65f-d61bdb4935e7 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:28.038940 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 183/385] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:39:28.040740 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0462075-58d5-4de3-8411-66b9dea2c09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:28.042452 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0462075-58d5-4de3-8411-66b9dea2c09c admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:28.042907 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0462075-58d5-4de3-8411-66b9dea2c09c admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:28.043418 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0462075-58d5-4de3-8411-66b9dea2c09c admin admin] PATH_INFO: `/v3/groups/f64f7d45aab34a96ad844fb3daf34bcb` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:28.044839 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0462075-58d5-4de3-8411-66b9dea2c09c admin admin] RBAC: Authorizing `identity:get_group(group_id=f64f7d45aab34a96ad844fb3daf34bcb)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:28.046999 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0462075-58d5-4de3-8411-66b9dea2c09c admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:28.049114 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 203/386] 10.222.0.30 () {56 vars in 1201 bytes} [Wed Jan 5 14:39:28 2022] GET /identity/v3/groups/f64f7d45aab34a96ad844fb3daf34bcb => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:28.054589 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198d72d-8532-4be3-8796-929d8cb087db None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:28.067249 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198d72d-8532-4be3-8796-929d8cb087db None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:28.072327 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94267057-5db7-489e-afa7-153ac69dba0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:28.073578 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94267057-5db7-489e-afa7-153ac69dba0c admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:28.074034 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94267057-5db7-489e-afa7-153ac69dba0c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:28.074478 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94267057-5db7-489e-afa7-153ac69dba0c admin admin] PATH_INFO: `/v3/projects/c6f6acecb2424b65a947c7f56c378682` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:28.076085 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94267057-5db7-489e-afa7-153ac69dba0c admin admin] RBAC: Authorizing `identity:get_project(project_id=c6f6acecb2424b65a947c7f56c378682)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:28.080437 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94267057-5db7-489e-afa7-153ac69dba0c admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:28.082655 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 184/387] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:28 2022] GET /identity/v3/projects/c6f6acecb2424b65a947c7f56c378682 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:28.089206 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0462075-58d5-4de3-8411-66b9dea2c09c admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:28.098036 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94267057-5db7-489e-afa7-153ac69dba0c admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:28.102525 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0462075-58d5-4de3-8411-66b9dea2c09c admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:28.111458 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de983a75-662d-4c82-863f-1641076e357f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:28.113133 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de983a75-662d-4c82-863f-1641076e357f admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:28.114635 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de983a75-662d-4c82-863f-1641076e357f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:28.115118 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de983a75-662d-4c82-863f-1641076e357f admin admin] PATH_INFO: `/v3/projects/c6f6acecb2424b65a947c7f56c378682/groups/f64f7d45aab34a96ad844fb3daf34bcb/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:28.120243 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de983a75-662d-4c82-863f-1641076e357f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6f6acecb2424b65a947c7f56c378682, group_id=f64f7d45aab34a96ad844fb3daf34bcb, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:28.123658 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94267057-5db7-489e-afa7-153ac69dba0c admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:28.125735 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de983a75-662d-4c82-863f-1641076e357f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:28.131836 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e58943-70a2-4d19-86d7-3f54062ee883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:28.134195 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e58943-70a2-4d19-86d7-3f54062ee883 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:28.135700 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e58943-70a2-4d19-86d7-3f54062ee883 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:28.136195 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e58943-70a2-4d19-86d7-3f54062ee883 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:28.148554 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e58943-70a2-4d19-86d7-3f54062ee883 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:28.156284 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-45e58943-70a2-4d19-86d7-3f54062ee883 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 05 14:39:28.158073 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 185/388] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:28.163384 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e58943-70a2-4d19-86d7-3f54062ee883 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:28.175469 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e58943-70a2-4d19-86d7-3f54062ee883 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:28.180211 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bace5-9b12-4d41-97d9-45c8c3fd9add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:28.181113 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bace5-9b12-4d41-97d9-45c8c3fd9add admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:28.181588 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bace5-9b12-4d41-97d9-45c8c3fd9add admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:28.182126 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bace5-9b12-4d41-97d9-45c8c3fd9add admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:28.183048 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965bace5-9b12-4d41-97d9-45c8c3fd9add admin admin] RBAC: Adding query filter params (name=member) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:28.183582 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965bace5-9b12-4d41-97d9-45c8c3fd9add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:28.185556 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965bace5-9b12-4d41-97d9-45c8c3fd9add admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:28.194900 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 186/389] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jan 5 14:39:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:28.201553 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bace5-9b12-4d41-97d9-45c8c3fd9add admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:28.211808 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bace5-9b12-4d41-97d9-45c8c3fd9add admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:28.222476 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 204/390] 10.222.0.30 () {58 vars in 1463 bytes} [Wed Jan 5 14:39:28 2022] PUT /identity/v3/projects/c6f6acecb2424b65a947c7f56c378682/groups/f64f7d45aab34a96ad844fb3daf34bcb/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:39:28.224837 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56f265-969a-4aaa-bc25-b023d7227054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:28.225197 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56f265-969a-4aaa-bc25-b023d7227054 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:28.225672 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56f265-969a-4aaa-bc25-b023d7227054 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:28.226162 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56f265-969a-4aaa-bc25-b023d7227054 admin admin] PATH_INFO: `/v3/groups/f64f7d45aab34a96ad844fb3daf34bcb` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:28.227623 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56f265-969a-4aaa-bc25-b023d7227054 admin admin] RBAC: Authorizing `identity:get_group(group_id=f64f7d45aab34a96ad844fb3daf34bcb)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:28.234484 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56f265-969a-4aaa-bc25-b023d7227054 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:28.237638 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 187/391] 10.222.0.30 () {56 vars in 1201 bytes} [Wed Jan 5 14:39:28 2022] GET /identity/v3/groups/f64f7d45aab34a96ad844fb3daf34bcb => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:28.242610 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de983a75-662d-4c82-863f-1641076e357f admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:28.317058 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de983a75-662d-4c82-863f-1641076e357f admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:28.321907 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac37593-bf75-4ec7-ab13-d907edfae919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:28.323535 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac37593-bf75-4ec7-ab13-d907edfae919 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:28.324024 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac37593-bf75-4ec7-ab13-d907edfae919 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:28.324471 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac37593-bf75-4ec7-ab13-d907edfae919 admin admin] PATH_INFO: `/v3/projects/0c3d9801ad754740ae4b7891d05c103f` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:28.325996 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac37593-bf75-4ec7-ab13-d907edfae919 admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3d9801ad754740ae4b7891d05c103f)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:28.328343 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac37593-bf75-4ec7-ab13-d907edfae919 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:28.333343 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 205/392] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:28 2022] GET /identity/v3/projects/0c3d9801ad754740ae4b7891d05c103f => generated 298 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:28.340366 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56f265-969a-4aaa-bc25-b023d7227054 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:28.350490 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56f265-969a-4aaa-bc25-b023d7227054 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:28.359615 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c95172-d75f-442c-be3d-0f08b97ccef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:28.360563 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c95172-d75f-442c-be3d-0f08b97ccef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:28.360898 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c95172-d75f-442c-be3d-0f08b97ccef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:28.361268 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c95172-d75f-442c-be3d-0f08b97ccef5 admin admin] PATH_INFO: `/v3/projects/0c3d9801ad754740ae4b7891d05c103f/groups/f64f7d45aab34a96ad844fb3daf34bcb/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:28.364823 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c95172-d75f-442c-be3d-0f08b97ccef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c3d9801ad754740ae4b7891d05c103f, group_id=f64f7d45aab34a96ad844fb3daf34bcb, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:28.367662 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c95172-d75f-442c-be3d-0f08b97ccef5 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:28.459844 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 188/393] 10.222.0.30 () {58 vars in 1463 bytes} [Wed Jan 5 14:39:28 2022] PUT /identity/v3/projects/0c3d9801ad754740ae4b7891d05c103f/groups/f64f7d45aab34a96ad844fb3daf34bcb/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:39:28.594300 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740daea9-d6c6-4e38-bc1b-5ab2b777ae17 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:28.594941 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740daea9-d6c6-4e38-bc1b-5ab2b777ae17 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:28.595452 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740daea9-d6c6-4e38-bc1b-5ab2b777ae17 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:28.597805 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 206/394] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:28.605169 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324e15b-3bbb-4196-8e33-e9676aae85f9 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:28.605820 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324e15b-3bbb-4196-8e33-e9676aae85f9 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:28.606293 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324e15b-3bbb-4196-8e33-e9676aae85f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:28.626223 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-b324e15b-3bbb-4196-8e33-e9676aae85f9 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:28.628019 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-b324e15b-3bbb-4196-8e33-e9676aae85f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:28.692670 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 189/395] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:28.717984 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740daea9-d6c6-4e38-bc1b-5ab2b777ae17 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:28.731503 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740daea9-d6c6-4e38-bc1b-5ab2b777ae17 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:28.736362 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693957dc-c5f2-48ce-9f77-ce529dee1994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:28.737492 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693957dc-c5f2-48ce-9f77-ce529dee1994 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:28.737998 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693957dc-c5f2-48ce-9f77-ce529dee1994 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:28.738472 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693957dc-c5f2-48ce-9f77-ce529dee1994 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:28.750733 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693957dc-c5f2-48ce-9f77-ce529dee1994 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:28.759109 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-693957dc-c5f2-48ce-9f77-ce529dee1994 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 05 14:39:28.761041 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 207/396] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Jan 5 14:39:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:28.767032 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324e15b-3bbb-4196-8e33-e9676aae85f9 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:28.777111 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324e15b-3bbb-4196-8e33-e9676aae85f9 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:28.781849 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7488c3a-033b-49fd-98af-d70aac99c47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:28.782770 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7488c3a-033b-49fd-98af-d70aac99c47b admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:28.783296 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7488c3a-033b-49fd-98af-d70aac99c47b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:28.783783 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7488c3a-033b-49fd-98af-d70aac99c47b admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:28.784816 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7488c3a-033b-49fd-98af-d70aac99c47b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:28.785441 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7488c3a-033b-49fd-98af-d70aac99c47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:28.787314 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7488c3a-033b-49fd-98af-d70aac99c47b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:28.798875 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 190/397] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:39:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:28.804984 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693957dc-c5f2-48ce-9f77-ce529dee1994 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:28.818413 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693957dc-c5f2-48ce-9f77-ce529dee1994 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:28.823479 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e8d25-f3bd-48b1-aa5b-0118489eff10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:28.825039 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e8d25-f3bd-48b1-aa5b-0118489eff10 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:28.825554 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e8d25-f3bd-48b1-aa5b-0118489eff10 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:28.826115 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e8d25-f3bd-48b1-aa5b-0118489eff10 admin admin] PATH_INFO: `/v3/groups/f64f7d45aab34a96ad844fb3daf34bcb` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:28.827510 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e8d25-f3bd-48b1-aa5b-0118489eff10 admin admin] RBAC: Authorizing `identity:get_group(group_id=f64f7d45aab34a96ad844fb3daf34bcb)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:28.829901 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e8d25-f3bd-48b1-aa5b-0118489eff10 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:28.831684 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 208/398] 10.222.0.30 () {56 vars in 1201 bytes} [Wed Jan 5 14:39:28 2022] GET /identity/v3/groups/f64f7d45aab34a96ad844fb3daf34bcb => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:28.837510 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7488c3a-033b-49fd-98af-d70aac99c47b admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:28.849048 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7488c3a-033b-49fd-98af-d70aac99c47b admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:28.854012 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c3cca-8f0b-4e6f-bf97-1a7d639cd762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:28.855168 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c3cca-8f0b-4e6f-bf97-1a7d639cd762 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:28.855756 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c3cca-8f0b-4e6f-bf97-1a7d639cd762 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:28.856224 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c3cca-8f0b-4e6f-bf97-1a7d639cd762 admin admin] PATH_INFO: `/v3/projects/0c3d9801ad754740ae4b7891d05c103f` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:28.857729 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c3cca-8f0b-4e6f-bf97-1a7d639cd762 admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3d9801ad754740ae4b7891d05c103f)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:28.860068 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c3cca-8f0b-4e6f-bf97-1a7d639cd762 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:28.862057 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 191/399] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:28 2022] GET /identity/v3/projects/0c3d9801ad754740ae4b7891d05c103f => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:28.868005 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e8d25-f3bd-48b1-aa5b-0118489eff10 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:28.883708 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e8d25-f3bd-48b1-aa5b-0118489eff10 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:28.888341 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bdaf3-54f9-409b-afea-ec7c6c272853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:28.889258 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bdaf3-54f9-409b-afea-ec7c6c272853 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:28.889534 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bdaf3-54f9-409b-afea-ec7c6c272853 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:28.889799 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bdaf3-54f9-409b-afea-ec7c6c272853 admin admin] PATH_INFO: `/v3/projects/0c3d9801ad754740ae4b7891d05c103f/groups/f64f7d45aab34a96ad844fb3daf34bcb/roles/78b87341e5464907bcce0d16dca76299` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:28.892049 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bdaf3-54f9-409b-afea-ec7c6c272853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c3d9801ad754740ae4b7891d05c103f, group_id=f64f7d45aab34a96ad844fb3daf34bcb, role_id=78b87341e5464907bcce0d16dca76299)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:28.894719 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bdaf3-54f9-409b-afea-ec7c6c272853 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:29.013917 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 209/400] 10.222.0.30 () {58 vars in 1463 bytes} [Wed Jan 5 14:39:28 2022] PUT /identity/v3/projects/0c3d9801ad754740ae4b7891d05c103f/groups/f64f7d45aab34a96ad844fb3daf34bcb/roles/78b87341e5464907bcce0d16dca76299 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:39:29.202272 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9490d-e3f4-4a7c-8d21-d2be665fd896 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:29.202779 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9490d-e3f4-4a7c-8d21-d2be665fd896 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:29.203118 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9490d-e3f4-4a7c-8d21-d2be665fd896 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:29.205258 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 192/401] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:29.210938 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc54f83-095b-4c48-8be7-bd844ec47eff None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:29.211229 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc54f83-095b-4c48-8be7-bd844ec47eff None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:29.211508 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc54f83-095b-4c48-8be7-bd844ec47eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:29.230186 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-abc54f83-095b-4c48-8be7-bd844ec47eff None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:29.231376 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-abc54f83-095b-4c48-8be7-bd844ec47eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:29.293845 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 210/402] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:29.320631 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9490d-e3f4-4a7c-8d21-d2be665fd896 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:29.337751 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9490d-e3f4-4a7c-8d21-d2be665fd896 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:29.343357 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102f034-5c0c-464c-ac50-ba450615634a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:29.344159 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102f034-5c0c-464c-ac50-ba450615634a admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:29.344445 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102f034-5c0c-464c-ac50-ba450615634a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:29.344776 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102f034-5c0c-464c-ac50-ba450615634a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:29.360902 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102f034-5c0c-464c-ac50-ba450615634a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:29.368545 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-1102f034-5c0c-464c-ac50-ba450615634a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 05 14:39:29.373203 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 193/403] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:39:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:29.376292 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc54f83-095b-4c48-8be7-bd844ec47eff None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:29.386198 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc54f83-095b-4c48-8be7-bd844ec47eff None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:29.392234 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7810f3-357b-49bd-9810-4b779521115d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:29.392976 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7810f3-357b-49bd-9810-4b779521115d admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:29.393287 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7810f3-357b-49bd-9810-4b779521115d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:29.393564 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7810f3-357b-49bd-9810-4b779521115d admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:29.394346 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7810f3-357b-49bd-9810-4b779521115d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:29.394654 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7810f3-357b-49bd-9810-4b779521115d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:29.396351 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7810f3-357b-49bd-9810-4b779521115d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:29.408892 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 211/404] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:29.412717 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102f034-5c0c-464c-ac50-ba450615634a admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:29.430939 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102f034-5c0c-464c-ac50-ba450615634a admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:29.436197 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b94541-91f7-45d5-b24b-4832fd95c305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:29.437122 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b94541-91f7-45d5-b24b-4832fd95c305 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:29.437418 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b94541-91f7-45d5-b24b-4832fd95c305 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:29.437692 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b94541-91f7-45d5-b24b-4832fd95c305 admin admin] PATH_INFO: `/v3/groups/f9b3b1820a054476a444a9cc583e58e0` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:29.438887 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b94541-91f7-45d5-b24b-4832fd95c305 admin admin] RBAC: Authorizing `identity:get_group(group_id=f9b3b1820a054476a444a9cc583e58e0)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:29.440982 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b94541-91f7-45d5-b24b-4832fd95c305 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:29.443596 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 194/405] 10.222.0.30 () {56 vars in 1201 bytes} [Wed Jan 5 14:39:29 2022] GET /identity/v3/groups/f9b3b1820a054476a444a9cc583e58e0 => generated 229 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:29.449310 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7810f3-357b-49bd-9810-4b779521115d admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:29.459822 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7810f3-357b-49bd-9810-4b779521115d admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:29.465020 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70324d1-d1ea-4c95-baa0-f35c1356f9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:29.465979 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70324d1-d1ea-4c95-baa0-f35c1356f9fe admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:29.466275 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70324d1-d1ea-4c95-baa0-f35c1356f9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:29.466552 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70324d1-d1ea-4c95-baa0-f35c1356f9fe admin admin] PATH_INFO: `/v3/projects/df4f5a399f0847ef9e872ee655a1354c` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:29.467800 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70324d1-d1ea-4c95-baa0-f35c1356f9fe admin admin] RBAC: Authorizing `identity:get_project(project_id=df4f5a399f0847ef9e872ee655a1354c)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:29.469763 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70324d1-d1ea-4c95-baa0-f35c1356f9fe admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:29.471478 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 212/406] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:29 2022] GET /identity/v3/projects/df4f5a399f0847ef9e872ee655a1354c => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:29.477640 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b94541-91f7-45d5-b24b-4832fd95c305 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:29.488472 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b94541-91f7-45d5-b24b-4832fd95c305 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:29.493310 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e5c40-8d5c-4cae-9512-52514b92dde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:29.494265 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e5c40-8d5c-4cae-9512-52514b92dde1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:29.494598 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e5c40-8d5c-4cae-9512-52514b92dde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:29.494873 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e5c40-8d5c-4cae-9512-52514b92dde1 admin admin] PATH_INFO: `/v3/projects/df4f5a399f0847ef9e872ee655a1354c/groups/f9b3b1820a054476a444a9cc583e58e0/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:29.496982 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e5c40-8d5c-4cae-9512-52514b92dde1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df4f5a399f0847ef9e872ee655a1354c, group_id=f9b3b1820a054476a444a9cc583e58e0, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:29.499886 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e5c40-8d5c-4cae-9512-52514b92dde1 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:29.582507 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 195/407] 10.222.0.30 () {58 vars in 1463 bytes} [Wed Jan 5 14:39:29 2022] PUT /identity/v3/projects/df4f5a399f0847ef9e872ee655a1354c/groups/f9b3b1820a054476a444a9cc583e58e0/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:39:30.115192 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50edef8-da79-47fd-af6d-f70176610b22 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:30.115703 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50edef8-da79-47fd-af6d-f70176610b22 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:30.115776 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50edef8-da79-47fd-af6d-f70176610b22 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:30.117830 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 213/408] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:30.123607 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7f16d-74d1-49f3-9003-b0bcdd5ed936 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:30.124038 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7f16d-74d1-49f3-9003-b0bcdd5ed936 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:30.124233 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7f16d-74d1-49f3-9003-b0bcdd5ed936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:30.144184 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-62c7f16d-74d1-49f3-9003-b0bcdd5ed936 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:30.145397 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-62c7f16d-74d1-49f3-9003-b0bcdd5ed936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:30.218034 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 196/409] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:30.257932 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50edef8-da79-47fd-af6d-f70176610b22 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:30.279955 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50edef8-da79-47fd-af6d-f70176610b22 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:30.288633 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243d4ea-9217-4772-9079-dff54e975473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:30.289527 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243d4ea-9217-4772-9079-dff54e975473 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:30.289808 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243d4ea-9217-4772-9079-dff54e975473 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:30.290137 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243d4ea-9217-4772-9079-dff54e975473 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:30.313439 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243d4ea-9217-4772-9079-dff54e975473 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:30.321204 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-9243d4ea-9217-4772-9079-dff54e975473 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 05 14:39:30.322711 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 214/410] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Jan 5 14:39:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:30.328348 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7f16d-74d1-49f3-9003-b0bcdd5ed936 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:30.340928 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7f16d-74d1-49f3-9003-b0bcdd5ed936 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:30.345646 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd843046-19e9-4b18-8912-081e58dcbd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:30.346526 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd843046-19e9-4b18-8912-081e58dcbd6f admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:30.347000 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd843046-19e9-4b18-8912-081e58dcbd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:30.347465 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd843046-19e9-4b18-8912-081e58dcbd6f admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:30.348423 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd843046-19e9-4b18-8912-081e58dcbd6f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:30.348933 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd843046-19e9-4b18-8912-081e58dcbd6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:30.350735 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd843046-19e9-4b18-8912-081e58dcbd6f admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:30.364416 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 197/411] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:39:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:30.370774 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243d4ea-9217-4772-9079-dff54e975473 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:30.391537 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243d4ea-9217-4772-9079-dff54e975473 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:30.395596 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be34a1-5c01-4ee1-91a8-2350937dfff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:30.396459 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be34a1-5c01-4ee1-91a8-2350937dfff3 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:30.396794 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be34a1-5c01-4ee1-91a8-2350937dfff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:30.397094 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be34a1-5c01-4ee1-91a8-2350937dfff3 admin admin] PATH_INFO: `/v3/groups/f64f7d45aab34a96ad844fb3daf34bcb` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:30.401018 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be34a1-5c01-4ee1-91a8-2350937dfff3 admin admin] RBAC: Authorizing `identity:get_group(group_id=f64f7d45aab34a96ad844fb3daf34bcb)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:30.403045 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be34a1-5c01-4ee1-91a8-2350937dfff3 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:30.404693 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 215/412] 10.222.0.30 () {56 vars in 1201 bytes} [Wed Jan 5 14:39:30 2022] GET /identity/v3/groups/f64f7d45aab34a96ad844fb3daf34bcb => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:30.410332 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd843046-19e9-4b18-8912-081e58dcbd6f admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:30.421573 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd843046-19e9-4b18-8912-081e58dcbd6f admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:30.426259 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69045eb5-6ff7-4836-8dc0-b04fb2070a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:30.427321 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69045eb5-6ff7-4836-8dc0-b04fb2070a25 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:30.427793 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69045eb5-6ff7-4836-8dc0-b04fb2070a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:30.428286 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69045eb5-6ff7-4836-8dc0-b04fb2070a25 admin admin] PATH_INFO: `/v3/projects/c6f6acecb2424b65a947c7f56c378682` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:30.429700 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69045eb5-6ff7-4836-8dc0-b04fb2070a25 admin admin] RBAC: Authorizing `identity:get_project(project_id=c6f6acecb2424b65a947c7f56c378682)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:30.432495 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69045eb5-6ff7-4836-8dc0-b04fb2070a25 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:30.434418 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 198/413] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:30 2022] GET /identity/v3/projects/c6f6acecb2424b65a947c7f56c378682 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:30.440227 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be34a1-5c01-4ee1-91a8-2350937dfff3 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:30.454060 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be34a1-5c01-4ee1-91a8-2350937dfff3 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:30.459767 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f700e3-a145-4d10-ace5-0fc108d6fb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:30.460698 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f700e3-a145-4d10-ace5-0fc108d6fb14 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:30.460981 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f700e3-a145-4d10-ace5-0fc108d6fb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:30.461277 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f700e3-a145-4d10-ace5-0fc108d6fb14 admin admin] PATH_INFO: `/v3/projects/c6f6acecb2424b65a947c7f56c378682/groups/f64f7d45aab34a96ad844fb3daf34bcb/roles/78b87341e5464907bcce0d16dca76299` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:30.465401 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f700e3-a145-4d10-ace5-0fc108d6fb14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6f6acecb2424b65a947c7f56c378682, group_id=f64f7d45aab34a96ad844fb3daf34bcb, role_id=78b87341e5464907bcce0d16dca76299)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:30.468197 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f700e3-a145-4d10-ace5-0fc108d6fb14 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:30.594481 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 216/414] 10.222.0.30 () {58 vars in 1463 bytes} [Wed Jan 5 14:39:30 2022] PUT /identity/v3/projects/c6f6acecb2424b65a947c7f56c378682/groups/f64f7d45aab34a96ad844fb3daf34bcb/roles/78b87341e5464907bcce0d16dca76299 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:39:31.388701 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf62e8-623e-4031-a1e1-70e6f00ebbbc None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:31.389236 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf62e8-623e-4031-a1e1-70e6f00ebbbc None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:31.389309 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf62e8-623e-4031-a1e1-70e6f00ebbbc None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:31.391296 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 199/415] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:31.396697 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fe7ee-ac15-49af-b758-0b353b295319 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:31.397147 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fe7ee-ac15-49af-b758-0b353b295319 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:31.397329 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fe7ee-ac15-49af-b758-0b353b295319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:31.420295 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-5b0fe7ee-ac15-49af-b758-0b353b295319 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:31.421843 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-5b0fe7ee-ac15-49af-b758-0b353b295319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:31.491754 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 217/416] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:39:31.531558 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf62e8-623e-4031-a1e1-70e6f00ebbbc None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:31.548115 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf62e8-623e-4031-a1e1-70e6f00ebbbc None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:31.557205 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2c839-5991-40d4-9d36-1ff733c40f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:31.557993 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2c839-5991-40d4-9d36-1ff733c40f3c admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:31.558275 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2c839-5991-40d4-9d36-1ff733c40f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:31.558545 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2c839-5991-40d4-9d36-1ff733c40f3c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:31.578347 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2c839-5991-40d4-9d36-1ff733c40f3c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:31.585465 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-ecf2c839-5991-40d4-9d36-1ff733c40f3c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 05 14:39:31.586958 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 200/417] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:31.592976 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fe7ee-ac15-49af-b758-0b353b295319 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:31.606279 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fe7ee-ac15-49af-b758-0b353b295319 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:31.611985 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba042a0e-fc1c-4ac0-a0c6-bf1b52a253bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:31.612912 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba042a0e-fc1c-4ac0-a0c6-bf1b52a253bf admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:31.613409 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba042a0e-fc1c-4ac0-a0c6-bf1b52a253bf admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:31.613887 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba042a0e-fc1c-4ac0-a0c6-bf1b52a253bf admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:31.614840 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba042a0e-fc1c-4ac0-a0c6-bf1b52a253bf admin admin] RBAC: Adding query filter params (name=member) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:31.615345 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba042a0e-fc1c-4ac0-a0c6-bf1b52a253bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:31.617167 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba042a0e-fc1c-4ac0-a0c6-bf1b52a253bf admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:31.632716 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 218/418] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jan 5 14:39:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:31.638169 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2c839-5991-40d4-9d36-1ff733c40f3c admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:31.648558 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2c839-5991-40d4-9d36-1ff733c40f3c admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:31.657191 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd6631-50e7-495e-93eb-5f1e0639d26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:31.657822 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd6631-50e7-495e-93eb-5f1e0639d26b admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:31.658105 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd6631-50e7-495e-93eb-5f1e0639d26b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:31.658376 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd6631-50e7-495e-93eb-5f1e0639d26b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:31.673175 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd6631-50e7-495e-93eb-5f1e0639d26b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:31.674935 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd6631-50e7-495e-93eb-5f1e0639d26b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:31.688132 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 201/419] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:39:31.693991 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba042a0e-fc1c-4ac0-a0c6-bf1b52a253bf admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:31.710236 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba042a0e-fc1c-4ac0-a0c6-bf1b52a253bf admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:31.720650 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567ba0b-af59-412c-bf50-a30741d67d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:31.721858 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567ba0b-af59-412c-bf50-a30741d67d3a admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:31.722336 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567ba0b-af59-412c-bf50-a30741d67d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:31.722819 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567ba0b-af59-412c-bf50-a30741d67d3a admin admin] PATH_INFO: `/v3/projects/0c3d9801ad754740ae4b7891d05c103f` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:31.724241 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567ba0b-af59-412c-bf50-a30741d67d3a admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3d9801ad754740ae4b7891d05c103f)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:31.726694 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567ba0b-af59-412c-bf50-a30741d67d3a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:31.728580 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 219/420] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:31 2022] GET /identity/v3/projects/0c3d9801ad754740ae4b7891d05c103f => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:31.734721 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd6631-50e7-495e-93eb-5f1e0639d26b admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:31.743845 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd6631-50e7-495e-93eb-5f1e0639d26b admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:31.753282 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4efdc-26f8-462d-8c67-1889c4258f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:31.754127 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4efdc-26f8-462d-8c67-1889c4258f76 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:31.754407 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4efdc-26f8-462d-8c67-1889c4258f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:31.754679 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4efdc-26f8-462d-8c67-1889c4258f76 admin admin] PATH_INFO: `/v3/groups/f64f7d45aab34a96ad844fb3daf34bcb` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:31.761849 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4efdc-26f8-462d-8c67-1889c4258f76 admin admin] RBAC: Authorizing `identity:get_group(group_id=f64f7d45aab34a96ad844fb3daf34bcb)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:31.763758 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4efdc-26f8-462d-8c67-1889c4258f76 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:31.765369 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 202/421] 10.222.0.30 () {56 vars in 1201 bytes} [Wed Jan 5 14:39:31 2022] GET /identity/v3/groups/f64f7d45aab34a96ad844fb3daf34bcb => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:31.771246 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567ba0b-af59-412c-bf50-a30741d67d3a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:31.782768 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567ba0b-af59-412c-bf50-a30741d67d3a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:31.788942 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca66dc3-3c7d-4fc1-86b0-576151112456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:31.789881 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca66dc3-3c7d-4fc1-86b0-576151112456 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:31.790082 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3ef03-f999-4f87-a7db-02537fa37bdf None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:31.790361 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3ef03-f999-4f87-a7db-02537fa37bdf None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:31.790636 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3ef03-f999-4f87-a7db-02537fa37bdf None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:31.791089 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca66dc3-3c7d-4fc1-86b0-576151112456 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:31.791585 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca66dc3-3c7d-4fc1-86b0-576151112456 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:31.792696 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca66dc3-3c7d-4fc1-86b0-576151112456 admin admin] RBAC: Adding query filter params (group.id=f64f7d45aab34a96ad844fb3daf34bcb, role.id=eaba1e26bf0040868b08b042a7859698, scope.project.id=0c3d9801ad754740ae4b7891d05c103f) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:31.792811 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 203/422] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 14:39:31.793380 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca66dc3-3c7d-4fc1-86b0-576151112456 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:31.795573 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca66dc3-3c7d-4fc1-86b0-576151112456 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:31.797525 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839ee67-6397-483a-b24f-9659c1ffd60b None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:31.797809 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839ee67-6397-483a-b24f-9659c1ffd60b None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:31.798082 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839ee67-6397-483a-b24f-9659c1ffd60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:31.804721 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 220/423] 10.222.0.30 () {56 vars in 1397 bytes} [Wed Jan 5 14:39:31 2022] GET /identity/v3/role_assignments?group.id=f64f7d45aab34a96ad844fb3daf34bcb&scope.project.id=0c3d9801ad754740ae4b7891d05c103f&role.id=eaba1e26bf0040868b08b042a7859698 => generated 611 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:31.826205 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-7839ee67-6397-483a-b24f-9659c1ffd60b None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:31.827740 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-7839ee67-6397-483a-b24f-9659c1ffd60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:31.837643 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 204/424] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:39:31.888872 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca66dc3-3c7d-4fc1-86b0-576151112456 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:31.902642 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca66dc3-3c7d-4fc1-86b0-576151112456 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:31.913273 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43881971-2a09-40c7-8659-8e506cebe4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:31.914093 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43881971-2a09-40c7-8659-8e506cebe4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:31.914375 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43881971-2a09-40c7-8659-8e506cebe4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:31.914657 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43881971-2a09-40c7-8659-8e506cebe4b4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:31.933333 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43881971-2a09-40c7-8659-8e506cebe4b4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:31.940709 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-43881971-2a09-40c7-8659-8e506cebe4b4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 05 14:39:31.942363 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 221/425] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:31.948909 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839ee67-6397-483a-b24f-9659c1ffd60b None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:31.962471 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839ee67-6397-483a-b24f-9659c1ffd60b None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:31.967659 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ef7a7-978d-44a3-9f82-8fed9f100f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:31.968350 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ef7a7-978d-44a3-9f82-8fed9f100f60 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:31.968630 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ef7a7-978d-44a3-9f82-8fed9f100f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:31.968903 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ef7a7-978d-44a3-9f82-8fed9f100f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:31.970146 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ef7a7-978d-44a3-9f82-8fed9f100f60 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:31.970450 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ef7a7-978d-44a3-9f82-8fed9f100f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:31.981811 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ef7a7-978d-44a3-9f82-8fed9f100f60 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:31.999195 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 205/426] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jan 5 14:39:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:32.006649 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43881971-2a09-40c7-8659-8e506cebe4b4 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:32.022720 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43881971-2a09-40c7-8659-8e506cebe4b4 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:32.033261 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88df9e-8258-4fd3-a99d-c9aa4a24e380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:32.033924 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88df9e-8258-4fd3-a99d-c9aa4a24e380 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:32.034204 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88df9e-8258-4fd3-a99d-c9aa4a24e380 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:32.034476 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88df9e-8258-4fd3-a99d-c9aa4a24e380 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:32.049705 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88df9e-8258-4fd3-a99d-c9aa4a24e380 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:32.051494 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88df9e-8258-4fd3-a99d-c9aa4a24e380 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:32.068315 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 222/427] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:39:32.074819 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ef7a7-978d-44a3-9f82-8fed9f100f60 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:32.086681 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ef7a7-978d-44a3-9f82-8fed9f100f60 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:32.097708 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85467947-602c-4824-92e8-30ce0f927a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:32.098842 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85467947-602c-4824-92e8-30ce0f927a7d admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:32.099346 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85467947-602c-4824-92e8-30ce0f927a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:32.099836 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85467947-602c-4824-92e8-30ce0f927a7d admin admin] PATH_INFO: `/v3/projects/c6f6acecb2424b65a947c7f56c378682` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:32.101282 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85467947-602c-4824-92e8-30ce0f927a7d admin admin] RBAC: Authorizing `identity:get_project(project_id=c6f6acecb2424b65a947c7f56c378682)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:32.104088 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85467947-602c-4824-92e8-30ce0f927a7d admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:32.106958 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 206/428] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:32 2022] GET /identity/v3/projects/c6f6acecb2424b65a947c7f56c378682 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:32.111372 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88df9e-8258-4fd3-a99d-c9aa4a24e380 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:32.122749 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88df9e-8258-4fd3-a99d-c9aa4a24e380 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:32.127254 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe3e7e-29c1-4213-9a89-a1128ff6b3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:32.128353 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe3e7e-29c1-4213-9a89-a1128ff6b3bf admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:32.128633 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe3e7e-29c1-4213-9a89-a1128ff6b3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:32.128905 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe3e7e-29c1-4213-9a89-a1128ff6b3bf admin admin] PATH_INFO: `/v3/groups/f64f7d45aab34a96ad844fb3daf34bcb` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:32.132060 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe3e7e-29c1-4213-9a89-a1128ff6b3bf admin admin] RBAC: Authorizing `identity:get_group(group_id=f64f7d45aab34a96ad844fb3daf34bcb)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:32.133999 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe3e7e-29c1-4213-9a89-a1128ff6b3bf admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:32.136180 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 223/429] 10.222.0.30 () {56 vars in 1201 bytes} [Wed Jan 5 14:39:32 2022] GET /identity/v3/groups/f64f7d45aab34a96ad844fb3daf34bcb => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:32.141983 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85467947-602c-4824-92e8-30ce0f927a7d admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:32.158235 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85467947-602c-4824-92e8-30ce0f927a7d admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:32.167261 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821938d-7833-4d3d-a419-8d35834c5c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:32.167917 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821938d-7833-4d3d-a419-8d35834c5c63 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:32.168292 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821938d-7833-4d3d-a419-8d35834c5c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:32.168574 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821938d-7833-4d3d-a419-8d35834c5c63 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:32.169558 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821938d-7833-4d3d-a419-8d35834c5c63 admin admin] RBAC: Adding query filter params (group.id=f64f7d45aab34a96ad844fb3daf34bcb, role.id=eaba1e26bf0040868b08b042a7859698, scope.project.id=c6f6acecb2424b65a947c7f56c378682) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:32.169921 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821938d-7833-4d3d-a419-8d35834c5c63 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:32.171859 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821938d-7833-4d3d-a419-8d35834c5c63 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:32.178817 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 207/430] 10.222.0.30 () {56 vars in 1397 bytes} [Wed Jan 5 14:39:32 2022] GET /identity/v3/role_assignments?group.id=f64f7d45aab34a96ad844fb3daf34bcb&scope.project.id=c6f6acecb2424b65a947c7f56c378682&role.id=eaba1e26bf0040868b08b042a7859698 => generated 611 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:32.386789 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477f972-05e2-4420-9735-6a5ff6727b41 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:32.387069 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477f972-05e2-4420-9735-6a5ff6727b41 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:32.387461 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477f972-05e2-4420-9735-6a5ff6727b41 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:32.389424 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 224/431] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:32.395833 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ef91b-5d75-4ca9-99b9-418c50e761fe None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:32.396328 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ef91b-5d75-4ca9-99b9-418c50e761fe None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:32.396401 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ef91b-5d75-4ca9-99b9-418c50e761fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:32.417376 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-386ef91b-5d75-4ca9-99b9-418c50e761fe None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:32.418506 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-386ef91b-5d75-4ca9-99b9-418c50e761fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:32.429831 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 208/432] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:32.456376 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477f972-05e2-4420-9735-6a5ff6727b41 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:32.474691 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477f972-05e2-4420-9735-6a5ff6727b41 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:32.480651 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa2ef6-c393-47ee-bfe6-46fff9b19e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:32.481658 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa2ef6-c393-47ee-bfe6-46fff9b19e43 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:32.481938 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa2ef6-c393-47ee-bfe6-46fff9b19e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:32.482216 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa2ef6-c393-47ee-bfe6-46fff9b19e43 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:32.500964 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa2ef6-c393-47ee-bfe6-46fff9b19e43 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:32.509179 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-51fa2ef6-c393-47ee-bfe6-46fff9b19e43 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 05 14:39:32.511556 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 225/433] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Jan 5 14:39:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:32.516554 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ef91b-5d75-4ca9-99b9-418c50e761fe None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:32.527682 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ef91b-5d75-4ca9-99b9-418c50e761fe None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:32.536279 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24240254-073c-4cfe-af0a-50be50777965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:32.536964 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24240254-073c-4cfe-af0a-50be50777965 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:32.537257 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24240254-073c-4cfe-af0a-50be50777965 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:32.537528 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24240254-073c-4cfe-af0a-50be50777965 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:32.538289 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24240254-073c-4cfe-af0a-50be50777965 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:32.538591 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24240254-073c-4cfe-af0a-50be50777965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:32.540183 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24240254-073c-4cfe-af0a-50be50777965 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:32.554020 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 209/434] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:39:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:32.560418 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa2ef6-c393-47ee-bfe6-46fff9b19e43 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:32.572896 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa2ef6-c393-47ee-bfe6-46fff9b19e43 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:32.578901 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115caff-707d-4162-af84-633d415b8693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:32.579824 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115caff-707d-4162-af84-633d415b8693 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:32.580332 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115caff-707d-4162-af84-633d415b8693 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:32.580815 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115caff-707d-4162-af84-633d415b8693 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:32.591819 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115caff-707d-4162-af84-633d415b8693 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:32.594032 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115caff-707d-4162-af84-633d415b8693 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:32.603886 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 226/435] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:39:32.609685 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24240254-073c-4cfe-af0a-50be50777965 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:32.620414 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24240254-073c-4cfe-af0a-50be50777965 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:32.625229 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db5be0-2b11-49ee-8b84-f58404e0f91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:32.626329 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db5be0-2b11-49ee-8b84-f58404e0f91e admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:32.626830 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db5be0-2b11-49ee-8b84-f58404e0f91e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:32.627302 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db5be0-2b11-49ee-8b84-f58404e0f91e admin admin] PATH_INFO: `/v3/projects/0c3d9801ad754740ae4b7891d05c103f` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:32.629005 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db5be0-2b11-49ee-8b84-f58404e0f91e admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3d9801ad754740ae4b7891d05c103f)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:32.631352 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db5be0-2b11-49ee-8b84-f58404e0f91e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:32.633576 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 210/436] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:32 2022] GET /identity/v3/projects/0c3d9801ad754740ae4b7891d05c103f => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:32.639280 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115caff-707d-4162-af84-633d415b8693 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:32.648581 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115caff-707d-4162-af84-633d415b8693 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:32.653858 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788fc3c-17a4-4ac6-aea8-834fc53b43ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:32.654918 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788fc3c-17a4-4ac6-aea8-834fc53b43ef admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:32.655390 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788fc3c-17a4-4ac6-aea8-834fc53b43ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:32.655879 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788fc3c-17a4-4ac6-aea8-834fc53b43ef admin admin] PATH_INFO: `/v3/groups/f64f7d45aab34a96ad844fb3daf34bcb` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:32.657276 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788fc3c-17a4-4ac6-aea8-834fc53b43ef admin admin] RBAC: Authorizing `identity:get_group(group_id=f64f7d45aab34a96ad844fb3daf34bcb)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:32.662534 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788fc3c-17a4-4ac6-aea8-834fc53b43ef admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:32.665096 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 227/437] 10.222.0.30 () {56 vars in 1201 bytes} [Wed Jan 5 14:39:32 2022] GET /identity/v3/groups/f64f7d45aab34a96ad844fb3daf34bcb => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:32.668806 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db5be0-2b11-49ee-8b84-f58404e0f91e admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:32.679522 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db5be0-2b11-49ee-8b84-f58404e0f91e admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:32.684069 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c51cd-09b4-4206-b9ad-10b7f72d25f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:32.684721 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c51cd-09b4-4206-b9ad-10b7f72d25f7 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:32.685017 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c51cd-09b4-4206-b9ad-10b7f72d25f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:32.685374 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c51cd-09b4-4206-b9ad-10b7f72d25f7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:32.686221 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c51cd-09b4-4206-b9ad-10b7f72d25f7 admin admin] RBAC: Adding query filter params (group.id=f64f7d45aab34a96ad844fb3daf34bcb, role.id=78b87341e5464907bcce0d16dca76299, scope.project.id=0c3d9801ad754740ae4b7891d05c103f) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:32.686532 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c51cd-09b4-4206-b9ad-10b7f72d25f7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:32.688395 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c51cd-09b4-4206-b9ad-10b7f72d25f7 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:32.695030 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 211/438] 10.222.0.30 () {56 vars in 1397 bytes} [Wed Jan 5 14:39:32 2022] GET /identity/v3/role_assignments?group.id=f64f7d45aab34a96ad844fb3daf34bcb&scope.project.id=0c3d9801ad754740ae4b7891d05c103f&role.id=78b87341e5464907bcce0d16dca76299 => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:32.930322 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f6cf6-1edb-4f53-b44b-4d1f3a5efa1a None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:32.930520 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f6cf6-1edb-4f53-b44b-4d1f3a5efa1a None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:32.930780 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f6cf6-1edb-4f53-b44b-4d1f3a5efa1a None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:32.932731 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 228/439] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:32.937686 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de634f56-29b2-48a2-893c-e56c59a28446 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:32.937975 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de634f56-29b2-48a2-893c-e56c59a28446 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:32.938251 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de634f56-29b2-48a2-893c-e56c59a28446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:32.957164 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-de634f56-29b2-48a2-893c-e56c59a28446 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:32.958330 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-de634f56-29b2-48a2-893c-e56c59a28446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:32.967827 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 212/440] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:32.992469 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f6cf6-1edb-4f53-b44b-4d1f3a5efa1a None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:33.004853 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f6cf6-1edb-4f53-b44b-4d1f3a5efa1a None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:33.009120 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfa2b8-620a-452a-a215-f8afd40d9d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:33.010434 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfa2b8-620a-452a-a215-f8afd40d9d93 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:33.010711 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfa2b8-620a-452a-a215-f8afd40d9d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:33.013169 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfa2b8-620a-452a-a215-f8afd40d9d93 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:33.023009 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfa2b8-620a-452a-a215-f8afd40d9d93 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:33.030799 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-08bfa2b8-620a-452a-a215-f8afd40d9d93 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 05 14:39:33.032362 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 229/441] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:39:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:33.037991 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de634f56-29b2-48a2-893c-e56c59a28446 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:33.047150 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de634f56-29b2-48a2-893c-e56c59a28446 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:33.051541 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3b1ea-188c-46f4-a73b-2fcfe3c15ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:33.052199 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3b1ea-188c-46f4-a73b-2fcfe3c15ecc admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:33.052476 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3b1ea-188c-46f4-a73b-2fcfe3c15ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:33.052745 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3b1ea-188c-46f4-a73b-2fcfe3c15ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:33.053538 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3b1ea-188c-46f4-a73b-2fcfe3c15ecc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:33.053840 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3b1ea-188c-46f4-a73b-2fcfe3c15ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:33.055433 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3b1ea-188c-46f4-a73b-2fcfe3c15ecc admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:33.064325 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 213/442] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:33.069723 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfa2b8-620a-452a-a215-f8afd40d9d93 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:33.079872 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfa2b8-620a-452a-a215-f8afd40d9d93 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:33.085205 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bea73-cd48-4802-abd4-74f832507132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:33.085833 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bea73-cd48-4802-abd4-74f832507132 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:33.086112 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bea73-cd48-4802-abd4-74f832507132 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:33.086382 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bea73-cd48-4802-abd4-74f832507132 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:33.096220 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569bea73-cd48-4802-abd4-74f832507132 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:33.098098 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569bea73-cd48-4802-abd4-74f832507132 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:33.108916 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 230/443] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:39:33.113295 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3b1ea-188c-46f4-a73b-2fcfe3c15ecc admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:33.124686 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3b1ea-188c-46f4-a73b-2fcfe3c15ecc admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:33.129596 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66110c8-ecd8-4221-8e15-e97e8b73f663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:33.130534 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66110c8-ecd8-4221-8e15-e97e8b73f663 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:33.130820 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66110c8-ecd8-4221-8e15-e97e8b73f663 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:33.131100 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66110c8-ecd8-4221-8e15-e97e8b73f663 admin admin] PATH_INFO: `/v3/projects/df4f5a399f0847ef9e872ee655a1354c` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:33.132299 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66110c8-ecd8-4221-8e15-e97e8b73f663 admin admin] RBAC: Authorizing `identity:get_project(project_id=df4f5a399f0847ef9e872ee655a1354c)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:33.134163 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66110c8-ecd8-4221-8e15-e97e8b73f663 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:33.136589 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 214/444] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:33 2022] GET /identity/v3/projects/df4f5a399f0847ef9e872ee655a1354c => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:33.141848 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bea73-cd48-4802-abd4-74f832507132 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:33.150825 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bea73-cd48-4802-abd4-74f832507132 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:33.155382 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6e9f7-251b-4e51-b787-411f3f81413d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:33.156224 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6e9f7-251b-4e51-b787-411f3f81413d admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:33.156502 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6e9f7-251b-4e51-b787-411f3f81413d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:33.156776 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6e9f7-251b-4e51-b787-411f3f81413d admin admin] PATH_INFO: `/v3/groups/f9b3b1820a054476a444a9cc583e58e0` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:33.158074 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d6e9f7-251b-4e51-b787-411f3f81413d admin admin] RBAC: Authorizing `identity:get_group(group_id=f9b3b1820a054476a444a9cc583e58e0)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:33.159970 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d6e9f7-251b-4e51-b787-411f3f81413d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:33.161765 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 231/445] 10.222.0.30 () {56 vars in 1201 bytes} [Wed Jan 5 14:39:33 2022] GET /identity/v3/groups/f9b3b1820a054476a444a9cc583e58e0 => generated 229 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:33.167316 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66110c8-ecd8-4221-8e15-e97e8b73f663 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:33.179115 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66110c8-ecd8-4221-8e15-e97e8b73f663 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:33.184043 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b55148-7e13-4010-9b18-aa9b23e4a7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:33.184626 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b55148-7e13-4010-9b18-aa9b23e4a7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:33.184906 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b55148-7e13-4010-9b18-aa9b23e4a7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:33.185232 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b55148-7e13-4010-9b18-aa9b23e4a7b3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:33.186074 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b55148-7e13-4010-9b18-aa9b23e4a7b3 admin admin] RBAC: Adding query filter params (group.id=f9b3b1820a054476a444a9cc583e58e0, role.id=494131614fcf424f92e0817fa7ff6961, scope.project.id=df4f5a399f0847ef9e872ee655a1354c) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:33.186388 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b55148-7e13-4010-9b18-aa9b23e4a7b3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:33.188228 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b55148-7e13-4010-9b18-aa9b23e4a7b3 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:33.194373 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 215/446] 10.222.0.30 () {56 vars in 1397 bytes} [Wed Jan 5 14:39:33 2022] GET /identity/v3/role_assignments?group.id=f9b3b1820a054476a444a9cc583e58e0&scope.project.id=df4f5a399f0847ef9e872ee655a1354c&role.id=494131614fcf424f92e0817fa7ff6961 => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:33.774989 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f61a2d-3708-4e2d-b95b-76824b0606c3 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:33.775538 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f61a2d-3708-4e2d-b95b-76824b0606c3 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:33.775538 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f61a2d-3708-4e2d-b95b-76824b0606c3 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:33.777316 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 232/447] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:33.782437 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa2869-6c18-49cc-942b-80a08e3ac65f None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:33.782862 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa2869-6c18-49cc-942b-80a08e3ac65f None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:33.782995 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa2869-6c18-49cc-942b-80a08e3ac65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:33.800586 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-07fa2869-6c18-49cc-942b-80a08e3ac65f None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:33.801849 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-07fa2869-6c18-49cc-942b-80a08e3ac65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:33.809707 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 216/448] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:39:33.833492 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f61a2d-3708-4e2d-b95b-76824b0606c3 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:33.845592 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f61a2d-3708-4e2d-b95b-76824b0606c3 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:33.849710 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbbb20-f468-47ff-b7d1-d83aa65f647e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:33.850475 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbbb20-f468-47ff-b7d1-d83aa65f647e admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:33.850754 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbbb20-f468-47ff-b7d1-d83aa65f647e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:33.851024 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbbb20-f468-47ff-b7d1-d83aa65f647e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:33.861278 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbbb20-f468-47ff-b7d1-d83aa65f647e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:33.868661 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-84bbbb20-f468-47ff-b7d1-d83aa65f647e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 05 14:39:33.869785 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 233/449] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Jan 5 14:39:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:33.874924 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa2869-6c18-49cc-942b-80a08e3ac65f None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:33.883762 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa2869-6c18-49cc-942b-80a08e3ac65f None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:33.888056 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053a7e8-2ceb-45cf-8333-4d2e5ac0b99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:33.888690 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053a7e8-2ceb-45cf-8333-4d2e5ac0b99a admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:33.888971 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053a7e8-2ceb-45cf-8333-4d2e5ac0b99a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:33.889282 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053a7e8-2ceb-45cf-8333-4d2e5ac0b99a admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:33.890033 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053a7e8-2ceb-45cf-8333-4d2e5ac0b99a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:33.890339 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053a7e8-2ceb-45cf-8333-4d2e5ac0b99a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:33.891942 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053a7e8-2ceb-45cf-8333-4d2e5ac0b99a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:33.899659 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 217/450] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:39:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:33.905094 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbbb20-f468-47ff-b7d1-d83aa65f647e admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:33.914127 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbbb20-f468-47ff-b7d1-d83aa65f647e admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:33.918420 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d66cd1-7ac6-4394-ac39-ab9f555e3c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:33.919007 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d66cd1-7ac6-4394-ac39-ab9f555e3c24 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:33.919283 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d66cd1-7ac6-4394-ac39-ab9f555e3c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:33.919552 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d66cd1-7ac6-4394-ac39-ab9f555e3c24 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:33.927391 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d66cd1-7ac6-4394-ac39-ab9f555e3c24 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:33.929125 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d66cd1-7ac6-4394-ac39-ab9f555e3c24 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:33.937940 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 234/451] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:39:33.942890 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053a7e8-2ceb-45cf-8333-4d2e5ac0b99a admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:33.952723 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053a7e8-2ceb-45cf-8333-4d2e5ac0b99a admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:33.957158 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c17fb-96f6-47e9-aea4-10a0a58a82a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:33.957981 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c17fb-96f6-47e9-aea4-10a0a58a82a7 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:33.958268 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c17fb-96f6-47e9-aea4-10a0a58a82a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:33.958545 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c17fb-96f6-47e9-aea4-10a0a58a82a7 admin admin] PATH_INFO: `/v3/projects/c6f6acecb2424b65a947c7f56c378682` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:33.959720 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c17fb-96f6-47e9-aea4-10a0a58a82a7 admin admin] RBAC: Authorizing `identity:get_project(project_id=c6f6acecb2424b65a947c7f56c378682)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:33.961854 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c17fb-96f6-47e9-aea4-10a0a58a82a7 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:33.963474 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 218/452] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:39:33 2022] GET /identity/v3/projects/c6f6acecb2424b65a947c7f56c378682 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:33.968183 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d66cd1-7ac6-4394-ac39-ab9f555e3c24 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:33.976385 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d66cd1-7ac6-4394-ac39-ab9f555e3c24 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:33.980602 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183c047-27cc-4582-8e75-1f76620d1bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:33.981422 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183c047-27cc-4582-8e75-1f76620d1bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:33.981703 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183c047-27cc-4582-8e75-1f76620d1bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:33.981975 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183c047-27cc-4582-8e75-1f76620d1bf9 admin admin] PATH_INFO: `/v3/groups/f64f7d45aab34a96ad844fb3daf34bcb` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:33.983121 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4183c047-27cc-4582-8e75-1f76620d1bf9 admin admin] RBAC: Authorizing `identity:get_group(group_id=f64f7d45aab34a96ad844fb3daf34bcb)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:33.984932 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4183c047-27cc-4582-8e75-1f76620d1bf9 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:33.986460 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 235/453] 10.222.0.30 () {56 vars in 1201 bytes} [Wed Jan 5 14:39:33 2022] GET /identity/v3/groups/f64f7d45aab34a96ad844fb3daf34bcb => generated 226 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:33.991591 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c17fb-96f6-47e9-aea4-10a0a58a82a7 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:34.001428 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c17fb-96f6-47e9-aea4-10a0a58a82a7 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:34.006039 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042e201-18b8-4e41-898b-be374cb0bf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:34.006640 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042e201-18b8-4e41-898b-be374cb0bf33 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:34.006923 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042e201-18b8-4e41-898b-be374cb0bf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:34.007200 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042e201-18b8-4e41-898b-be374cb0bf33 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:34.008015 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042e201-18b8-4e41-898b-be374cb0bf33 admin admin] RBAC: Adding query filter params (group.id=f64f7d45aab34a96ad844fb3daf34bcb, role.id=78b87341e5464907bcce0d16dca76299, scope.project.id=c6f6acecb2424b65a947c7f56c378682) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:34.008327 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042e201-18b8-4e41-898b-be374cb0bf33 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:34.010246 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042e201-18b8-4e41-898b-be374cb0bf33 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:34.015848 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 219/454] 10.222.0.30 () {56 vars in 1397 bytes} [Wed Jan 5 14:39:33 2022] GET /identity/v3/role_assignments?group.id=f64f7d45aab34a96ad844fb3daf34bcb&scope.project.id=c6f6acecb2424b65a947c7f56c378682&role.id=78b87341e5464907bcce0d16dca76299 => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:37.290456 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36aa157-56b6-4d8c-94ee-59955b47864c None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:37.291501 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36aa157-56b6-4d8c-94ee-59955b47864c None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:37.291501 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36aa157-56b6-4d8c-94ee-59955b47864c None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:37.293646 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 236/455] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:37.298986 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602ddec-d649-44ed-ac2a-0c99e06f3160 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:37.299821 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602ddec-d649-44ed-ac2a-0c99e06f3160 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:37.300298 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602ddec-d649-44ed-ac2a-0c99e06f3160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:37.325817 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-b602ddec-d649-44ed-ac2a-0c99e06f3160 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:37.327358 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-b602ddec-d649-44ed-ac2a-0c99e06f3160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:37.341375 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e692ad1-d962-43d8-b2a6-d8fac7d8aa67 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:37.341667 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 220/456] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:37.342212 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e692ad1-d962-43d8-b2a6-d8fac7d8aa67 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:37.342800 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e692ad1-d962-43d8-b2a6-d8fac7d8aa67 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:37.345956 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 237/457] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 14:39:37.350317 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5d339-7f8f-45c6-ad75-62df543ec3e3 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:37.350606 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5d339-7f8f-45c6-ad75-62df543ec3e3 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:37.350883 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5d339-7f8f-45c6-ad75-62df543ec3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:37.378831 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-dcf5d339-7f8f-45c6-ad75-62df543ec3e3 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:37.380029 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-dcf5d339-7f8f-45c6-ad75-62df543ec3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:37.387871 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 221/458] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:37.397158 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fd6fc-e8ba-45be-9456-8af758dd67a9 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:37.397744 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fd6fc-e8ba-45be-9456-8af758dd67a9 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:37.398287 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fd6fc-e8ba-45be-9456-8af758dd67a9 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:37.399257 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5d339-7f8f-45c6-ad75-62df543ec3e3 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:37.400562 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 238/459] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:37.405530 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae2803-b07d-426f-b395-abd6f038e25e None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:37.406047 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae2803-b07d-426f-b395-abd6f038e25e None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:37.406526 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae2803-b07d-426f-b395-abd6f038e25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:37.409298 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5d339-7f8f-45c6-ad75-62df543ec3e3 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:37.413885 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefd1af-efd9-4069-a050-491800db255b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:37.414674 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefd1af-efd9-4069-a050-491800db255b admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:37.414960 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefd1af-efd9-4069-a050-491800db255b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:37.415235 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefd1af-efd9-4069-a050-491800db255b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:37.427863 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aefd1af-efd9-4069-a050-491800db255b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:37.430095 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aefd1af-efd9-4069-a050-491800db255b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:37.436456 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-7fae2803-b07d-426f-b395-abd6f038e25e None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:37.437930 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-7fae2803-b07d-426f-b395-abd6f038e25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:37.448927 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-8aefd1af-efd9-4069-a050-491800db255b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:37.450611 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 222/460] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:39:37.451391 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefd1af-efd9-4069-a050-491800db255b admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:37.452095 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 239/461] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:39:37.457264 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae2803-b07d-426f-b395-abd6f038e25e None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:37.462879 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefd1af-efd9-4069-a050-491800db255b admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:37.467381 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373c4c6-6693-40ce-9d5e-18d7e258521d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:37.467737 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae2803-b07d-426f-b395-abd6f038e25e None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:37.468162 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373c4c6-6693-40ce-9d5e-18d7e258521d admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:37.468444 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373c4c6-6693-40ce-9d5e-18d7e258521d admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:37.468720 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373c4c6-6693-40ce-9d5e-18d7e258521d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:37.473237 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4d2fc-74d8-4c61-ad85-005604eaa813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:37.474149 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4d2fc-74d8-4c61-ad85-005604eaa813 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:37.474625 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4d2fc-74d8-4c61-ad85-005604eaa813 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:37.475095 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4d2fc-74d8-4c61-ad85-005604eaa813 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:37.476029 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4d2fc-74d8-4c61-ad85-005604eaa813 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:37.476533 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4d2fc-74d8-4c61-ad85-005604eaa813 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:37.477808 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING py.warnings [None req-82c4d2fc-74d8-4c61-ad85-005604eaa813 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:39:37.477808 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: warnings.warn(msg) Jan 05 14:39:37.477808 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: Jan 05 14:39:37.479226 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4d2fc-74d8-4c61-ad85-005604eaa813 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:37.480249 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2373c4c6-6693-40ce-9d5e-18d7e258521d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:37.482160 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2373c4c6-6693-40ce-9d5e-18d7e258521d admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:37.498733 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 240/462] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:37.500332 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0705f44-3be1-457c-b4a6-d82043be88ec None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:37.500979 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0705f44-3be1-457c-b4a6-d82043be88ec None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:37.501450 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0705f44-3be1-457c-b4a6-d82043be88ec None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:37.503507 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 241/463] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:37.504415 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0705f44-3be1-457c-b4a6-d82043be88ec None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:37.504539 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-2373c4c6-6693-40ce-9d5e-18d7e258521d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:37.508522 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 223/464] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:37.508522 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373c4c6-6693-40ce-9d5e-18d7e258521d admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:37.519042 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373c4c6-6693-40ce-9d5e-18d7e258521d admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:37.522674 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0705f44-3be1-457c-b4a6-d82043be88ec None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:37.523430 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c674dca-9721-40ab-99b2-d09731c47c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:37.524179 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c674dca-9721-40ab-99b2-d09731c47c06 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:37.524457 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c674dca-9721-40ab-99b2-d09731c47c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:37.524732 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c674dca-9721-40ab-99b2-d09731c47c06 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:37.525511 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c674dca-9721-40ab-99b2-d09731c47c06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:37.527180 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8b2ae-c784-47f5-b77d-ccc065fae779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:37.527421 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c674dca-9721-40ab-99b2-d09731c47c06 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:37.527957 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8b2ae-c784-47f5-b77d-ccc065fae779 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:37.528240 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8b2ae-c784-47f5-b77d-ccc065fae779 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:37.528637 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8b2ae-c784-47f5-b77d-ccc065fae779 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:37.539366 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8b2ae-c784-47f5-b77d-ccc065fae779 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:37.541834 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8b2ae-c784-47f5-b77d-ccc065fae779 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:37.560312 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-78e8b2ae-c784-47f5-b77d-ccc065fae779 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:37.561582 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 242/465] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:37.562759 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b337a68-37f1-4ca1-9b99-32f688469034 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:37.563044 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b337a68-37f1-4ca1-9b99-32f688469034 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:37.563318 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b337a68-37f1-4ca1-9b99-32f688469034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:37.581315 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-4b337a68-37f1-4ca1-9b99-32f688469034 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:37.582497 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-4b337a68-37f1-4ca1-9b99-32f688469034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:37.590680 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 243/466] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:37.591426 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b337a68-37f1-4ca1-9b99-32f688469034 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:37.600187 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b337a68-37f1-4ca1-9b99-32f688469034 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:37.605233 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947870d-a270-4edb-beda-83cc379e3116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:37.605855 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947870d-a270-4edb-beda-83cc379e3116 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:37.606131 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947870d-a270-4edb-beda-83cc379e3116 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:37.606406 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947870d-a270-4edb-beda-83cc379e3116 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:37.607128 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f947870d-a270-4edb-beda-83cc379e3116 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:37.607431 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f947870d-a270-4edb-beda-83cc379e3116 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:37.609017 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f947870d-a270-4edb-beda-83cc379e3116 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:37.620245 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 244/467] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:37.621125 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947870d-a270-4edb-beda-83cc379e3116 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:37.634863 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947870d-a270-4edb-beda-83cc379e3116 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:37.637102 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 224/468] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Jan 5 14:39:37 2022] POST /identity/v3/users => generated 248 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:39:37.637102 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c674dca-9721-40ab-99b2-d09731c47c06 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:37.644685 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86a8ec-0cb1-443b-9ce1-f26841d06df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:37.645767 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86a8ec-0cb1-443b-9ce1-f26841d06df8 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:37.646246 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86a8ec-0cb1-443b-9ce1-f26841d06df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:37.646712 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86a8ec-0cb1-443b-9ce1-f26841d06df8 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:37.647636 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c674dca-9721-40ab-99b2-d09731c47c06 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:37.647970 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86a8ec-0cb1-443b-9ce1-f26841d06df8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:37.648504 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86a8ec-0cb1-443b-9ce1-f26841d06df8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:37.650995 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86a8ec-0cb1-443b-9ce1-f26841d06df8 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:37.653384 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc716235-a3a8-4865-aa4d-8baf54dfade6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:37.654224 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc716235-a3a8-4865-aa4d-8baf54dfade6 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:37.654934 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc716235-a3a8-4865-aa4d-8baf54dfade6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:37.654934 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc716235-a3a8-4865-aa4d-8baf54dfade6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:37.670980 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 245/469] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:37.671178 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc716235-a3a8-4865-aa4d-8baf54dfade6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:37.671178 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc716235-a3a8-4865-aa4d-8baf54dfade6 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:37.672926 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86a8ec-0cb1-443b-9ce1-f26841d06df8 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:37.683233 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86a8ec-0cb1-443b-9ce1-f26841d06df8 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:37.688099 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2f8d8-6a9b-455a-8971-58a2376e4029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:37.689015 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2f8d8-6a9b-455a-8971-58a2376e4029 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:37.689568 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2f8d8-6a9b-455a-8971-58a2376e4029 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:37.690012 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2f8d8-6a9b-455a-8971-58a2376e4029 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:37.690904 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2f8d8-6a9b-455a-8971-58a2376e4029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:37.691054 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-bc716235-a3a8-4865-aa4d-8baf54dfade6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:37.697025 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 225/470] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:37.697025 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc716235-a3a8-4865-aa4d-8baf54dfade6 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:37.702165 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2f8d8-6a9b-455a-8971-58a2376e4029 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:37.710529 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc716235-a3a8-4865-aa4d-8baf54dfade6 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:37.716293 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1d22e-36ac-4225-b89a-690c726c13b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:37.716977 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1d22e-36ac-4225-b89a-690c726c13b7 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:37.717338 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1d22e-36ac-4225-b89a-690c726c13b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:37.717647 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1d22e-36ac-4225-b89a-690c726c13b7 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:37.718379 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1d22e-36ac-4225-b89a-690c726c13b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:37.720535 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1d22e-36ac-4225-b89a-690c726c13b7 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:37.780021 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 246/471] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Jan 5 14:39:37 2022] POST /identity/v3/users => generated 248 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:39:37.781422 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2f8d8-6a9b-455a-8971-58a2376e4029 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:37.795233 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2f8d8-6a9b-455a-8971-58a2376e4029 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:37.800682 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d82b2a-106d-4650-ae03-507eb9a2c7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:37.801836 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d82b2a-106d-4650-ae03-507eb9a2c7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:37.802338 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d82b2a-106d-4650-ae03-507eb9a2c7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:37.802850 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d82b2a-106d-4650-ae03-507eb9a2c7e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:37.803850 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d82b2a-106d-4650-ae03-507eb9a2c7e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:37.804383 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d82b2a-106d-4650-ae03-507eb9a2c7e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:37.807170 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d82b2a-106d-4650-ae03-507eb9a2c7e3 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:37.817676 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 226/472] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Jan 5 14:39:37 2022] POST /identity/v3/users => generated 246 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:39:37.830475 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 247/473] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:37.845679 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1d22e-36ac-4225-b89a-690c726c13b7 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:37.863050 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1d22e-36ac-4225-b89a-690c726c13b7 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:37.878310 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80451e3e-80ac-452b-a654-5090ab77fdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:37.879012 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80451e3e-80ac-452b-a654-5090ab77fdcc admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:37.879295 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80451e3e-80ac-452b-a654-5090ab77fdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:37.879572 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80451e3e-80ac-452b-a654-5090ab77fdcc admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:37.880348 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80451e3e-80ac-452b-a654-5090ab77fdcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:37.882460 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80451e3e-80ac-452b-a654-5090ab77fdcc admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:38.028957 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 227/474] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Jan 5 14:39:37 2022] POST /identity/v3/users => generated 249 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:39:38.648778 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4f705-328f-42dd-bcba-26d5498c0e6a None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:38.649328 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4f705-328f-42dd-bcba-26d5498c0e6a None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:38.649328 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4f705-328f-42dd-bcba-26d5498c0e6a None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:38.651870 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 248/475] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:38.657307 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf042a2d-4dfa-4f51-ad70-c22679698bed None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:38.657729 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf042a2d-4dfa-4f51-ad70-c22679698bed None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:38.657897 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf042a2d-4dfa-4f51-ad70-c22679698bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:38.681028 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-cf042a2d-4dfa-4f51-ad70-c22679698bed None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:38.682259 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-cf042a2d-4dfa-4f51-ad70-c22679698bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:38.696339 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 228/476] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:39:38.736813 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4f705-328f-42dd-bcba-26d5498c0e6a None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:38.755307 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4f705-328f-42dd-bcba-26d5498c0e6a None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:38.762830 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375dff56-3417-4396-b430-6f1c84b00bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:38.763411 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375dff56-3417-4396-b430-6f1c84b00bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:38.763690 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375dff56-3417-4396-b430-6f1c84b00bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:38.763959 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375dff56-3417-4396-b430-6f1c84b00bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:38.764741 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375dff56-3417-4396-b430-6f1c84b00bd6 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:38.766400 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375dff56-3417-4396-b430-6f1c84b00bd6 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:38.833178 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.sql.core [None req-375dff56-3417-4396-b430-6f1c84b00bd6 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jan 05 14:39:38.833178 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jan 05 14:39:38.833178 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [parameters: {'id': '79b6c7c4d9d04f218b2405d2bd8bf55a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jan 05 14:39:38.833178 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=90997) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 05 14:39:38.852082 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-375dff56-3417-4396-b430-6f1c84b00bd6 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jan 05 14:39:38.853735 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 249/477] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 14:39:38 2022] POST /identity/v3/roles => generated 144 bytes in 117 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:38.859193 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf042a2d-4dfa-4f51-ad70-c22679698bed None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:38.868673 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf042a2d-4dfa-4f51-ad70-c22679698bed None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:38.877444 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899406d0-43d7-4a2e-8f65-04442552fd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:38.878507 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899406d0-43d7-4a2e-8f65-04442552fd6f admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:38.878780 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899406d0-43d7-4a2e-8f65-04442552fd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:38.879050 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899406d0-43d7-4a2e-8f65-04442552fd6f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:38.890704 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899406d0-43d7-4a2e-8f65-04442552fd6f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:38.898190 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-899406d0-43d7-4a2e-8f65-04442552fd6f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 05 14:39:38.899617 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 229/478] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Jan 5 14:39:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:38.905058 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375dff56-3417-4396-b430-6f1c84b00bd6 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:38.917407 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375dff56-3417-4396-b430-6f1c84b00bd6 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:38.925590 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ded57-b7f0-4c90-9ab5-d3e3cf9a9375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:38.926400 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ded57-b7f0-4c90-9ab5-d3e3cf9a9375 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:38.926676 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ded57-b7f0-4c90-9ab5-d3e3cf9a9375 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:38.926950 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ded57-b7f0-4c90-9ab5-d3e3cf9a9375 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:38.927791 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ded57-b7f0-4c90-9ab5-d3e3cf9a9375 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:38.928096 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ded57-b7f0-4c90-9ab5-d3e3cf9a9375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:38.929799 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ded57-b7f0-4c90-9ab5-d3e3cf9a9375 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:38.944425 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 250/479] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:39:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:40.559550 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631021a-d31a-40d7-8c93-e299150f0948 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:40.560079 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631021a-d31a-40d7-8c93-e299150f0948 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:40.560079 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631021a-d31a-40d7-8c93-e299150f0948 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:40.562215 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 230/480] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:40.567490 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d963ed-0214-4b15-9bb1-07cb4fe2d3d5 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:40.567907 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d963ed-0214-4b15-9bb1-07cb4fe2d3d5 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:40.568091 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d963ed-0214-4b15-9bb1-07cb4fe2d3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:40.589747 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-58d963ed-0214-4b15-9bb1-07cb4fe2d3d5 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:40.590939 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-58d963ed-0214-4b15-9bb1-07cb4fe2d3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:40.600405 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 251/481] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:40.628098 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631021a-d31a-40d7-8c93-e299150f0948 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:40.634812 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc92ee4-3475-4005-b09b-553628095b30 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:40.635104 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc92ee4-3475-4005-b09b-553628095b30 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:40.635379 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc92ee4-3475-4005-b09b-553628095b30 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:40.637418 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 252/482] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 14:39:40.642283 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631021a-d31a-40d7-8c93-e299150f0948 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:40.644518 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba45831-fe78-4f83-a36c-b863bf6ea8fa None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:40.644799 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba45831-fe78-4f83-a36c-b863bf6ea8fa None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:40.645088 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba45831-fe78-4f83-a36c-b863bf6ea8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:40.646756 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd083747-4169-46d1-b2f2-f74640d12f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:40.647561 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd083747-4169-46d1-b2f2-f74640d12f56 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:40.647849 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd083747-4169-46d1-b2f2-f74640d12f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:40.648125 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd083747-4169-46d1-b2f2-f74640d12f56 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:40.661159 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd083747-4169-46d1-b2f2-f74640d12f56 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:40.668826 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-cd083747-4169-46d1-b2f2-f74640d12f56 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 05 14:39:40.670970 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-7ba45831-fe78-4f83-a36c-b863bf6ea8fa None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:40.672137 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-7ba45831-fe78-4f83-a36c-b863bf6ea8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:40.673192 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 231/483] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Jan 5 14:39:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:39:40.676008 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd083747-4169-46d1-b2f2-f74640d12f56 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:40.686464 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd083747-4169-46d1-b2f2-f74640d12f56 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:40.691183 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf768b7-7356-4172-86e7-0b157e8164b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:40.691835 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf768b7-7356-4172-86e7-0b157e8164b3 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:40.692121 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf768b7-7356-4172-86e7-0b157e8164b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:40.692400 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf768b7-7356-4172-86e7-0b157e8164b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:40.693194 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf768b7-7356-4172-86e7-0b157e8164b3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:40.693505 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf768b7-7356-4172-86e7-0b157e8164b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:40.695123 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf768b7-7356-4172-86e7-0b157e8164b3 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:40.695301 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 253/484] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:40.708912 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 232/485] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Jan 5 14:39:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:40.710217 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba45831-fe78-4f83-a36c-b863bf6ea8fa None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:40.720380 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba45831-fe78-4f83-a36c-b863bf6ea8fa None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:40.724970 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b93d7-561b-4bc8-bb3a-0cce98437079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:40.725813 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b93d7-561b-4bc8-bb3a-0cce98437079 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:40.726100 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b93d7-561b-4bc8-bb3a-0cce98437079 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:40.726380 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b93d7-561b-4bc8-bb3a-0cce98437079 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:40.733302 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf768b7-7356-4172-86e7-0b157e8164b3 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:40.743648 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf768b7-7356-4172-86e7-0b157e8164b3 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:40.750620 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54adc19a-4ad6-4eb8-a746-55d66f3baa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:40.751418 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adc19a-4ad6-4eb8-a746-55d66f3baa73 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:40.751595 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b93d7-561b-4bc8-bb3a-0cce98437079 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:40.751764 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adc19a-4ad6-4eb8-a746-55d66f3baa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:40.751965 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adc19a-4ad6-4eb8-a746-55d66f3baa73 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:40.755250 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b93d7-561b-4bc8-bb3a-0cce98437079 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:40.774475 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54adc19a-4ad6-4eb8-a746-55d66f3baa73 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:40.783999 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-6a3b93d7-561b-4bc8-bb3a-0cce98437079 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:40.789199 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 254/486] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:40.790012 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-54adc19a-4ad6-4eb8-a746-55d66f3baa73 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 05 14:39:40.791287 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b93d7-561b-4bc8-bb3a-0cce98437079 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:40.791630 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 233/487] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Jan 5 14:39:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:39:40.797542 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54adc19a-4ad6-4eb8-a746-55d66f3baa73 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:40.802214 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b93d7-561b-4bc8-bb3a-0cce98437079 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:40.807752 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb512c30-5b71-4de0-8bc5-e5d27b88e906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:40.808480 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb512c30-5b71-4de0-8bc5-e5d27b88e906 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:40.808773 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb512c30-5b71-4de0-8bc5-e5d27b88e906 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:40.809053 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb512c30-5b71-4de0-8bc5-e5d27b88e906 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:40.809830 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb512c30-5b71-4de0-8bc5-e5d27b88e906 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:40.810139 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb512c30-5b71-4de0-8bc5-e5d27b88e906 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:40.812410 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb512c30-5b71-4de0-8bc5-e5d27b88e906 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:40.824115 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54adc19a-4ad6-4eb8-a746-55d66f3baa73 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:40.829157 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 255/488] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:40.831365 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb512c30-5b71-4de0-8bc5-e5d27b88e906 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:40.833457 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c21737-90fb-406f-a00a-8449f62828e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:40.834123 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c21737-90fb-406f-a00a-8449f62828e6 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:40.834405 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c21737-90fb-406f-a00a-8449f62828e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:40.834678 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c21737-90fb-406f-a00a-8449f62828e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:40.835613 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c21737-90fb-406f-a00a-8449f62828e6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:40.835931 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c21737-90fb-406f-a00a-8449f62828e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:40.837610 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c21737-90fb-406f-a00a-8449f62828e6 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:40.841369 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb512c30-5b71-4de0-8bc5-e5d27b88e906 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:40.854956 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ac9b7-ccb1-4a8d-b7f9-d3bc003adb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:40.855762 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ac9b7-ccb1-4a8d-b7f9-d3bc003adb57 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:40.856094 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ac9b7-ccb1-4a8d-b7f9-d3bc003adb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:40.856378 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ac9b7-ccb1-4a8d-b7f9-d3bc003adb57 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:40.861099 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 234/489] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Jan 5 14:39:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:40.863304 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2da1d-8ba9-4844-a01a-cecfb7f5ba26 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:40.863596 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2da1d-8ba9-4844-a01a-cecfb7f5ba26 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:40.863877 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2da1d-8ba9-4844-a01a-cecfb7f5ba26 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:40.865555 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 235/490] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:40.871592 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ac9b7-ccb1-4a8d-b7f9-d3bc003adb57 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:40.873934 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2da1d-8ba9-4844-a01a-cecfb7f5ba26 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:40.875479 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ac9b7-ccb1-4a8d-b7f9-d3bc003adb57 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:40.887813 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2da1d-8ba9-4844-a01a-cecfb7f5ba26 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:40.890294 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-d57ac9b7-ccb1-4a8d-b7f9-d3bc003adb57 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 05 14:39:40.893028 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2ada0-7c43-4884-b1fa-cd5495132c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:40.894164 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2ada0-7c43-4884-b1fa-cd5495132c72 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:40.894645 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2ada0-7c43-4884-b1fa-cd5495132c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:40.895185 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2ada0-7c43-4884-b1fa-cd5495132c72 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:40.896124 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 256/491] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:40.897408 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd2479-f812-435b-ace0-6364d1381ec7 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:40.897701 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd2479-f812-435b-ace0-6364d1381ec7 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:40.898171 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd2479-f812-435b-ace0-6364d1381ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:40.909015 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2ada0-7c43-4884-b1fa-cd5495132c72 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:40.911138 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2ada0-7c43-4884-b1fa-cd5495132c72 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:40.918988 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-0dfd2479-f812-435b-ace0-6364d1381ec7 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:40.920599 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-0dfd2479-f812-435b-ace0-6364d1381ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:40.928974 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 257/492] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:40.937104 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd2479-f812-435b-ace0-6364d1381ec7 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:40.938996 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-69d2ada0-7c43-4884-b1fa-cd5495132c72 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:40.942463 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 236/493] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:40.944717 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd2479-f812-435b-ace0-6364d1381ec7 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:40.951469 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2ada0-7c43-4884-b1fa-cd5495132c72 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:40.957777 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8bb2e-d269-448a-b3fa-90a14e8e53bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:40.959965 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8bb2e-d269-448a-b3fa-90a14e8e53bd admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:40.961596 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8bb2e-d269-448a-b3fa-90a14e8e53bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:40.961984 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8bb2e-d269-448a-b3fa-90a14e8e53bd admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:40.964170 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8bb2e-d269-448a-b3fa-90a14e8e53bd admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:40.998378 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8bb2e-d269-448a-b3fa-90a14e8e53bd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:40.998378 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING py.warnings [None req-ddc8bb2e-d269-448a-b3fa-90a14e8e53bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:39:40.998378 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: warnings.warn(msg) Jan 05 14:39:40.998378 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: Jan 05 14:39:40.998378 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8bb2e-d269-448a-b3fa-90a14e8e53bd admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:40.998727 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2ada0-7c43-4884-b1fa-cd5495132c72 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:40.998727 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff72e28-e1f2-4e26-9ca5-da0f876a4356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:40.998727 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff72e28-e1f2-4e26-9ca5-da0f876a4356 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:40.998727 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff72e28-e1f2-4e26-9ca5-da0f876a4356 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:40.998995 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff72e28-e1f2-4e26-9ca5-da0f876a4356 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:40.998995 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff72e28-e1f2-4e26-9ca5-da0f876a4356 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:40.998995 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff72e28-e1f2-4e26-9ca5-da0f876a4356 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:40.998995 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff72e28-e1f2-4e26-9ca5-da0f876a4356 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:40.998995 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 237/494] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:40.998995 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff72e28-e1f2-4e26-9ca5-da0f876a4356 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.011227 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff72e28-e1f2-4e26-9ca5-da0f876a4356 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.011465 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 258/495] 10.222.0.30 () {56 vars in 1158 bytes} [Wed Jan 5 14:39:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:41.013690 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8bb2e-d269-448a-b3fa-90a14e8e53bd admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.024035 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ad2c4-dd4e-44e0-b436-e5fc65672260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:41.024987 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ad2c4-dd4e-44e0-b436-e5fc65672260 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.031355 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ad2c4-dd4e-44e0-b436-e5fc65672260 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.031355 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ad2c4-dd4e-44e0-b436-e5fc65672260 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.031519 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8bb2e-d269-448a-b3fa-90a14e8e53bd admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.034578 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3216237-9140-4031-8151-77d7a4ba237b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:41.035710 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3216237-9140-4031-8151-77d7a4ba237b admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.036452 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3216237-9140-4031-8151-77d7a4ba237b admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.036908 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3216237-9140-4031-8151-77d7a4ba237b admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.041674 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ad2c4-dd4e-44e0-b436-e5fc65672260 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:41.045694 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3216237-9140-4031-8151-77d7a4ba237b admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:41.047929 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3216237-9140-4031-8151-77d7a4ba237b admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:41.050005 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-f63ad2c4-dd4e-44e0-b436-e5fc65672260 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 05 14:39:41.051344 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 238/496] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Jan 5 14:39:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:41.056808 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ad2c4-dd4e-44e0-b436-e5fc65672260 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.066862 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ad2c4-dd4e-44e0-b436-e5fc65672260 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.071692 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c996d21-8b80-4c19-be98-94d69d9e8c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:41.072495 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-b3216237-9140-4031-8151-77d7a4ba237b admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 05 14:39:41.073108 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c996d21-8b80-4c19-be98-94d69d9e8c70 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.073501 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c996d21-8b80-4c19-be98-94d69d9e8c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.073923 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c996d21-8b80-4c19-be98-94d69d9e8c70 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.078912 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 259/497] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:41.078912 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3216237-9140-4031-8151-77d7a4ba237b admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.090206 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c996d21-8b80-4c19-be98-94d69d9e8c70 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:41.092108 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3216237-9140-4031-8151-77d7a4ba237b admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.092488 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c996d21-8b80-4c19-be98-94d69d9e8c70 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:41.096775 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f917f-f311-4187-a5ad-e6d18b008628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:41.097511 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f917f-f311-4187-a5ad-e6d18b008628 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.097804 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f917f-f311-4187-a5ad-e6d18b008628 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.098137 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f917f-f311-4187-a5ad-e6d18b008628 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.098914 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f917f-f311-4187-a5ad-e6d18b008628 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:41.099546 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f917f-f311-4187-a5ad-e6d18b008628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:41.101007 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f917f-f311-4187-a5ad-e6d18b008628 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:41.104863 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 239/498] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:39:41.105892 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c996d21-8b80-4c19-be98-94d69d9e8c70 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.116392 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 260/499] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Jan 5 14:39:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:41.120843 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f917f-f311-4187-a5ad-e6d18b008628 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.123955 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c996d21-8b80-4c19-be98-94d69d9e8c70 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.128075 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f917f-f311-4187-a5ad-e6d18b008628 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.129268 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eea753-ead5-4ac8-887f-3a880313452e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:41.130221 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eea753-ead5-4ac8-887f-3a880313452e admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.130774 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eea753-ead5-4ac8-887f-3a880313452e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.131355 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eea753-ead5-4ac8-887f-3a880313452e admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.132391 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eea753-ead5-4ac8-887f-3a880313452e admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:41.132961 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eea753-ead5-4ac8-887f-3a880313452e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:41.133253 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3db764-dfb2-4075-aaed-0363fa3c2b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:41.134074 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3db764-dfb2-4075-aaed-0363fa3c2b0c admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.134408 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3db764-dfb2-4075-aaed-0363fa3c2b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.135225 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3db764-dfb2-4075-aaed-0363fa3c2b0c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.135576 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING py.warnings [None req-f5eea753-ead5-4ac8-887f-3a880313452e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:39:41.135576 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: warnings.warn(msg) Jan 05 14:39:41.135576 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: Jan 05 14:39:41.137305 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eea753-ead5-4ac8-887f-3a880313452e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:41.149922 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3db764-dfb2-4075-aaed-0363fa3c2b0c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:41.153497 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3db764-dfb2-4075-aaed-0363fa3c2b0c admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:41.172452 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-1e3db764-dfb2-4075-aaed-0363fa3c2b0c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:41.178204 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 261/500] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:41.179012 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3db764-dfb2-4075-aaed-0363fa3c2b0c admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.184688 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 240/501] 10.222.0.30 () {56 vars in 1158 bytes} [Wed Jan 5 14:39:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:41.185815 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eea753-ead5-4ac8-887f-3a880313452e admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.189384 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3db764-dfb2-4075-aaed-0363fa3c2b0c admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.194515 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4c73a-b9a7-4214-b791-60dc62dee09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:41.195330 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4c73a-b9a7-4214-b791-60dc62dee09c admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.195619 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4c73a-b9a7-4214-b791-60dc62dee09c admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.195898 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4c73a-b9a7-4214-b791-60dc62dee09c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.196860 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eea753-ead5-4ac8-887f-3a880313452e admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.203914 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9258a9-4284-4c3b-bcfb-d46a03720ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:41.205254 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9258a9-4284-4c3b-bcfb-d46a03720ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.205764 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9258a9-4284-4c3b-bcfb-d46a03720ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.206299 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9258a9-4284-4c3b-bcfb-d46a03720ba2 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.207343 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9258a9-4284-4c3b-bcfb-d46a03720ba2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:41.207843 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9258a9-4284-4c3b-bcfb-d46a03720ba2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:41.207960 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4c73a-b9a7-4214-b791-60dc62dee09c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:41.209790 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4c73a-b9a7-4214-b791-60dc62dee09c admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:41.210267 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9258a9-4284-4c3b-bcfb-d46a03720ba2 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:41.222875 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 241/502] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:41.223927 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9258a9-4284-4c3b-bcfb-d46a03720ba2 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.234410 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-c5e4c73a-b9a7-4214-b791-60dc62dee09c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:41.235827 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 262/503] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:41.241034 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4c73a-b9a7-4214-b791-60dc62dee09c admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.241170 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9258a9-4284-4c3b-bcfb-d46a03720ba2 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.245842 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3b6d2-3dc2-4115-8b31-89661d8b470a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:41.246467 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3b6d2-3dc2-4115-8b31-89661d8b470a admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.246755 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3b6d2-3dc2-4115-8b31-89661d8b470a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.247034 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3b6d2-3dc2-4115-8b31-89661d8b470a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.253259 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4c73a-b9a7-4214-b791-60dc62dee09c admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.256826 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3b6d2-3dc2-4115-8b31-89661d8b470a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:41.258830 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5d37f-c6d4-4ee6-8b3c-9399710c12d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:41.260413 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5d37f-c6d4-4ee6-8b3c-9399710c12d7 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.260662 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3b6d2-3dc2-4115-8b31-89661d8b470a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:41.261167 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5d37f-c6d4-4ee6-8b3c-9399710c12d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.261689 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5d37f-c6d4-4ee6-8b3c-9399710c12d7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.269165 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5d37f-c6d4-4ee6-8b3c-9399710c12d7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:41.270774 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 242/504] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:39:41.275996 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5d37f-c6d4-4ee6-8b3c-9399710c12d7 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:41.276110 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3b6d2-3dc2-4115-8b31-89661d8b470a admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.281059 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3b6d2-3dc2-4115-8b31-89661d8b470a admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.285904 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3b03c-5144-45ee-8e5e-f5ab4d9f8707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:41.286537 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3b03c-5144-45ee-8e5e-f5ab4d9f8707 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.286822 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3b03c-5144-45ee-8e5e-f5ab4d9f8707 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.287103 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3b03c-5144-45ee-8e5e-f5ab4d9f8707 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.287820 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d3b03c-5144-45ee-8e5e-f5ab4d9f8707 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:41.288124 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d3b03c-5144-45ee-8e5e-f5ab4d9f8707 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:41.289745 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d3b03c-5144-45ee-8e5e-f5ab4d9f8707 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:41.293206 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-08e5d37f-c6d4-4ee6-8b3c-9399710c12d7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:39:41.294889 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 263/505] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:39:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:41.295895 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5d37f-c6d4-4ee6-8b3c-9399710c12d7 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.311140 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 243/506] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:41.311140 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3b03c-5144-45ee-8e5e-f5ab4d9f8707 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.311783 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5d37f-c6d4-4ee6-8b3c-9399710c12d7 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.318428 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce571e7-ca33-4aa8-8f83-5fe98311e9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:41.319447 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce571e7-ca33-4aa8-8f83-5fe98311e9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.319944 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce571e7-ca33-4aa8-8f83-5fe98311e9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.320417 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce571e7-ca33-4aa8-8f83-5fe98311e9a0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.321827 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3b03c-5144-45ee-8e5e-f5ab4d9f8707 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.327007 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97588833-770e-48d7-a8d4-03211531af44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:41.327649 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97588833-770e-48d7-a8d4-03211531af44 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.327935 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97588833-770e-48d7-a8d4-03211531af44 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.328218 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97588833-770e-48d7-a8d4-03211531af44 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.329096 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97588833-770e-48d7-a8d4-03211531af44 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:41.329688 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97588833-770e-48d7-a8d4-03211531af44 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:41.332236 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING py.warnings [None req-97588833-770e-48d7-a8d4-03211531af44 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:39:41.332236 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: warnings.warn(msg) Jan 05 14:39:41.332236 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: Jan 05 14:39:41.333402 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97588833-770e-48d7-a8d4-03211531af44 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:41.334884 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce571e7-ca33-4aa8-8f83-5fe98311e9a0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:41.338897 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce571e7-ca33-4aa8-8f83-5fe98311e9a0 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:41.353884 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 244/507] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:39:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:41.357468 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-1ce571e7-ca33-4aa8-8f83-5fe98311e9a0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:41.358866 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 264/508] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:41.361199 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97588833-770e-48d7-a8d4-03211531af44 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.364078 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce571e7-ca33-4aa8-8f83-5fe98311e9a0 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.372979 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97588833-770e-48d7-a8d4-03211531af44 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.374290 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce571e7-ca33-4aa8-8f83-5fe98311e9a0 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.378646 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f690ddb-cb2a-4981-bb73-12de1b4c8d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:41.379568 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70791312-90d5-4bfb-8ce4-386cbecdc8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:41.379920 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f690ddb-cb2a-4981-bb73-12de1b4c8d82 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.380401 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70791312-90d5-4bfb-8ce4-386cbecdc8d6 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.380531 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f690ddb-cb2a-4981-bb73-12de1b4c8d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.380856 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70791312-90d5-4bfb-8ce4-386cbecdc8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.381115 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f690ddb-cb2a-4981-bb73-12de1b4c8d82 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.381352 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70791312-90d5-4bfb-8ce4-386cbecdc8d6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.382473 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70791312-90d5-4bfb-8ce4-386cbecdc8d6 admin admin] RBAC: Adding query filter params (role.id=9868670385c0469093001f6f2c310f1a, scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1, user.id=935ad716e4624c25bc34308f05eb1526) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:41.382877 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70791312-90d5-4bfb-8ce4-386cbecdc8d6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:41.385108 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70791312-90d5-4bfb-8ce4-386cbecdc8d6 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:41.397107 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 265/509] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:39:41 2022] GET /identity/v3/role_assignments?user.id=935ad716e4624c25bc34308f05eb1526&scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1&role.id=9868670385c0469093001f6f2c310f1a => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:41.397107 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70791312-90d5-4bfb-8ce4-386cbecdc8d6 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.397356 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f690ddb-cb2a-4981-bb73-12de1b4c8d82 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:41.397356 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f690ddb-cb2a-4981-bb73-12de1b4c8d82 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:41.411482 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70791312-90d5-4bfb-8ce4-386cbecdc8d6 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.421007 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-3f690ddb-cb2a-4981-bb73-12de1b4c8d82 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 05 14:39:41.430081 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 245/510] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Jan 5 14:39:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:41.430731 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdd67d-ec19-406f-b6da-48d6e6174bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:41.431950 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdd67d-ec19-406f-b6da-48d6e6174bab admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.432237 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdd67d-ec19-406f-b6da-48d6e6174bab admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.432515 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdd67d-ec19-406f-b6da-48d6e6174bab admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.433292 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdd67d-ec19-406f-b6da-48d6e6174bab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:41.433598 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdd67d-ec19-406f-b6da-48d6e6174bab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:41.435243 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdd67d-ec19-406f-b6da-48d6e6174bab admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:41.437820 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f690ddb-cb2a-4981-bb73-12de1b4c8d82 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.449660 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 266/511] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:41.450991 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf64d3-ded7-4ddc-9422-ef28977daa7d None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.451272 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf64d3-ded7-4ddc-9422-ef28977daa7d None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.451543 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf64d3-ded7-4ddc-9422-ef28977daa7d None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.453185 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 267/512] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:41.454874 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf64d3-ded7-4ddc-9422-ef28977daa7d None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.458225 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f690ddb-cb2a-4981-bb73-12de1b4c8d82 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.463623 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb5ae7-3322-4644-b008-9d77a2c292ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:41.464302 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb5ae7-3322-4644-b008-9d77a2c292ff admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.464584 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb5ae7-3322-4644-b008-9d77a2c292ff admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.465107 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb5ae7-3322-4644-b008-9d77a2c292ff admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.465810 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb5ae7-3322-4644-b008-9d77a2c292ff admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:41.466128 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb5ae7-3322-4644-b008-9d77a2c292ff admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:41.468020 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb5ae7-3322-4644-b008-9d77a2c292ff admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:41.471411 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf64d3-ded7-4ddc-9422-ef28977daa7d None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.476299 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8ca9b-5578-450e-a529-d241fb72da62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:41.477286 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8ca9b-5578-450e-a529-d241fb72da62 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.477570 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8ca9b-5578-450e-a529-d241fb72da62 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.477842 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8ca9b-5578-450e-a529-d241fb72da62 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.485596 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c8ca9b-5578-450e-a529-d241fb72da62 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:41.487600 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c8ca9b-5578-450e-a529-d241fb72da62 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:41.497645 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 246/513] 10.222.0.30 () {56 vars in 1154 bytes} [Wed Jan 5 14:39:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:41.503940 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59045af3-916a-4cb1-ba19-bf2d4d4208e2 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.504159 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-e2c8ca9b-5578-450e-a529-d241fb72da62 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:39:41.504864 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59045af3-916a-4cb1-ba19-bf2d4d4208e2 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.504988 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 268/514] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:39:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:41.505825 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8ca9b-5578-450e-a529-d241fb72da62 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.506104 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59045af3-916a-4cb1-ba19-bf2d4d4208e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.520619 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8ca9b-5578-450e-a529-d241fb72da62 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.527171 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a1add-62c3-43d9-8d17-623d896e546a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:41.527783 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a1add-62c3-43d9-8d17-623d896e546a admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.528072 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a1add-62c3-43d9-8d17-623d896e546a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.528349 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a1add-62c3-43d9-8d17-623d896e546a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.537091 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-59045af3-916a-4cb1-ba19-bf2d4d4208e2 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:41.537276 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a1add-62c3-43d9-8d17-623d896e546a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:41.538659 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-59045af3-916a-4cb1-ba19-bf2d4d4208e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:41.539125 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a1add-62c3-43d9-8d17-623d896e546a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:41.554130 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 269/515] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:39:41.554130 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a1add-62c3-43d9-8d17-623d896e546a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.555096 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 247/516] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:41.556182 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59045af3-916a-4cb1-ba19-bf2d4d4208e2 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.567019 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59045af3-916a-4cb1-ba19-bf2d4d4208e2 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.573961 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154004f4-c2fa-4197-8a50-4318b6732729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:41.575002 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154004f4-c2fa-4197-8a50-4318b6732729 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.575427 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154004f4-c2fa-4197-8a50-4318b6732729 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.575843 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154004f4-c2fa-4197-8a50-4318b6732729 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.575953 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a1add-62c3-43d9-8d17-623d896e546a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.585886 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedaf3b-5be0-4d0c-8a72-7db914a841ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:41.586561 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedaf3b-5be0-4d0c-8a72-7db914a841ce admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.586888 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedaf3b-5be0-4d0c-8a72-7db914a841ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.587168 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedaf3b-5be0-4d0c-8a72-7db914a841ce admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.588600 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bedaf3b-5be0-4d0c-8a72-7db914a841ce admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:41.588960 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bedaf3b-5be0-4d0c-8a72-7db914a841ce admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:41.590423 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154004f4-c2fa-4197-8a50-4318b6732729 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:41.592496 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154004f4-c2fa-4197-8a50-4318b6732729 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:41.594285 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING py.warnings [None req-7bedaf3b-5be0-4d0c-8a72-7db914a841ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:39:41.594285 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: warnings.warn(msg) Jan 05 14:39:41.594285 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: Jan 05 14:39:41.595511 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bedaf3b-5be0-4d0c-8a72-7db914a841ce admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:41.612551 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-154004f4-c2fa-4197-8a50-4318b6732729 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:41.614070 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 248/517] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:41.615000 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154004f4-c2fa-4197-8a50-4318b6732729 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.625439 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 270/518] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:39:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:41.627802 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154004f4-c2fa-4197-8a50-4318b6732729 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.631437 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedaf3b-5be0-4d0c-8a72-7db914a841ce admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.634215 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f55b71-5dbe-41b1-b7f8-cde266242254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:41.635640 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f55b71-5dbe-41b1-b7f8-cde266242254 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.636350 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f55b71-5dbe-41b1-b7f8-cde266242254 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.637274 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f55b71-5dbe-41b1-b7f8-cde266242254 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.642690 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedaf3b-5be0-4d0c-8a72-7db914a841ce admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.647885 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8753bd-4e2c-44a0-b43e-c13bc24d6efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:41.648576 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8753bd-4e2c-44a0-b43e-c13bc24d6efe admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.648946 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8753bd-4e2c-44a0-b43e-c13bc24d6efe admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.649340 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8753bd-4e2c-44a0-b43e-c13bc24d6efe admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.650674 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8753bd-4e2c-44a0-b43e-c13bc24d6efe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:41.650986 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8753bd-4e2c-44a0-b43e-c13bc24d6efe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:41.652715 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8753bd-4e2c-44a0-b43e-c13bc24d6efe admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:41.656708 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f55b71-5dbe-41b1-b7f8-cde266242254 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:41.667278 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-61f55b71-5dbe-41b1-b7f8-cde266242254 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 05 14:39:41.668711 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 249/519] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Jan 5 14:39:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:41.669746 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f55b71-5dbe-41b1-b7f8-cde266242254 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.673394 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 271/520] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:41.674307 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8753bd-4e2c-44a0-b43e-c13bc24d6efe admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.681163 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f55b71-5dbe-41b1-b7f8-cde266242254 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.685674 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaea880-01fc-4f81-9e0c-90d9cca80a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:41.685811 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8753bd-4e2c-44a0-b43e-c13bc24d6efe admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.686310 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaea880-01fc-4f81-9e0c-90d9cca80a78 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.686593 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaea880-01fc-4f81-9e0c-90d9cca80a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.686919 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaea880-01fc-4f81-9e0c-90d9cca80a78 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.687695 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaea880-01fc-4f81-9e0c-90d9cca80a78 admin admin] RBAC: Adding query filter params (role.id=9868670385c0469093001f6f2c310f1a, scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1, user.id=541bd71b355d4b7ca35372e11be54be3) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:41.688005 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaea880-01fc-4f81-9e0c-90d9cca80a78 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:41.689894 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaea880-01fc-4f81-9e0c-90d9cca80a78 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:41.690623 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbd2f1-d888-4fc2-9af5-9c826b8253e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:41.691280 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbd2f1-d888-4fc2-9af5-9c826b8253e7 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.691567 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbd2f1-d888-4fc2-9af5-9c826b8253e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.691851 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbd2f1-d888-4fc2-9af5-9c826b8253e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.692615 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddbd2f1-d888-4fc2-9af5-9c826b8253e7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:41.692923 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddbd2f1-d888-4fc2-9af5-9c826b8253e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:41.694585 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddbd2f1-d888-4fc2-9af5-9c826b8253e7 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:41.698263 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 250/521] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:39:41 2022] GET /identity/v3/role_assignments?user.id=541bd71b355d4b7ca35372e11be54be3&scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1&role.id=9868670385c0469093001f6f2c310f1a => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:41.699209 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaea880-01fc-4f81-9e0c-90d9cca80a78 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.705131 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 272/522] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Jan 5 14:39:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:41.718385 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbd2f1-d888-4fc2-9af5-9c826b8253e7 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.721403 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaea880-01fc-4f81-9e0c-90d9cca80a78 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.734761 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbd2f1-d888-4fc2-9af5-9c826b8253e7 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.736276 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40629f72-a6d1-42f1-a0c3-a27d6212a3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:41.737283 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40629f72-a6d1-42f1-a0c3-a27d6212a3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.737742 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40629f72-a6d1-42f1-a0c3-a27d6212a3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.738161 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40629f72-a6d1-42f1-a0c3-a27d6212a3e9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.748372 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40629f72-a6d1-42f1-a0c3-a27d6212a3e9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:41.751109 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40629f72-a6d1-42f1-a0c3-a27d6212a3e9 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:41.753483 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b7839-3ab6-4d9f-b341-67ad445f80f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:41.754493 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b7839-3ab6-4d9f-b341-67ad445f80f8 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.754928 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b7839-3ab6-4d9f-b341-67ad445f80f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.755341 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b7839-3ab6-4d9f-b341-67ad445f80f8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.777934 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-40629f72-a6d1-42f1-a0c3-a27d6212a3e9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:39:41.780525 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b7839-3ab6-4d9f-b341-67ad445f80f8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:41.782615 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b7839-3ab6-4d9f-b341-67ad445f80f8 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:41.784571 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 251/523] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:39:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:41.799411 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40629f72-a6d1-42f1-a0c3-a27d6212a3e9 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.810283 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-408b7839-3ab6-4d9f-b341-67ad445f80f8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:41.815871 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40629f72-a6d1-42f1-a0c3-a27d6212a3e9 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.817426 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 273/524] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:39:41.821610 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9dc21-1f21-46cf-9076-4bc79b043f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:41.822983 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9dc21-1f21-46cf-9076-4bc79b043f1f admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.823405 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9dc21-1f21-46cf-9076-4bc79b043f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.823824 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9dc21-1f21-46cf-9076-4bc79b043f1f admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.824786 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9dc21-1f21-46cf-9076-4bc79b043f1f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:41.825266 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9dc21-1f21-46cf-9076-4bc79b043f1f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:41.827287 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9dc21-1f21-46cf-9076-4bc79b043f1f admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:41.829818 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b7839-3ab6-4d9f-b341-67ad445f80f8 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.840834 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b7839-3ab6-4d9f-b341-67ad445f80f8 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.847736 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 252/525] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:39:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:41.855150 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9dc21-1f21-46cf-9076-4bc79b043f1f admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.865706 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c642969-d31a-466c-80da-910c8bf9febf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:41.866568 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c642969-d31a-466c-80da-910c8bf9febf admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.867004 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c642969-d31a-466c-80da-910c8bf9febf admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.867384 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c642969-d31a-466c-80da-910c8bf9febf admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.868313 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c642969-d31a-466c-80da-910c8bf9febf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:41.868804 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c642969-d31a-466c-80da-910c8bf9febf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:41.870689 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c642969-d31a-466c-80da-910c8bf9febf admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:41.880436 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9dc21-1f21-46cf-9076-4bc79b043f1f admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.891804 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf62b2-685d-4bee-a6a7-d87753df8591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:41.894198 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf62b2-685d-4bee-a6a7-d87753df8591 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.895599 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf62b2-685d-4bee-a6a7-d87753df8591 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.896019 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf62b2-685d-4bee-a6a7-d87753df8591 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.899458 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf62b2-685d-4bee-a6a7-d87753df8591 admin admin] RBAC: Adding query filter params (role.id=9868670385c0469093001f6f2c310f1a, scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1, user.id=77db235e2f7046e4bdbad7f31b5e3ebc) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:41.899968 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf62b2-685d-4bee-a6a7-d87753df8591 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:41.902483 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 274/526] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:41.903784 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf62b2-685d-4bee-a6a7-d87753df8591 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:41.907668 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c642969-d31a-466c-80da-910c8bf9febf admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.925275 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 253/527] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:39:41 2022] GET /identity/v3/role_assignments?user.id=77db235e2f7046e4bdbad7f31b5e3ebc&scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1&role.id=9868670385c0469093001f6f2c310f1a => generated 259 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:41.929483 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c642969-d31a-466c-80da-910c8bf9febf admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.934708 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29db21-98fe-4a83-b029-123d77e8710d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:41.935712 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29db21-98fe-4a83-b029-123d77e8710d admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:41.936131 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29db21-98fe-4a83-b029-123d77e8710d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:41.936514 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29db21-98fe-4a83-b029-123d77e8710d admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:41.951527 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc29db21-98fe-4a83-b029-123d77e8710d admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:41.953913 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc29db21-98fe-4a83-b029-123d77e8710d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:41.975090 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-dc29db21-98fe-4a83-b029-123d77e8710d admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 05 14:39:41.976514 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 275/528] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Jan 5 14:39:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:39:41.982720 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf62b2-685d-4bee-a6a7-d87753df8591 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:41.993096 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf62b2-685d-4bee-a6a7-d87753df8591 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:41.997842 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975294c8-794d-4d0d-a876-dfe496207a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:42.005815 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975294c8-794d-4d0d-a876-dfe496207a35 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:42.006091 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975294c8-794d-4d0d-a876-dfe496207a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:42.006378 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975294c8-794d-4d0d-a876-dfe496207a35 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:42.007286 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975294c8-794d-4d0d-a876-dfe496207a35 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:42.007602 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975294c8-794d-4d0d-a876-dfe496207a35 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:42.010128 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975294c8-794d-4d0d-a876-dfe496207a35 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:42.034868 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 254/529] 10.222.0.30 () {56 vars in 1160 bytes} [Wed Jan 5 14:39:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:42.040282 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29db21-98fe-4a83-b029-123d77e8710d admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:42.054518 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29db21-98fe-4a83-b029-123d77e8710d admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:42.059310 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f34e4-813d-489c-b11a-00acca66c603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:42.059975 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f34e4-813d-489c-b11a-00acca66c603 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:42.060285 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f34e4-813d-489c-b11a-00acca66c603 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:42.060536 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f34e4-813d-489c-b11a-00acca66c603 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:42.072575 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f34e4-813d-489c-b11a-00acca66c603 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:42.074540 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f34e4-813d-489c-b11a-00acca66c603 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:42.086891 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 276/530] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:39:42.093031 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975294c8-794d-4d0d-a876-dfe496207a35 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:42.103488 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975294c8-794d-4d0d-a876-dfe496207a35 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:42.108145 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4dd9b-76ff-4808-84f5-8f72a1706a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:42.108963 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4dd9b-76ff-4808-84f5-8f72a1706a75 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:42.109293 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4dd9b-76ff-4808-84f5-8f72a1706a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:42.109574 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4dd9b-76ff-4808-84f5-8f72a1706a75 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:42.121761 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f4dd9b-76ff-4808-84f5-8f72a1706a75 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:42.123706 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f4dd9b-76ff-4808-84f5-8f72a1706a75 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:42.142873 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-f5f4dd9b-76ff-4808-84f5-8f72a1706a75 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:42.144514 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 255/531] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:42.149625 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f34e4-813d-489c-b11a-00acca66c603 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:42.162382 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f34e4-813d-489c-b11a-00acca66c603 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:42.167117 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcbe77-2228-42df-866a-7280185f6d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:42.167800 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcbe77-2228-42df-866a-7280185f6d80 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:42.168087 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcbe77-2228-42df-866a-7280185f6d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:42.168368 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcbe77-2228-42df-866a-7280185f6d80 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:42.169204 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fcbe77-2228-42df-866a-7280185f6d80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:42.169517 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fcbe77-2228-42df-866a-7280185f6d80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:42.171147 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fcbe77-2228-42df-866a-7280185f6d80 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:42.189097 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 277/532] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:42.194368 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4dd9b-76ff-4808-84f5-8f72a1706a75 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:42.204508 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4dd9b-76ff-4808-84f5-8f72a1706a75 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:42.208987 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19676f-f357-4ce1-bb04-76fd4dba2c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:42.209816 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19676f-f357-4ce1-bb04-76fd4dba2c8a admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:42.210104 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19676f-f357-4ce1-bb04-76fd4dba2c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:42.210377 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19676f-f357-4ce1-bb04-76fd4dba2c8a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:42.217862 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19676f-f357-4ce1-bb04-76fd4dba2c8a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:42.219870 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19676f-f357-4ce1-bb04-76fd4dba2c8a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:42.226267 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30318591-c9b0-4a6b-81b5-b79f80de298f None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:42.226705 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30318591-c9b0-4a6b-81b5-b79f80de298f None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:42.227047 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30318591-c9b0-4a6b-81b5-b79f80de298f None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:42.229263 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 278/533] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:42.233832 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-de19676f-f357-4ce1-bb04-76fd4dba2c8a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:39:42.234553 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30792492-3b1f-4a6a-99ea-1cc44cc4a6bd None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:42.234933 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30792492-3b1f-4a6a-99ea-1cc44cc4a6bd None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:42.235323 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30792492-3b1f-4a6a-99ea-1cc44cc4a6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:42.239260 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 256/534] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:39:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:42.240904 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19676f-f357-4ce1-bb04-76fd4dba2c8a admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:42.253709 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19676f-f357-4ce1-bb04-76fd4dba2c8a admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:42.262221 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-30792492-3b1f-4a6a-99ea-1cc44cc4a6bd None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:42.263628 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-30792492-3b1f-4a6a-99ea-1cc44cc4a6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:42.269093 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8326a-5ac1-4f0f-9990-92e0092b6ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:42.269093 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8326a-5ac1-4f0f-9990-92e0092b6ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:42.269093 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8326a-5ac1-4f0f-9990-92e0092b6ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:42.269093 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8326a-5ac1-4f0f-9990-92e0092b6ea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:42.269415 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8326a-5ac1-4f0f-9990-92e0092b6ea0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:42.269415 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8326a-5ac1-4f0f-9990-92e0092b6ea0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:42.269555 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8326a-5ac1-4f0f-9990-92e0092b6ea0 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:42.282873 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 257/535] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:39:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:42.286793 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 279/536] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:39:42.288892 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8326a-5ac1-4f0f-9990-92e0092b6ea0 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:42.302502 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8326a-5ac1-4f0f-9990-92e0092b6ea0 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:42.315227 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749766e-a974-4c5b-9987-10bcd00a1292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:42.315885 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749766e-a974-4c5b-9987-10bcd00a1292 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:42.316173 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749766e-a974-4c5b-9987-10bcd00a1292 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:42.316452 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749766e-a974-4c5b-9987-10bcd00a1292 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:42.316972 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30792492-3b1f-4a6a-99ea-1cc44cc4a6bd None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:42.317341 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749766e-a974-4c5b-9987-10bcd00a1292 admin admin] RBAC: Adding query filter params (role.id=9868670385c0469093001f6f2c310f1a, scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1, user.id=a6234d716a014808a8a4eb22b903bbc9) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:42.317647 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749766e-a974-4c5b-9987-10bcd00a1292 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:42.319511 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749766e-a974-4c5b-9987-10bcd00a1292 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:42.327409 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 258/537] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:39:42 2022] GET /identity/v3/role_assignments?user.id=a6234d716a014808a8a4eb22b903bbc9&scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1&role.id=9868670385c0469093001f6f2c310f1a => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:42.337380 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30792492-3b1f-4a6a-99ea-1cc44cc4a6bd None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:42.344910 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66043f39-b225-40b5-a107-97dbc727c1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:42.345831 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66043f39-b225-40b5-a107-97dbc727c1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:42.346113 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66043f39-b225-40b5-a107-97dbc727c1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:42.346443 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66043f39-b225-40b5-a107-97dbc727c1c8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:42.360898 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66043f39-b225-40b5-a107-97dbc727c1c8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:42.363170 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66043f39-b225-40b5-a107-97dbc727c1c8 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:42.390286 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-66043f39-b225-40b5-a107-97dbc727c1c8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:42.391945 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 280/538] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:39:42.397801 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749766e-a974-4c5b-9987-10bcd00a1292 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:42.408748 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749766e-a974-4c5b-9987-10bcd00a1292 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:42.418126 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577bd9a-e457-4fc3-b607-0533f6643f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:42.418856 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577bd9a-e457-4fc3-b607-0533f6643f64 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:42.419148 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577bd9a-e457-4fc3-b607-0533f6643f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:42.419429 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577bd9a-e457-4fc3-b607-0533f6643f64 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:42.420233 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1577bd9a-e457-4fc3-b607-0533f6643f64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:42.420546 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1577bd9a-e457-4fc3-b607-0533f6643f64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:42.422293 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1577bd9a-e457-4fc3-b607-0533f6643f64 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:42.436771 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 259/539] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:42.442619 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66043f39-b225-40b5-a107-97dbc727c1c8 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:42.455349 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66043f39-b225-40b5-a107-97dbc727c1c8 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:42.461626 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c05b8-8314-47d3-900a-1a6ae43a0f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:42.462678 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c05b8-8314-47d3-900a-1a6ae43a0f3c admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:42.463107 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c05b8-8314-47d3-900a-1a6ae43a0f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:42.463614 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c05b8-8314-47d3-900a-1a6ae43a0f3c admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:42.464499 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c05b8-8314-47d3-900a-1a6ae43a0f3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:42.466962 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c05b8-8314-47d3-900a-1a6ae43a0f3c admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:42.562515 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 281/540] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Jan 5 14:39:42 2022] POST /identity/v3/users => generated 247 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:39:44.382051 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004aa912-d7ec-49aa-87a2-bfc4ead5ae9c None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:44.382051 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004aa912-d7ec-49aa-87a2-bfc4ead5ae9c None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:44.382051 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004aa912-d7ec-49aa-87a2-bfc4ead5ae9c None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:44.382051 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 260/541] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:44.387456 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dace16-9be6-4625-87a6-3bed5a7a1ab1 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:44.387885 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dace16-9be6-4625-87a6-3bed5a7a1ab1 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:44.388035 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dace16-9be6-4625-87a6-3bed5a7a1ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:44.418754 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-82dace16-9be6-4625-87a6-3bed5a7a1ab1 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:44.419945 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-82dace16-9be6-4625-87a6-3bed5a7a1ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:44.437001 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 282/542] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:39:44.480663 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004aa912-d7ec-49aa-87a2-bfc4ead5ae9c None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:44.500418 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004aa912-d7ec-49aa-87a2-bfc4ead5ae9c None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:44.508599 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b43669-82b1-4e38-9bc3-4f87de67c894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:44.509572 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b43669-82b1-4e38-9bc3-4f87de67c894 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:44.509857 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b43669-82b1-4e38-9bc3-4f87de67c894 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:44.510130 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b43669-82b1-4e38-9bc3-4f87de67c894 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:44.529143 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b43669-82b1-4e38-9bc3-4f87de67c894 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:44.536343 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-38b43669-82b1-4e38-9bc3-4f87de67c894 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 05 14:39:44.537878 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 261/543] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Jan 5 14:39:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:44.543633 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dace16-9be6-4625-87a6-3bed5a7a1ab1 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:44.561097 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dace16-9be6-4625-87a6-3bed5a7a1ab1 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:44.569573 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2f047-8d50-4eee-904b-cc427e0f6a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:44.570277 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2f047-8d50-4eee-904b-cc427e0f6a3a admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:44.570562 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2f047-8d50-4eee-904b-cc427e0f6a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:44.570840 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2f047-8d50-4eee-904b-cc427e0f6a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:44.571636 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2f047-8d50-4eee-904b-cc427e0f6a3a admin admin] RBAC: Adding query filter params (name=service) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:44.572016 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2f047-8d50-4eee-904b-cc427e0f6a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:44.573778 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2f047-8d50-4eee-904b-cc427e0f6a3a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:44.590202 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 283/544] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Jan 5 14:39:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:44.595491 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b43669-82b1-4e38-9bc3-4f87de67c894 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:44.610674 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b43669-82b1-4e38-9bc3-4f87de67c894 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:44.617145 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5eca1-4853-406e-b145-39febcb55544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:44.622047 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5eca1-4853-406e-b145-39febcb55544 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:44.622564 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5eca1-4853-406e-b145-39febcb55544 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:44.623069 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5eca1-4853-406e-b145-39febcb55544 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:44.635333 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5eca1-4853-406e-b145-39febcb55544 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:44.637516 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5eca1-4853-406e-b145-39febcb55544 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:44.667646 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-04c5eca1-4853-406e-b145-39febcb55544 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:44.669612 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 262/545] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:44.674652 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2f047-8d50-4eee-904b-cc427e0f6a3a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:44.694112 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2f047-8d50-4eee-904b-cc427e0f6a3a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:44.706300 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58786691-74f1-432f-aafa-8c4b176d3ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:44.706978 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58786691-74f1-432f-aafa-8c4b176d3ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:44.707267 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58786691-74f1-432f-aafa-8c4b176d3ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:44.707549 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58786691-74f1-432f-aafa-8c4b176d3ea2 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:44.708288 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58786691-74f1-432f-aafa-8c4b176d3ea2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:44.708601 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58786691-74f1-432f-aafa-8c4b176d3ea2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:44.710235 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58786691-74f1-432f-aafa-8c4b176d3ea2 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:44.731238 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 284/546] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:44.736904 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5eca1-4853-406e-b145-39febcb55544 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:44.748571 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5eca1-4853-406e-b145-39febcb55544 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:44.762055 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac897e-957c-480a-b0f3-9d1dc5de3ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:44.763207 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac897e-957c-480a-b0f3-9d1dc5de3ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:44.763723 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac897e-957c-480a-b0f3-9d1dc5de3ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:44.764223 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac897e-957c-480a-b0f3-9d1dc5de3ac2 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:44.777699 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac897e-957c-480a-b0f3-9d1dc5de3ac2 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:44.780092 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac897e-957c-480a-b0f3-9d1dc5de3ac2 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:44.800146 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-a2ac897e-957c-480a-b0f3-9d1dc5de3ac2 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 05 14:39:44.802108 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 263/547] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:44.807914 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58786691-74f1-432f-aafa-8c4b176d3ea2 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:44.826113 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58786691-74f1-432f-aafa-8c4b176d3ea2 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:44.833740 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80910b7e-0d1c-40f7-b481-13b6809a1aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:44.834412 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80910b7e-0d1c-40f7-b481-13b6809a1aaa admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:44.834699 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80910b7e-0d1c-40f7-b481-13b6809a1aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:44.834978 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80910b7e-0d1c-40f7-b481-13b6809a1aaa admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:44.835830 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80910b7e-0d1c-40f7-b481-13b6809a1aaa admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:44.836138 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80910b7e-0d1c-40f7-b481-13b6809a1aaa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:44.838055 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80910b7e-0d1c-40f7-b481-13b6809a1aaa admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:44.840374 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccafd3-b222-4f31-a07d-ca4a8b99d295 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:44.840905 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccafd3-b222-4f31-a07d-ca4a8b99d295 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:44.841406 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccafd3-b222-4f31-a07d-ca4a8b99d295 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:44.843686 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 264/548] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 14:39:44.848186 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c68a03-f309-41b2-ab7b-e4e70d902540 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:44.848479 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c68a03-f309-41b2-ab7b-e4e70d902540 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:44.848758 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c68a03-f309-41b2-ab7b-e4e70d902540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:44.866039 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 285/549] 10.222.0.30 () {56 vars in 1158 bytes} [Wed Jan 5 14:39:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:44.871516 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80910b7e-0d1c-40f7-b481-13b6809a1aaa admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:44.887039 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80910b7e-0d1c-40f7-b481-13b6809a1aaa admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:44.888546 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-d7c68a03-f309-41b2-ab7b-e4e70d902540 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:44.889862 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-d7c68a03-f309-41b2-ab7b-e4e70d902540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:44.897714 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed9156-5b7c-49c1-a240-ff9726276b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:44.898508 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed9156-5b7c-49c1-a240-ff9726276b14 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:44.900592 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed9156-5b7c-49c1-a240-ff9726276b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:44.900880 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed9156-5b7c-49c1-a240-ff9726276b14 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:44.906749 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 265/550] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:39:44.915052 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed9156-5b7c-49c1-a240-ff9726276b14 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:44.917565 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed9156-5b7c-49c1-a240-ff9726276b14 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:44.934265 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c68a03-f309-41b2-ab7b-e4e70d902540 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:44.944739 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c68a03-f309-41b2-ab7b-e4e70d902540 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:44.955836 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daeb8c6-0317-45a5-8494-0bf6e0e696d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:44.956637 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daeb8c6-0317-45a5-8494-0bf6e0e696d4 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:44.956979 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daeb8c6-0317-45a5-8494-0bf6e0e696d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:44.957280 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daeb8c6-0317-45a5-8494-0bf6e0e696d4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:44.966110 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-6fed9156-5b7c-49c1-a240-ff9726276b14 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:44.967090 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 286/551] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:39:44.973001 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed9156-5b7c-49c1-a240-ff9726276b14 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:44.986236 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daeb8c6-0317-45a5-8494-0bf6e0e696d4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:44.995289 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed9156-5b7c-49c1-a240-ff9726276b14 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:44.998936 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-6daeb8c6-0317-45a5-8494-0bf6e0e696d4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 05 14:39:45.000722 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 266/552] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Jan 5 14:39:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:39:45.006790 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08b8e1-1188-4bfe-9b52-39f1d07f40fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:45.007460 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08b8e1-1188-4bfe-9b52-39f1d07f40fd admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.007797 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08b8e1-1188-4bfe-9b52-39f1d07f40fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.008080 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08b8e1-1188-4bfe-9b52-39f1d07f40fd admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.008830 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08b8e1-1188-4bfe-9b52-39f1d07f40fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:45.009217 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08b8e1-1188-4bfe-9b52-39f1d07f40fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:45.011465 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08b8e1-1188-4bfe-9b52-39f1d07f40fd admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:45.023435 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daeb8c6-0317-45a5-8494-0bf6e0e696d4 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:45.027882 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 287/553] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:45.029269 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e0277-3590-4625-b696-0adbf73296f6 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.029590 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e0277-3590-4625-b696-0adbf73296f6 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.029865 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e0277-3590-4625-b696-0adbf73296f6 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.031534 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 288/554] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:45.034081 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e0277-3590-4625-b696-0adbf73296f6 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:45.042644 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daeb8c6-0317-45a5-8494-0bf6e0e696d4 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:45.047973 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e0277-3590-4625-b696-0adbf73296f6 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:45.048154 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ba26c-6b64-4954-ae48-d6d3b319dc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:45.048699 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ba26c-6b64-4954-ae48-d6d3b319dc59 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.048986 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ba26c-6b64-4954-ae48-d6d3b319dc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.049409 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ba26c-6b64-4954-ae48-d6d3b319dc59 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.050229 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ba26c-6b64-4954-ae48-d6d3b319dc59 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:45.050541 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ba26c-6b64-4954-ae48-d6d3b319dc59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:45.052155 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ba26c-6b64-4954-ae48-d6d3b319dc59 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:45.052971 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d10ff-06ce-46a6-9d16-b10aa22821ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:45.053806 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d10ff-06ce-46a6-9d16-b10aa22821ee admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.054087 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d10ff-06ce-46a6-9d16-b10aa22821ee admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.054416 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d10ff-06ce-46a6-9d16-b10aa22821ee admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.062229 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d10ff-06ce-46a6-9d16-b10aa22821ee admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:45.062681 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 267/555] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Jan 5 14:39:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:45.063949 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568252e8-612b-4431-a989-148d62350222 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.064232 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568252e8-612b-4431-a989-148d62350222 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.064503 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568252e8-612b-4431-a989-148d62350222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.068629 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d10ff-06ce-46a6-9d16-b10aa22821ee admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:45.083590 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-747d10ff-06ce-46a6-9d16-b10aa22821ee admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:39:45.084840 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 289/556] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:39:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:45.085829 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-568252e8-612b-4431-a989-148d62350222 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:45.087074 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-568252e8-612b-4431-a989-148d62350222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:45.089730 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d10ff-06ce-46a6-9d16-b10aa22821ee admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:45.096291 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 268/557] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:45.097273 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568252e8-612b-4431-a989-148d62350222 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:45.108192 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d10ff-06ce-46a6-9d16-b10aa22821ee admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:45.117847 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c5e5a-ae5a-4a84-9f0c-7291375c824b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:45.119659 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568252e8-612b-4431-a989-148d62350222 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:45.120040 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c5e5a-ae5a-4a84-9f0c-7291375c824b admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.120376 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c5e5a-ae5a-4a84-9f0c-7291375c824b admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.120656 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c5e5a-ae5a-4a84-9f0c-7291375c824b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.127700 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9d9cb-14dc-4e9c-8aed-7566230865bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:45.128344 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9d9cb-14dc-4e9c-8aed-7566230865bb admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.128631 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9d9cb-14dc-4e9c-8aed-7566230865bb admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.128883 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9d9cb-14dc-4e9c-8aed-7566230865bb admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.129701 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9d9cb-14dc-4e9c-8aed-7566230865bb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:45.130036 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9d9cb-14dc-4e9c-8aed-7566230865bb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:45.131870 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9d9cb-14dc-4e9c-8aed-7566230865bb admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:45.133699 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c5e5a-ae5a-4a84-9f0c-7291375c824b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:45.135579 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c5e5a-ae5a-4a84-9f0c-7291375c824b admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:45.144609 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 269/558] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:39:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:45.144739 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9d9cb-14dc-4e9c-8aed-7566230865bb admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:45.154716 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9d9cb-14dc-4e9c-8aed-7566230865bb admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:45.157972 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-032c5e5a-ae5a-4a84-9f0c-7291375c824b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:45.159325 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 290/559] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:45.159430 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ef33f-bdd4-4b21-a6e6-ca925b052984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:45.160066 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ef33f-bdd4-4b21-a6e6-ca925b052984 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.163207 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ef33f-bdd4-4b21-a6e6-ca925b052984 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.163207 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ef33f-bdd4-4b21-a6e6-ca925b052984 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.163450 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34582e-8ab3-4dc6-a936-daa654600718 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.163450 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34582e-8ab3-4dc6-a936-daa654600718 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.163450 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34582e-8ab3-4dc6-a936-daa654600718 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.164363 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 291/560] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:45.166580 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34582e-8ab3-4dc6-a936-daa654600718 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:45.175203 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ef33f-bdd4-4b21-a6e6-ca925b052984 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:45.180802 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34582e-8ab3-4dc6-a936-daa654600718 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:45.182629 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-ff6ef33f-bdd4-4b21-a6e6-ca925b052984 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 05 14:39:45.188481 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 270/561] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Jan 5 14:39:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:45.188481 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ef33f-bdd4-4b21-a6e6-ca925b052984 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:45.190151 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb304a-6346-45e0-9f29-962e8ca80610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:45.190996 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb304a-6346-45e0-9f29-962e8ca80610 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.191273 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb304a-6346-45e0-9f29-962e8ca80610 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.191542 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb304a-6346-45e0-9f29-962e8ca80610 admin admin] PATH_INFO: `/v3/projects/fbf90e947f3a4fcdb6f42646a4bf34a1/users/935ad716e4624c25bc34308f05eb1526/roles/9868670385c0469093001f6f2c310f1a` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.198985 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ef33f-bdd4-4b21-a6e6-ca925b052984 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:45.203525 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc14578-8fd0-4c59-bdb9-3cd1167c4374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:45.204165 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc14578-8fd0-4c59-bdb9-3cd1167c4374 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.204425 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc14578-8fd0-4c59-bdb9-3cd1167c4374 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.204700 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc14578-8fd0-4c59-bdb9-3cd1167c4374 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.205454 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc14578-8fd0-4c59-bdb9-3cd1167c4374 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:45.205762 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc14578-8fd0-4c59-bdb9-3cd1167c4374 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:45.206141 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb304a-6346-45e0-9f29-962e8ca80610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf90e947f3a4fcdb6f42646a4bf34a1, user_id=935ad716e4624c25bc34308f05eb1526, role_id=9868670385c0469093001f6f2c310f1a)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:45.207355 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc14578-8fd0-4c59-bdb9-3cd1167c4374 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:45.208773 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb304a-6346-45e0-9f29-962e8ca80610 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:45.219050 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 271/562] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:45.220226 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed1b9f-0590-4493-bf72-8d9b65266bb1 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.220510 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed1b9f-0590-4493-bf72-8d9b65266bb1 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.220783 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed1b9f-0590-4493-bf72-8d9b65266bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.237977 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-8eed1b9f-0590-4493-bf72-8d9b65266bb1 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:45.239129 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-8eed1b9f-0590-4493-bf72-8d9b65266bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:45.246520 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 272/563] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:45.255022 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed1b9f-0590-4493-bf72-8d9b65266bb1 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:45.256053 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed1b9f-0590-4493-bf72-8d9b65266bb1 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:45.260322 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053de1b-879b-4011-83cf-0d2231b8bf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:45.260938 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053de1b-879b-4011-83cf-0d2231b8bf96 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.261254 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053de1b-879b-4011-83cf-0d2231b8bf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.261529 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053de1b-879b-4011-83cf-0d2231b8bf96 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.262252 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053de1b-879b-4011-83cf-0d2231b8bf96 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:45.262566 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053de1b-879b-4011-83cf-0d2231b8bf96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:45.264115 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053de1b-879b-4011-83cf-0d2231b8bf96 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:45.271983 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 273/564] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Jan 5 14:39:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:45.272735 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053de1b-879b-4011-83cf-0d2231b8bf96 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:45.282183 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 292/565] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Jan 5 14:39:45 2022] PUT /identity/v3/projects/fbf90e947f3a4fcdb6f42646a4bf34a1/users/935ad716e4624c25bc34308f05eb1526/roles/9868670385c0469093001f6f2c310f1a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:39:45.283116 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb304a-6346-45e0-9f29-962e8ca80610 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:45.283232 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053de1b-879b-4011-83cf-0d2231b8bf96 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:45.349077 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af05552-e580-4b5a-b326-2832defe93d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:45.349902 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af05552-e580-4b5a-b326-2832defe93d6 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.350183 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af05552-e580-4b5a-b326-2832defe93d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.350460 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af05552-e580-4b5a-b326-2832defe93d6 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.358709 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb304a-6346-45e0-9f29-962e8ca80610 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:45.359503 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af05552-e580-4b5a-b326-2832defe93d6 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:45.361655 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af05552-e580-4b5a-b326-2832defe93d6 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:45.363956 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39333024-a8c5-4e59-913a-2738534bf6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:45.364887 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39333024-a8c5-4e59-913a-2738534bf6de admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.365298 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39333024-a8c5-4e59-913a-2738534bf6de admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.365695 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39333024-a8c5-4e59-913a-2738534bf6de admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.376927 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-3af05552-e580-4b5a-b326-2832defe93d6 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 05 14:39:45.378672 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 274/566] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:45.379224 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af05552-e580-4b5a-b326-2832defe93d6 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:45.381472 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39333024-a8c5-4e59-913a-2738534bf6de admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:45.388838 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-39333024-a8c5-4e59-913a-2738534bf6de admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 05 14:39:45.390387 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 293/567] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Jan 5 14:39:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:45.391159 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39333024-a8c5-4e59-913a-2738534bf6de admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:45.404626 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af05552-e580-4b5a-b326-2832defe93d6 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:45.406148 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39333024-a8c5-4e59-913a-2738534bf6de admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:45.409996 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4fc90-abcb-4d01-978c-18fcddea33f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:45.410618 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9ce7a-47d3-4c87-9381-5335f999c487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:45.410919 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4fc90-abcb-4d01-978c-18fcddea33f9 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.411218 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4fc90-abcb-4d01-978c-18fcddea33f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.411489 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9ce7a-47d3-4c87-9381-5335f999c487 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.411644 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4fc90-abcb-4d01-978c-18fcddea33f9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.411785 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9ce7a-47d3-4c87-9381-5335f999c487 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.411785 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9ce7a-47d3-4c87-9381-5335f999c487 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.412643 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9ce7a-47d3-4c87-9381-5335f999c487 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:45.412950 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9ce7a-47d3-4c87-9381-5335f999c487 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:45.414866 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9ce7a-47d3-4c87-9381-5335f999c487 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:45.425431 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f4fc90-abcb-4d01-978c-18fcddea33f9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:45.428437 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f4fc90-abcb-4d01-978c-18fcddea33f9 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:45.435268 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 294/568] 10.222.0.30 () {56 vars in 1158 bytes} [Wed Jan 5 14:39:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:45.436274 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9ce7a-47d3-4c87-9381-5335f999c487 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:45.449846 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9ce7a-47d3-4c87-9381-5335f999c487 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:45.454666 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f51fd-cd49-44ae-bfe8-f493cd7cdf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:45.454861 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-d0f4fc90-abcb-4d01-978c-18fcddea33f9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:45.455569 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f51fd-cd49-44ae-bfe8-f493cd7cdf31 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.455916 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f51fd-cd49-44ae-bfe8-f493cd7cdf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.456215 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 275/569] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:45.456354 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f51fd-cd49-44ae-bfe8-f493cd7cdf31 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.457018 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4fc90-abcb-4d01-978c-18fcddea33f9 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:45.457263 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f51fd-cd49-44ae-bfe8-f493cd7cdf31 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:45.457627 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f51fd-cd49-44ae-bfe8-f493cd7cdf31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:45.459470 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f51fd-cd49-44ae-bfe8-f493cd7cdf31 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:45.469178 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4fc90-abcb-4d01-978c-18fcddea33f9 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:45.470087 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 295/570] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Jan 5 14:39:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:45.471058 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f51fd-cd49-44ae-bfe8-f493cd7cdf31 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:45.480629 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3c70e-9c40-449f-be70-6336d2d7dd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:45.482300 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3c70e-9c40-449f-be70-6336d2d7dd09 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.482872 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3c70e-9c40-449f-be70-6336d2d7dd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.483191 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3c70e-9c40-449f-be70-6336d2d7dd09 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.484929 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f51fd-cd49-44ae-bfe8-f493cd7cdf31 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:45.501089 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27816ab-f021-479a-8a69-f6d952aac9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:45.501089 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27816ab-f021-479a-8a69-f6d952aac9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.501089 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27816ab-f021-479a-8a69-f6d952aac9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.501089 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27816ab-f021-479a-8a69-f6d952aac9b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.501539 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27816ab-f021-479a-8a69-f6d952aac9b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:45.501539 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27816ab-f021-479a-8a69-f6d952aac9b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:45.501539 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27816ab-f021-479a-8a69-f6d952aac9b1 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:45.501768 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3c70e-9c40-449f-be70-6336d2d7dd09 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:45.501768 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3c70e-9c40-449f-be70-6336d2d7dd09 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:45.507992 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 296/571] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:45.511645 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27816ab-f021-479a-8a69-f6d952aac9b1 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:45.519716 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27816ab-f021-479a-8a69-f6d952aac9b1 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:45.520086 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-26a3c70e-9c40-449f-be70-6336d2d7dd09 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:45.521676 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 276/572] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:45.526246 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3c70e-9c40-449f-be70-6336d2d7dd09 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:45.531267 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf2dba-30e9-4c4b-9ca0-efaee8646d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:45.532138 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf2dba-30e9-4c4b-9ca0-efaee8646d27 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.532430 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf2dba-30e9-4c4b-9ca0-efaee8646d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.533035 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf2dba-30e9-4c4b-9ca0-efaee8646d27 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.538059 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3c70e-9c40-449f-be70-6336d2d7dd09 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:45.547300 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc15b8-0cc0-4e32-b19d-84a07b0ac2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:45.548113 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc15b8-0cc0-4e32-b19d-84a07b0ac2db admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.548399 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc15b8-0cc0-4e32-b19d-84a07b0ac2db admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.548675 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc15b8-0cc0-4e32-b19d-84a07b0ac2db admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.551827 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf2dba-30e9-4c4b-9ca0-efaee8646d27 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:45.553880 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf2dba-30e9-4c4b-9ca0-efaee8646d27 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:45.562317 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc15b8-0cc0-4e32-b19d-84a07b0ac2db admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:45.564380 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc15b8-0cc0-4e32-b19d-84a07b0ac2db admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:45.577734 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-a4cf2dba-30e9-4c4b-9ca0-efaee8646d27 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:45.579206 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 297/573] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:45.580163 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf2dba-30e9-4c4b-9ca0-efaee8646d27 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:45.582913 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-a3dc15b8-0cc0-4e32-b19d-84a07b0ac2db admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 05 14:39:45.585278 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 277/574] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Jan 5 14:39:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:45.586450 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc15b8-0cc0-4e32-b19d-84a07b0ac2db admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:45.591768 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf2dba-30e9-4c4b-9ca0-efaee8646d27 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:45.596819 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48b74b-122c-4bed-863b-23ec06b4f458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:45.598539 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48b74b-122c-4bed-863b-23ec06b4f458 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.598675 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc15b8-0cc0-4e32-b19d-84a07b0ac2db admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:45.598755 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48b74b-122c-4bed-863b-23ec06b4f458 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.598755 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48b74b-122c-4bed-863b-23ec06b4f458 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.598903 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48b74b-122c-4bed-863b-23ec06b4f458 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:45.599174 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48b74b-122c-4bed-863b-23ec06b4f458 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:45.600888 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48b74b-122c-4bed-863b-23ec06b4f458 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:45.605845 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5f334-5486-4881-956c-b7ebe2ffa65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:45.606505 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5f334-5486-4881-956c-b7ebe2ffa65c admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.606790 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5f334-5486-4881-956c-b7ebe2ffa65c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.607128 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5f334-5486-4881-956c-b7ebe2ffa65c admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.608334 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5f334-5486-4881-956c-b7ebe2ffa65c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:45.608645 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5f334-5486-4881-956c-b7ebe2ffa65c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:45.611058 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5f334-5486-4881-956c-b7ebe2ffa65c admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:45.612941 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 298/575] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:45.613861 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48b74b-122c-4bed-863b-23ec06b4f458 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:45.624230 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48b74b-122c-4bed-863b-23ec06b4f458 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:45.624427 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 278/576] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:45.624848 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5f334-5486-4881-956c-b7ebe2ffa65c admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:45.630048 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fc5e2-c33e-4da4-b963-7586a0177872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:45.630687 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fc5e2-c33e-4da4-b963-7586a0177872 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.630970 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fc5e2-c33e-4da4-b963-7586a0177872 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.631244 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fc5e2-c33e-4da4-b963-7586a0177872 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.632469 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953fc5e2-c33e-4da4-b963-7586a0177872 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:45.632576 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953fc5e2-c33e-4da4-b963-7586a0177872 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:45.634948 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953fc5e2-c33e-4da4-b963-7586a0177872 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:45.635654 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5f334-5486-4881-956c-b7ebe2ffa65c admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:45.641448 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789de35-745c-4366-bb52-e1c4bcf48ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:45.642274 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789de35-745c-4366-bb52-e1c4bcf48ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.642558 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789de35-745c-4366-bb52-e1c4bcf48ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.642831 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789de35-745c-4366-bb52-e1c4bcf48ed0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.653730 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0789de35-745c-4366-bb52-e1c4bcf48ed0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:45.656244 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0789de35-745c-4366-bb52-e1c4bcf48ed0 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:45.656988 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 299/577] 10.222.0.30 () {56 vars in 1154 bytes} [Wed Jan 5 14:39:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:45.662129 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fc5e2-c33e-4da4-b963-7586a0177872 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:45.673120 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fc5e2-c33e-4da4-b963-7586a0177872 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:45.673314 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-0789de35-745c-4366-bb52-e1c4bcf48ed0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:39:45.674946 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 279/578] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:39:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:45.675738 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789de35-745c-4366-bb52-e1c4bcf48ed0 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:45.682373 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf2115-2659-45f1-9c21-81d5fe1159e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:45.683433 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf2115-2659-45f1-9c21-81d5fe1159e8 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.683898 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf2115-2659-45f1-9c21-81d5fe1159e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.684374 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf2115-2659-45f1-9c21-81d5fe1159e8 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.685629 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789de35-745c-4366-bb52-e1c4bcf48ed0 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:45.691020 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7b923-8756-4153-bc66-708b8ad74a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:45.691792 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7b923-8756-4153-bc66-708b8ad74a48 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.692131 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7b923-8756-4153-bc66-708b8ad74a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.692419 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7b923-8756-4153-bc66-708b8ad74a48 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.694053 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf2115-2659-45f1-9c21-81d5fe1159e8 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:45.696532 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf2115-2659-45f1-9c21-81d5fe1159e8 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:45.705529 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7b923-8756-4153-bc66-708b8ad74a48 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:45.707443 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7b923-8756-4153-bc66-708b8ad74a48 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:45.713631 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-76cf2115-2659-45f1-9c21-81d5fe1159e8 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 05 14:39:45.715318 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 300/579] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Jan 5 14:39:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:45.720663 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf2115-2659-45f1-9c21-81d5fe1159e8 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:45.727292 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-07a7b923-8756-4153-bc66-708b8ad74a48 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:45.729881 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 280/580] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:45.731254 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf2115-2659-45f1-9c21-81d5fe1159e8 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:45.731391 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7b923-8756-4153-bc66-708b8ad74a48 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:45.736468 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b87658-595b-4da2-bc87-6043dc1ce13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:45.737605 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b87658-595b-4da2-bc87-6043dc1ce13a admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.738130 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b87658-595b-4da2-bc87-6043dc1ce13a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.738626 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b87658-595b-4da2-bc87-6043dc1ce13a admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.739630 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b87658-595b-4da2-bc87-6043dc1ce13a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:45.740226 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b87658-595b-4da2-bc87-6043dc1ce13a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:45.742500 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b87658-595b-4da2-bc87-6043dc1ce13a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:45.747008 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7b923-8756-4153-bc66-708b8ad74a48 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:45.752757 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c2076-d691-4f18-8461-3dba61cf638b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:45.753926 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c2076-d691-4f18-8461-3dba61cf638b admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.754271 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c2076-d691-4f18-8461-3dba61cf638b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.754554 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c2076-d691-4f18-8461-3dba61cf638b admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.755745 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c2076-d691-4f18-8461-3dba61cf638b admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:45.756157 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c2076-d691-4f18-8461-3dba61cf638b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:45.762800 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 301/581] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:39:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:45.762937 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c2076-d691-4f18-8461-3dba61cf638b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:45.764282 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b87658-595b-4da2-bc87-6043dc1ce13a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:45.774014 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b87658-595b-4da2-bc87-6043dc1ce13a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:45.779040 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61618e76-a723-4628-b8ce-c388ba77f524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:45.779169 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 281/582] 10.222.0.30 () {56 vars in 1160 bytes} [Wed Jan 5 14:39:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:45.779929 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c2076-d691-4f18-8461-3dba61cf638b admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:45.780421 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61618e76-a723-4628-b8ce-c388ba77f524 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.780908 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61618e76-a723-4628-b8ce-c388ba77f524 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.781419 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61618e76-a723-4628-b8ce-c388ba77f524 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.782366 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61618e76-a723-4628-b8ce-c388ba77f524 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:45.782871 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61618e76-a723-4628-b8ce-c388ba77f524 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:45.784770 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61618e76-a723-4628-b8ce-c388ba77f524 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:45.791195 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c2076-d691-4f18-8461-3dba61cf638b admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:45.797297 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f72a5-ab8a-4abc-9baf-1a184fde42e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:45.798246 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f72a5-ab8a-4abc-9baf-1a184fde42e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.798531 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f72a5-ab8a-4abc-9baf-1a184fde42e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.798866 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f72a5-ab8a-4abc-9baf-1a184fde42e4 admin admin] PATH_INFO: `/v3/projects/fbf90e947f3a4fcdb6f42646a4bf34a1/users/541bd71b355d4b7ca35372e11be54be3/roles/9868670385c0469093001f6f2c310f1a` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.799908 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 302/583] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:45.801219 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61618e76-a723-4628-b8ce-c388ba77f524 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:45.811442 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61618e76-a723-4628-b8ce-c388ba77f524 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:45.816266 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f72a5-ab8a-4abc-9baf-1a184fde42e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf90e947f3a4fcdb6f42646a4bf34a1, user_id=541bd71b355d4b7ca35372e11be54be3, role_id=9868670385c0469093001f6f2c310f1a)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:45.816780 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428eaed-f61d-49ec-b83e-36bed5a0ef9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:45.817841 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428eaed-f61d-49ec-b83e-36bed5a0ef9e admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.818340 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428eaed-f61d-49ec-b83e-36bed5a0ef9e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.818813 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428eaed-f61d-49ec-b83e-36bed5a0ef9e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.819145 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f72a5-ab8a-4abc-9baf-1a184fde42e4 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:45.829873 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428eaed-f61d-49ec-b83e-36bed5a0ef9e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:45.841140 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428eaed-f61d-49ec-b83e-36bed5a0ef9e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:45.849187 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-f428eaed-f61d-49ec-b83e-36bed5a0ef9e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:45.850523 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 303/584] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:45.851110 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428eaed-f61d-49ec-b83e-36bed5a0ef9e admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:45.860696 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428eaed-f61d-49ec-b83e-36bed5a0ef9e admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:45.865451 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29e0bd-7a7a-4209-9967-3c606a430488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:45.869255 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29e0bd-7a7a-4209-9967-3c606a430488 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:45.869255 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29e0bd-7a7a-4209-9967-3c606a430488 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:45.869255 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29e0bd-7a7a-4209-9967-3c606a430488 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:45.874913 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29e0bd-7a7a-4209-9967-3c606a430488 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:45.877047 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29e0bd-7a7a-4209-9967-3c606a430488 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:45.894000 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-2e29e0bd-7a7a-4209-9967-3c606a430488 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:39:45.895418 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 282/585] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Jan 5 14:39:45 2022] PUT /identity/v3/projects/fbf90e947f3a4fcdb6f42646a4bf34a1/users/541bd71b355d4b7ca35372e11be54be3/roles/9868670385c0469093001f6f2c310f1a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:39:45.901231 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f72a5-ab8a-4abc-9baf-1a184fde42e4 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:45.901404 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 304/586] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:39:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:45.909376 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29e0bd-7a7a-4209-9967-3c606a430488 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:45.929830 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29e0bd-7a7a-4209-9967-3c606a430488 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:46.025388 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc45a09-f55a-4c26-bb10-1a8d77dc36be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:46.026058 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc45a09-f55a-4c26-bb10-1a8d77dc36be admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:46.026337 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc45a09-f55a-4c26-bb10-1a8d77dc36be admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:46.026604 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc45a09-f55a-4c26-bb10-1a8d77dc36be admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:46.027411 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc45a09-f55a-4c26-bb10-1a8d77dc36be admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:46.027714 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc45a09-f55a-4c26-bb10-1a8d77dc36be admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:46.030768 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc45a09-f55a-4c26-bb10-1a8d77dc36be admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:46.036652 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f72a5-ab8a-4abc-9baf-1a184fde42e4 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:46.048377 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b237615-7454-4b45-ac66-a76dca2752e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:46.049044 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b237615-7454-4b45-ac66-a76dca2752e6 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:46.049349 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b237615-7454-4b45-ac66-a76dca2752e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:46.049622 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b237615-7454-4b45-ac66-a76dca2752e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:46.050364 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b237615-7454-4b45-ac66-a76dca2752e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:46.050666 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b237615-7454-4b45-ac66-a76dca2752e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:46.052336 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b237615-7454-4b45-ac66-a76dca2752e6 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:46.056947 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 305/587] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:39:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:46.062581 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc45a09-f55a-4c26-bb10-1a8d77dc36be admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:46.075967 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc45a09-f55a-4c26-bb10-1a8d77dc36be admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:46.078564 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 283/588] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:46.082988 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30029760-1bd2-419d-a1a1-ed779af694d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:46.084001 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30029760-1bd2-419d-a1a1-ed779af694d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:46.085018 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b237615-7454-4b45-ac66-a76dca2752e6 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:46.090576 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30029760-1bd2-419d-a1a1-ed779af694d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:46.091301 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30029760-1bd2-419d-a1a1-ed779af694d4 admin admin] PATH_INFO: `/v3/projects/fbf90e947f3a4fcdb6f42646a4bf34a1/users/77db235e2f7046e4bdbad7f31b5e3ebc/roles/9868670385c0469093001f6f2c310f1a` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:46.099530 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b237615-7454-4b45-ac66-a76dca2752e6 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:46.110970 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e3430-4e07-4145-8c16-f112703b68b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:46.112005 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e3430-4e07-4145-8c16-f112703b68b2 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:46.112283 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e3430-4e07-4145-8c16-f112703b68b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:46.112555 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e3430-4e07-4145-8c16-f112703b68b2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:46.122068 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30029760-1bd2-419d-a1a1-ed779af694d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf90e947f3a4fcdb6f42646a4bf34a1, user_id=77db235e2f7046e4bdbad7f31b5e3ebc, role_id=9868670385c0469093001f6f2c310f1a)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:46.124423 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e3430-4e07-4145-8c16-f112703b68b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:46.125134 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30029760-1bd2-419d-a1a1-ed779af694d4 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:46.130746 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e3430-4e07-4145-8c16-f112703b68b2 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:46.150716 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-e03e3430-4e07-4145-8c16-f112703b68b2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:39:46.152494 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 284/589] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:39:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:46.153984 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d8548-1a00-49e6-99ee-8b256cb8edbc None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:46.154628 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d8548-1a00-49e6-99ee-8b256cb8edbc None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:46.155159 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d8548-1a00-49e6-99ee-8b256cb8edbc None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:46.157059 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 285/590] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:46.157792 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d8548-1a00-49e6-99ee-8b256cb8edbc None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:46.173121 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d8548-1a00-49e6-99ee-8b256cb8edbc None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:46.178486 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb41736-341e-4bb3-8df9-081f9277987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:46.178486 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb41736-341e-4bb3-8df9-081f9277987b admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:46.178773 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb41736-341e-4bb3-8df9-081f9277987b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:46.179063 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb41736-341e-4bb3-8df9-081f9277987b admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:46.179853 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb41736-341e-4bb3-8df9-081f9277987b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:46.180157 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb41736-341e-4bb3-8df9-081f9277987b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:46.182059 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb41736-341e-4bb3-8df9-081f9277987b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:46.191562 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 306/591] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Jan 5 14:39:46 2022] PUT /identity/v3/projects/fbf90e947f3a4fcdb6f42646a4bf34a1/users/77db235e2f7046e4bdbad7f31b5e3ebc/roles/9868670385c0469093001f6f2c310f1a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 14:39:46.193548 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78438e7-b11e-4869-a682-9621a2702407 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:46.195606 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78438e7-b11e-4869-a682-9621a2702407 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:46.195606 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78438e7-b11e-4869-a682-9621a2702407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:46.195779 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 286/592] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:39:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:46.201055 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb41736-341e-4bb3-8df9-081f9277987b admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:46.217962 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb41736-341e-4bb3-8df9-081f9277987b admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:46.220931 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-f78438e7-b11e-4869-a682-9621a2702407 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:46.222434 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-f78438e7-b11e-4869-a682-9621a2702407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:46.296811 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e443c83-859d-4da0-ad6f-7cd313addda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:46.297889 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e443c83-859d-4da0-ad6f-7cd313addda4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:46.298176 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e443c83-859d-4da0-ad6f-7cd313addda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:46.298464 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e443c83-859d-4da0-ad6f-7cd313addda4 admin admin] PATH_INFO: `/v3/projects/fbf90e947f3a4fcdb6f42646a4bf34a1/users/a6234d716a014808a8a4eb22b903bbc9/roles/9868670385c0469093001f6f2c310f1a` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:46.300893 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 307/593] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:46.314277 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e443c83-859d-4da0-ad6f-7cd313addda4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf90e947f3a4fcdb6f42646a4bf34a1, user_id=a6234d716a014808a8a4eb22b903bbc9, role_id=9868670385c0469093001f6f2c310f1a)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:46.317004 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e443c83-859d-4da0-ad6f-7cd313addda4 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:46.327586 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78438e7-b11e-4869-a682-9621a2702407 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:46.338756 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78438e7-b11e-4869-a682-9621a2702407 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:46.344276 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54af76-5f16-4397-a101-db82e55dfe4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:46.345532 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54af76-5f16-4397-a101-db82e55dfe4b admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:46.346065 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54af76-5f16-4397-a101-db82e55dfe4b admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:46.346536 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54af76-5f16-4397-a101-db82e55dfe4b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:46.360103 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb54af76-5f16-4397-a101-db82e55dfe4b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:46.368289 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-bb54af76-5f16-4397-a101-db82e55dfe4b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 05 14:39:46.370433 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 308/594] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Jan 5 14:39:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:39:46.376904 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54af76-5f16-4397-a101-db82e55dfe4b admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:46.388391 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54af76-5f16-4397-a101-db82e55dfe4b admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:46.393836 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfc780-11e4-4c85-b965-c1d266e3ee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:46.395332 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfc780-11e4-4c85-b965-c1d266e3ee6b admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:46.395888 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfc780-11e4-4c85-b965-c1d266e3ee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:46.396359 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfc780-11e4-4c85-b965-c1d266e3ee6b admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:46.397441 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfc780-11e4-4c85-b965-c1d266e3ee6b admin admin] RBAC: Adding query filter params (name=service) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:46.397969 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfc780-11e4-4c85-b965-c1d266e3ee6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:46.400107 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfc780-11e4-4c85-b965-c1d266e3ee6b admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:46.411090 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 309/595] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Jan 5 14:39:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:46.416129 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 287/596] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Jan 5 14:39:46 2022] PUT /identity/v3/projects/fbf90e947f3a4fcdb6f42646a4bf34a1/users/a6234d716a014808a8a4eb22b903bbc9/roles/9868670385c0469093001f6f2c310f1a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 14:39:46.418415 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfc780-11e4-4c85-b965-c1d266e3ee6b admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:46.430328 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfc780-11e4-4c85-b965-c1d266e3ee6b admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:46.499104 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a7437-6656-422a-be6a-10505dd50a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:46.500418 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a7437-6656-422a-be6a-10505dd50a8a admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:46.500929 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a7437-6656-422a-be6a-10505dd50a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:46.501439 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a7437-6656-422a-be6a-10505dd50a8a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:46.518176 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a7437-6656-422a-be6a-10505dd50a8a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:46.520755 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a7437-6656-422a-be6a-10505dd50a8a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:46.540719 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-2e2a7437-6656-422a-be6a-10505dd50a8a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:46.542374 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 310/597] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 125 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:39:46.550209 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e443c83-859d-4da0-ad6f-7cd313addda4 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:46.570798 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e443c83-859d-4da0-ad6f-7cd313addda4 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:46.575756 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669eb5b5-2aa5-446f-ac59-091f045d6693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:46.576439 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669eb5b5-2aa5-446f-ac59-091f045d6693 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:46.576724 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669eb5b5-2aa5-446f-ac59-091f045d6693 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:46.577000 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669eb5b5-2aa5-446f-ac59-091f045d6693 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:46.577931 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669eb5b5-2aa5-446f-ac59-091f045d6693 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:46.578241 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669eb5b5-2aa5-446f-ac59-091f045d6693 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:46.579944 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669eb5b5-2aa5-446f-ac59-091f045d6693 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:46.595988 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 288/598] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:46.601001 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a7437-6656-422a-be6a-10505dd50a8a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:46.612838 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a7437-6656-422a-be6a-10505dd50a8a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:46.617945 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29d843-1f43-4183-8489-8a89b1586b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:46.619212 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29d843-1f43-4183-8489-8a89b1586b51 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:46.619503 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29d843-1f43-4183-8489-8a89b1586b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:46.619784 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29d843-1f43-4183-8489-8a89b1586b51 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:46.628606 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29d843-1f43-4183-8489-8a89b1586b51 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:46.630761 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29d843-1f43-4183-8489-8a89b1586b51 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:46.647126 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-9a29d843-1f43-4183-8489-8a89b1586b51 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 05 14:39:46.648711 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 311/599] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:39:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:39:46.654551 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669eb5b5-2aa5-446f-ac59-091f045d6693 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:46.666010 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669eb5b5-2aa5-446f-ac59-091f045d6693 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:46.671114 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4dc380-3e98-4bed-a2eb-914e4f949971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:46.671870 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dc380-3e98-4bed-a2eb-914e4f949971 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:46.672161 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dc380-3e98-4bed-a2eb-914e4f949971 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:46.672493 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dc380-3e98-4bed-a2eb-914e4f949971 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:46.673523 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4dc380-3e98-4bed-a2eb-914e4f949971 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:46.673852 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4dc380-3e98-4bed-a2eb-914e4f949971 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:46.676037 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4dc380-3e98-4bed-a2eb-914e4f949971 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:46.701388 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 289/600] 10.222.0.30 () {56 vars in 1156 bytes} [Wed Jan 5 14:39:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:46.706517 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29d843-1f43-4183-8489-8a89b1586b51 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:46.717363 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29d843-1f43-4183-8489-8a89b1586b51 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:46.722084 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13d295-0f9b-4753-81b3-40aeece5287f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:46.722784 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13d295-0f9b-4753-81b3-40aeece5287f admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:46.723149 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13d295-0f9b-4753-81b3-40aeece5287f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:46.723441 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13d295-0f9b-4753-81b3-40aeece5287f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:46.732063 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13d295-0f9b-4753-81b3-40aeece5287f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:46.733975 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13d295-0f9b-4753-81b3-40aeece5287f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:46.743467 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 312/601] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:39:46.749147 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4dc380-3e98-4bed-a2eb-914e4f949971 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:46.767147 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4dc380-3e98-4bed-a2eb-914e4f949971 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:46.772879 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768c47e-c01e-4f50-9685-7d93c4d22e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:46.773752 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768c47e-c01e-4f50-9685-7d93c4d22e7c admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:46.774034 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768c47e-c01e-4f50-9685-7d93c4d22e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:46.774310 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768c47e-c01e-4f50-9685-7d93c4d22e7c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:46.787036 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768c47e-c01e-4f50-9685-7d93c4d22e7c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:46.788882 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768c47e-c01e-4f50-9685-7d93c4d22e7c admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:46.808742 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-6768c47e-c01e-4f50-9685-7d93c4d22e7c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:46.810284 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 290/602] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:39:46.815330 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13d295-0f9b-4753-81b3-40aeece5287f admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:46.830748 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13d295-0f9b-4753-81b3-40aeece5287f admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:46.835335 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59010349-9cb1-4deb-9780-97a94d69f3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:46.836211 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59010349-9cb1-4deb-9780-97a94d69f3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:46.836492 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59010349-9cb1-4deb-9780-97a94d69f3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:46.836768 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59010349-9cb1-4deb-9780-97a94d69f3a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:46.838201 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59010349-9cb1-4deb-9780-97a94d69f3a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:46.838502 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59010349-9cb1-4deb-9780-97a94d69f3a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:46.840151 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59010349-9cb1-4deb-9780-97a94d69f3a7 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:46.858724 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 313/603] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:46.864210 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768c47e-c01e-4f50-9685-7d93c4d22e7c admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:46.878945 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768c47e-c01e-4f50-9685-7d93c4d22e7c admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:46.889109 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5c32a-45b0-4a28-bef3-9c1adcd077f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:46.889918 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5c32a-45b0-4a28-bef3-9c1adcd077f3 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:46.890206 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5c32a-45b0-4a28-bef3-9c1adcd077f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:46.890485 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5c32a-45b0-4a28-bef3-9c1adcd077f3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:46.902971 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5c32a-45b0-4a28-bef3-9c1adcd077f3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:46.904940 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5c32a-45b0-4a28-bef3-9c1adcd077f3 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:46.921026 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-80c5c32a-45b0-4a28-bef3-9c1adcd077f3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:39:46.922227 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 291/604] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:39:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:46.927984 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59010349-9cb1-4deb-9780-97a94d69f3a7 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:46.943137 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59010349-9cb1-4deb-9780-97a94d69f3a7 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:46.949758 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8442b-2fb0-4de8-8f58-01d657ed5dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:46.950456 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8442b-2fb0-4de8-8f58-01d657ed5dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:46.950837 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8442b-2fb0-4de8-8f58-01d657ed5dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:46.951203 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8442b-2fb0-4de8-8f58-01d657ed5dd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:46.959717 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8442b-2fb0-4de8-8f58-01d657ed5dd6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:46.959717 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8442b-2fb0-4de8-8f58-01d657ed5dd6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:46.959717 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8442b-2fb0-4de8-8f58-01d657ed5dd6 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:46.971721 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 314/605] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:39:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:46.977675 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5c32a-45b0-4a28-bef3-9c1adcd077f3 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:46.994182 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5c32a-45b0-4a28-bef3-9c1adcd077f3 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:47.005105 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a27c1a-5ca2-46de-b58b-b895bb86773a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:47.005105 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a27c1a-5ca2-46de-b58b-b895bb86773a admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:47.005105 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a27c1a-5ca2-46de-b58b-b895bb86773a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:47.005105 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a27c1a-5ca2-46de-b58b-b895bb86773a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:47.005450 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a27c1a-5ca2-46de-b58b-b895bb86773a admin admin] RBAC: Adding query filter params (role.id=9868670385c0469093001f6f2c310f1a, scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1, user.id=c6ea13fd3e704b16aad5a38606ddc049) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:47.005450 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a27c1a-5ca2-46de-b58b-b895bb86773a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:47.006673 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a27c1a-5ca2-46de-b58b-b895bb86773a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:47.016910 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 292/606] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:39:46 2022] GET /identity/v3/role_assignments?user.id=c6ea13fd3e704b16aad5a38606ddc049&scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1&role.id=9868670385c0469093001f6f2c310f1a => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:48.185350 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6018b-2de2-4c34-9083-7e402f512c72 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:48.185868 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6018b-2de2-4c34-9083-7e402f512c72 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:48.185868 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6018b-2de2-4c34-9083-7e402f512c72 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:48.187874 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 315/607] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:48.193397 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83767d03-6767-4819-8fd3-b94246777140 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:48.193837 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83767d03-6767-4819-8fd3-b94246777140 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:48.194017 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83767d03-6767-4819-8fd3-b94246777140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:48.218027 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-83767d03-6767-4819-8fd3-b94246777140 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:48.219194 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-83767d03-6767-4819-8fd3-b94246777140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:48.226972 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 293/608] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:48.252771 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6018b-2de2-4c34-9083-7e402f512c72 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:48.266653 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6018b-2de2-4c34-9083-7e402f512c72 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:48.274539 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d6fc8-0b9b-4ea9-8e5f-6b1e2e394b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:48.275600 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d6fc8-0b9b-4ea9-8e5f-6b1e2e394b6e admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:48.276088 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d6fc8-0b9b-4ea9-8e5f-6b1e2e394b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:48.276566 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d6fc8-0b9b-4ea9-8e5f-6b1e2e394b6e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:48.293986 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d6fc8-0b9b-4ea9-8e5f-6b1e2e394b6e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:48.301583 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-915d6fc8-0b9b-4ea9-8e5f-6b1e2e394b6e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 05 14:39:48.303295 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 316/609] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Jan 5 14:39:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:48.309652 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83767d03-6767-4819-8fd3-b94246777140 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:48.322927 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83767d03-6767-4819-8fd3-b94246777140 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:48.332316 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb6def-91d9-4d6c-9d12-aa21ba5efec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:48.332984 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb6def-91d9-4d6c-9d12-aa21ba5efec5 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:48.333291 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb6def-91d9-4d6c-9d12-aa21ba5efec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:48.333565 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb6def-91d9-4d6c-9d12-aa21ba5efec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:48.334330 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb6def-91d9-4d6c-9d12-aa21ba5efec5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:48.334632 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb6def-91d9-4d6c-9d12-aa21ba5efec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:48.336310 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb6def-91d9-4d6c-9d12-aa21ba5efec5 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:48.349002 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 294/610] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Jan 5 14:39:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:48.354549 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d6fc8-0b9b-4ea9-8e5f-6b1e2e394b6e admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:48.371206 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d6fc8-0b9b-4ea9-8e5f-6b1e2e394b6e admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:48.381757 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e5936-0908-43bf-a735-d9ce270a9de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:48.382952 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e5936-0908-43bf-a735-d9ce270a9de5 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:48.383438 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e5936-0908-43bf-a735-d9ce270a9de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:48.383907 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e5936-0908-43bf-a735-d9ce270a9de5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:48.398478 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e5936-0908-43bf-a735-d9ce270a9de5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:48.401207 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e5936-0908-43bf-a735-d9ce270a9de5 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:48.424476 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-d85e5936-0908-43bf-a735-d9ce270a9de5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:48.426018 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 317/611] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:48.432066 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb6def-91d9-4d6c-9d12-aa21ba5efec5 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:48.447899 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb6def-91d9-4d6c-9d12-aa21ba5efec5 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:48.459762 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d6b70-a7a8-4969-b8df-cca62cf39808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:48.460463 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d6b70-a7a8-4969-b8df-cca62cf39808 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:48.460746 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d6b70-a7a8-4969-b8df-cca62cf39808 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:48.461016 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d6b70-a7a8-4969-b8df-cca62cf39808 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:48.461825 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d6b70-a7a8-4969-b8df-cca62cf39808 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:48.462126 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d6b70-a7a8-4969-b8df-cca62cf39808 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:48.463928 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d6b70-a7a8-4969-b8df-cca62cf39808 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:48.481993 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 295/612] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:48.497318 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e5936-0908-43bf-a735-d9ce270a9de5 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:48.511133 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e5936-0908-43bf-a735-d9ce270a9de5 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:48.526569 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160defdd-6b49-415e-9849-cf42accd465a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:48.527376 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160defdd-6b49-415e-9849-cf42accd465a admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:48.527666 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160defdd-6b49-415e-9849-cf42accd465a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:48.527941 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160defdd-6b49-415e-9849-cf42accd465a admin admin] PATH_INFO: `/v3/users/glance` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:48.542196 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160defdd-6b49-415e-9849-cf42accd465a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:48.547218 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160defdd-6b49-415e-9849-cf42accd465a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:48.565707 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-160defdd-6b49-415e-9849-cf42accd465a admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 05 14:39:48.567194 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 318/613] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:48.573573 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d6b70-a7a8-4969-b8df-cca62cf39808 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:48.589948 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d6b70-a7a8-4969-b8df-cca62cf39808 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:48.598104 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd4154-a60f-44f5-a15e-4de7ee95bafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:48.598818 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd4154-a60f-44f5-a15e-4de7ee95bafb admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:48.599101 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd4154-a60f-44f5-a15e-4de7ee95bafb admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:48.599378 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd4154-a60f-44f5-a15e-4de7ee95bafb admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:48.600319 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd4154-a60f-44f5-a15e-4de7ee95bafb admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:48.600674 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd4154-a60f-44f5-a15e-4de7ee95bafb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:48.602611 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd4154-a60f-44f5-a15e-4de7ee95bafb admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:48.635798 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 296/614] 10.222.0.30 () {56 vars in 1158 bytes} [Wed Jan 5 14:39:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:48.641718 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160defdd-6b49-415e-9849-cf42accd465a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:48.659431 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160defdd-6b49-415e-9849-cf42accd465a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:48.669696 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156151d-42b7-49d3-8f54-05b8ab86242c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:48.670351 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156151d-42b7-49d3-8f54-05b8ab86242c admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:48.670634 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156151d-42b7-49d3-8f54-05b8ab86242c admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:48.670911 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156151d-42b7-49d3-8f54-05b8ab86242c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:48.688693 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156151d-42b7-49d3-8f54-05b8ab86242c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:48.690602 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156151d-42b7-49d3-8f54-05b8ab86242c admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:48.703200 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 319/615] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:39:48.708833 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd4154-a60f-44f5-a15e-4de7ee95bafb admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:48.721937 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd4154-a60f-44f5-a15e-4de7ee95bafb admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:48.729899 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6eda9-d603-4ec3-bf95-3f1236f2863a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:48.730742 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6eda9-d603-4ec3-bf95-3f1236f2863a admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:48.731021 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6eda9-d603-4ec3-bf95-3f1236f2863a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:48.731349 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6eda9-d603-4ec3-bf95-3f1236f2863a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:48.747132 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6eda9-d603-4ec3-bf95-3f1236f2863a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:48.748972 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6eda9-d603-4ec3-bf95-3f1236f2863a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:48.775702 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-0bc6eda9-d603-4ec3-bf95-3f1236f2863a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:48.777244 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 297/616] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:48.782799 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156151d-42b7-49d3-8f54-05b8ab86242c admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:48.798182 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156151d-42b7-49d3-8f54-05b8ab86242c admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:48.805179 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ffb5c-e6f9-4562-b502-de33bf6d3c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:48.805843 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ffb5c-e6f9-4562-b502-de33bf6d3c66 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:48.806283 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ffb5c-e6f9-4562-b502-de33bf6d3c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:48.806563 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ffb5c-e6f9-4562-b502-de33bf6d3c66 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:48.807303 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ffb5c-e6f9-4562-b502-de33bf6d3c66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:48.807608 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ffb5c-e6f9-4562-b502-de33bf6d3c66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:48.809238 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ffb5c-e6f9-4562-b502-de33bf6d3c66 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:48.835049 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 320/617] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:48.839887 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56631d6c-52d0-43fa-8582-bbde0afa3874 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:48.840187 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56631d6c-52d0-43fa-8582-bbde0afa3874 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:48.840436 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56631d6c-52d0-43fa-8582-bbde0afa3874 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:48.842109 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ffb5c-e6f9-4562-b502-de33bf6d3c66 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:48.842681 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 298/618] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:48.848273 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b50db-4139-4f41-9776-ed09b8a2e3c6 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:48.848555 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b50db-4139-4f41-9776-ed09b8a2e3c6 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:48.848833 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b50db-4139-4f41-9776-ed09b8a2e3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:48.859806 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ffb5c-e6f9-4562-b502-de33bf6d3c66 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:48.874517 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-b12b50db-4139-4f41-9776-ed09b8a2e3c6 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:48.875771 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfc958-d610-4900-8d91-19c11c8ae185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:48.876573 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfc958-d610-4900-8d91-19c11c8ae185 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:48.876850 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfc958-d610-4900-8d91-19c11c8ae185 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:48.877156 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfc958-d610-4900-8d91-19c11c8ae185 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:48.878058 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-b12b50db-4139-4f41-9776-ed09b8a2e3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:48.889013 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dfc958-d610-4900-8d91-19c11c8ae185 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:48.893116 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dfc958-d610-4900-8d91-19c11c8ae185 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:48.895969 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 299/619] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:39:48.910430 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-d2dfc958-d610-4900-8d91-19c11c8ae185 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:39:48.916644 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 321/620] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:39:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:48.918193 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b50db-4139-4f41-9776-ed09b8a2e3c6 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:48.928222 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b50db-4139-4f41-9776-ed09b8a2e3c6 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:48.929459 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfc958-d610-4900-8d91-19c11c8ae185 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:48.941055 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b3776-3d61-4e42-93b9-d76deac32224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:48.942013 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b3776-3d61-4e42-93b9-d76deac32224 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:48.942494 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b3776-3d61-4e42-93b9-d76deac32224 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:48.942967 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b3776-3d61-4e42-93b9-d76deac32224 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:48.944001 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b3776-3d61-4e42-93b9-d76deac32224 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:48.944504 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b3776-3d61-4e42-93b9-d76deac32224 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:48.947879 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b3776-3d61-4e42-93b9-d76deac32224 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:48.950911 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfc958-d610-4900-8d91-19c11c8ae185 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:48.966090 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50e705-237b-41db-838d-249aa0bfbf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:48.967195 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50e705-237b-41db-838d-249aa0bfbf3b admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:48.967684 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50e705-237b-41db-838d-249aa0bfbf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:48.968153 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50e705-237b-41db-838d-249aa0bfbf3b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:48.972953 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 300/621] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:39:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:48.979578 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b3776-3d61-4e42-93b9-d76deac32224 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:48.989932 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50e705-237b-41db-838d-249aa0bfbf3b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:48.996072 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b3776-3d61-4e42-93b9-d76deac32224 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:48.998812 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-ce50e705-237b-41db-838d-249aa0bfbf3b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 05 14:39:49.000201 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 322/622] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Jan 5 14:39:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:49.007443 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50e705-237b-41db-838d-249aa0bfbf3b admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:49.009390 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ad9c5-0fcb-4883-a98e-8759b84b8faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:49.010046 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ad9c5-0fcb-4883-a98e-8759b84b8faf admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:49.010325 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ad9c5-0fcb-4883-a98e-8759b84b8faf admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:49.010595 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ad9c5-0fcb-4883-a98e-8759b84b8faf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:49.011462 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ad9c5-0fcb-4883-a98e-8759b84b8faf admin admin] RBAC: Adding query filter params (role.id=9868670385c0469093001f6f2c310f1a, scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1, user.id=935ad716e4624c25bc34308f05eb1526) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:49.011778 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ad9c5-0fcb-4883-a98e-8759b84b8faf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:49.017780 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ad9c5-0fcb-4883-a98e-8759b84b8faf admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:49.021937 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50e705-237b-41db-838d-249aa0bfbf3b admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:49.031636 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 301/623] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:39:48 2022] GET /identity/v3/role_assignments?user.id=935ad716e4624c25bc34308f05eb1526&scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1&role.id=9868670385c0469093001f6f2c310f1a => generated 608 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:49.033746 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d8df7-8388-467b-99ce-67f8b222bfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:49.034762 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d8df7-8388-467b-99ce-67f8b222bfe0 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:49.035297 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d8df7-8388-467b-99ce-67f8b222bfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:49.035786 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d8df7-8388-467b-99ce-67f8b222bfe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:49.036874 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d8df7-8388-467b-99ce-67f8b222bfe0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:49.037448 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d8df7-8388-467b-99ce-67f8b222bfe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:49.039557 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d8df7-8388-467b-99ce-67f8b222bfe0 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:49.050373 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 323/624] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Jan 5 14:39:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:49.057171 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ad9c5-0fcb-4883-a98e-8759b84b8faf admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:49.075692 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ad9c5-0fcb-4883-a98e-8759b84b8faf admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:49.085892 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70b4ac-d01a-4edb-8ab5-a7ed0cd973f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:49.086709 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70b4ac-d01a-4edb-8ab5-a7ed0cd973f1 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:49.086983 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70b4ac-d01a-4edb-8ab5-a7ed0cd973f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:49.087813 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70b4ac-d01a-4edb-8ab5-a7ed0cd973f1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:49.109269 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70b4ac-d01a-4edb-8ab5-a7ed0cd973f1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:49.111132 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70b4ac-d01a-4edb-8ab5-a7ed0cd973f1 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:49.140200 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-ff70b4ac-d01a-4edb-8ab5-a7ed0cd973f1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:49.141726 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 302/625] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:49.147274 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d8df7-8388-467b-99ce-67f8b222bfe0 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:49.164267 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d8df7-8388-467b-99ce-67f8b222bfe0 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:49.169875 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add94b07-12f0-456d-a4ab-ede7f1c6b35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:49.170923 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add94b07-12f0-456d-a4ab-ede7f1c6b35b admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:49.171501 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add94b07-12f0-456d-a4ab-ede7f1c6b35b admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:49.171975 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add94b07-12f0-456d-a4ab-ede7f1c6b35b admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:49.172974 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add94b07-12f0-456d-a4ab-ede7f1c6b35b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:49.173517 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add94b07-12f0-456d-a4ab-ede7f1c6b35b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:49.175431 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add94b07-12f0-456d-a4ab-ede7f1c6b35b admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:49.189218 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 324/626] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:49.194245 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70b4ac-d01a-4edb-8ab5-a7ed0cd973f1 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:49.206031 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70b4ac-d01a-4edb-8ab5-a7ed0cd973f1 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:49.211350 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d82073-bc83-4508-8fe6-cf413cc084f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:49.212660 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d82073-bc83-4508-8fe6-cf413cc084f0 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:49.213209 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d82073-bc83-4508-8fe6-cf413cc084f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:49.213678 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d82073-bc83-4508-8fe6-cf413cc084f0 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:49.223275 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d82073-bc83-4508-8fe6-cf413cc084f0 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:49.225809 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d82073-bc83-4508-8fe6-cf413cc084f0 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:49.242094 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-94d82073-bc83-4508-8fe6-cf413cc084f0 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 05 14:39:49.244189 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 303/627] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:39:49.249484 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add94b07-12f0-456d-a4ab-ede7f1c6b35b admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:49.266342 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add94b07-12f0-456d-a4ab-ede7f1c6b35b admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:49.282556 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e450578-c543-4056-b213-7da1ba91fcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:49.283254 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e450578-c543-4056-b213-7da1ba91fcf4 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:49.283546 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e450578-c543-4056-b213-7da1ba91fcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:49.283826 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e450578-c543-4056-b213-7da1ba91fcf4 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:49.284693 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e450578-c543-4056-b213-7da1ba91fcf4 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:49.285003 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e450578-c543-4056-b213-7da1ba91fcf4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:49.286945 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e450578-c543-4056-b213-7da1ba91fcf4 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:49.316898 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 325/628] 10.222.0.30 () {56 vars in 1158 bytes} [Wed Jan 5 14:39:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:49.322806 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d82073-bc83-4508-8fe6-cf413cc084f0 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:49.334384 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d82073-bc83-4508-8fe6-cf413cc084f0 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:49.339574 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443715ca-3dac-4f15-9f5c-c5d7c7f379a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:49.340477 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443715ca-3dac-4f15-9f5c-c5d7c7f379a9 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:49.341015 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443715ca-3dac-4f15-9f5c-c5d7c7f379a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:49.341526 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443715ca-3dac-4f15-9f5c-c5d7c7f379a9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:49.352236 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443715ca-3dac-4f15-9f5c-c5d7c7f379a9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:49.354910 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443715ca-3dac-4f15-9f5c-c5d7c7f379a9 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:49.364381 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 304/629] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:39:49.369991 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e450578-c543-4056-b213-7da1ba91fcf4 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:49.381584 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e450578-c543-4056-b213-7da1ba91fcf4 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:49.386892 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a10fe-6443-4b89-8b00-ceb4a4670fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:49.387910 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a10fe-6443-4b89-8b00-ceb4a4670fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:49.388393 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a10fe-6443-4b89-8b00-ceb4a4670fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:49.388885 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a10fe-6443-4b89-8b00-ceb4a4670fe7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:49.400116 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a10fe-6443-4b89-8b00-ceb4a4670fe7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:49.402419 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a10fe-6443-4b89-8b00-ceb4a4670fe7 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:49.420963 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-135a10fe-6443-4b89-8b00-ceb4a4670fe7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:49.422902 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 326/630] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:39:49.427972 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443715ca-3dac-4f15-9f5c-c5d7c7f379a9 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:49.437480 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443715ca-3dac-4f15-9f5c-c5d7c7f379a9 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:49.443483 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5def5-7b54-4a5d-a930-708c1cd48ef0 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:49.444036 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5def5-7b54-4a5d-a930-708c1cd48ef0 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:49.444509 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5def5-7b54-4a5d-a930-708c1cd48ef0 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:49.447445 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 327/631] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 14:39:49.449778 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3d809-85ab-4415-905b-2a64655cf853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:49.450437 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3d809-85ab-4415-905b-2a64655cf853 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:49.450717 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3d809-85ab-4415-905b-2a64655cf853 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:49.450991 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3d809-85ab-4415-905b-2a64655cf853 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:49.451715 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3d809-85ab-4415-905b-2a64655cf853 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:49.452016 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3d809-85ab-4415-905b-2a64655cf853 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:49.453665 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3d809-85ab-4415-905b-2a64655cf853 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:49.454606 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc261d-d844-4bd4-b181-214220233955 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:49.455094 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc261d-d844-4bd4-b181-214220233955 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:49.455615 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc261d-d844-4bd4-b181-214220233955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:49.473873 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 305/632] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:49.475397 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-75bc261d-d844-4bd4-b181-214220233955 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:49.476830 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-75bc261d-d844-4bd4-b181-214220233955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:49.478949 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3d809-85ab-4415-905b-2a64655cf853 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:49.492273 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3d809-85ab-4415-905b-2a64655cf853 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:49.493464 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 328/633] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:39:49.498164 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448a53c-2c0c-4d71-b44c-6100b094c3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:49.499116 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448a53c-2c0c-4d71-b44c-6100b094c3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:49.499447 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448a53c-2c0c-4d71-b44c-6100b094c3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:49.499769 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448a53c-2c0c-4d71-b44c-6100b094c3c8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:49.509791 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448a53c-2c0c-4d71-b44c-6100b094c3c8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:49.512933 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448a53c-2c0c-4d71-b44c-6100b094c3c8 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:49.527003 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc261d-d844-4bd4-b181-214220233955 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:49.534580 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-a448a53c-2c0c-4d71-b44c-6100b094c3c8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:39:49.536274 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 306/634] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:39:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:49.536388 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc261d-d844-4bd4-b181-214220233955 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:49.542687 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448a53c-2c0c-4d71-b44c-6100b094c3c8 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:49.550272 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee5b51-7677-43ba-89e7-8979d6b96b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:49.550822 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee5b51-7677-43ba-89e7-8979d6b96b89 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:49.551115 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee5b51-7677-43ba-89e7-8979d6b96b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:49.551395 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee5b51-7677-43ba-89e7-8979d6b96b89 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:49.559238 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448a53c-2c0c-4d71-b44c-6100b094c3c8 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:49.565405 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236df8fe-a2dc-4136-a111-ca9f64ccb225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:49.566060 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236df8fe-a2dc-4136-a111-ca9f64ccb225 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:49.566342 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236df8fe-a2dc-4136-a111-ca9f64ccb225 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:49.566661 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee5b51-7677-43ba-89e7-8979d6b96b89 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:49.566765 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236df8fe-a2dc-4136-a111-ca9f64ccb225 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:49.567515 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236df8fe-a2dc-4136-a111-ca9f64ccb225 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:49.567826 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236df8fe-a2dc-4136-a111-ca9f64ccb225 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:49.570019 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236df8fe-a2dc-4136-a111-ca9f64ccb225 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:49.576953 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-cdee5b51-7677-43ba-89e7-8979d6b96b89 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 05 14:39:49.578014 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 329/635] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Jan 5 14:39:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:49.579168 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367fbbe-f94d-4540-bba7-b276fd6ed306 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:49.579455 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367fbbe-f94d-4540-bba7-b276fd6ed306 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:49.579732 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367fbbe-f94d-4540-bba7-b276fd6ed306 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:49.581699 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 330/636] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:49.583935 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367fbbe-f94d-4540-bba7-b276fd6ed306 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:49.590953 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 307/637] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:39:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:49.592425 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a876ce-c447-4bcb-a9f4-b57951efe94e None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:49.592721 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a876ce-c447-4bcb-a9f4-b57951efe94e None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:49.593003 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a876ce-c447-4bcb-a9f4-b57951efe94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:49.607343 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367fbbe-f94d-4540-bba7-b276fd6ed306 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:49.612001 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212d533-7ec9-4b66-9eae-178b75f850ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:49.612152 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-77a876ce-c447-4bcb-a9f4-b57951efe94e None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:49.612657 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212d533-7ec9-4b66-9eae-178b75f850ac admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:49.612942 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212d533-7ec9-4b66-9eae-178b75f850ac admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:49.613309 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-77a876ce-c447-4bcb-a9f4-b57951efe94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:49.613412 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212d533-7ec9-4b66-9eae-178b75f850ac admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:49.614206 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212d533-7ec9-4b66-9eae-178b75f850ac admin admin] RBAC: Adding query filter params (name=service) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:49.614563 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212d533-7ec9-4b66-9eae-178b75f850ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:49.616267 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212d533-7ec9-4b66-9eae-178b75f850ac admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:49.622110 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 308/638] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:49.623052 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a876ce-c447-4bcb-a9f4-b57951efe94e None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:49.628474 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 331/639] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Jan 5 14:39:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:49.633533 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212d533-7ec9-4b66-9eae-178b75f850ac admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:49.637940 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a876ce-c447-4bcb-a9f4-b57951efe94e None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:49.643932 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212d533-7ec9-4b66-9eae-178b75f850ac admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:49.647076 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdbc70-ca76-46a7-a32d-7efd517c0042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:49.647798 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdbc70-ca76-46a7-a32d-7efd517c0042 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:49.648023 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdbc70-ca76-46a7-a32d-7efd517c0042 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:49.648303 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdbc70-ca76-46a7-a32d-7efd517c0042 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:49.648951 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20bf27-1618-42e0-b33e-d7a0770f7b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:49.649272 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdbc70-ca76-46a7-a32d-7efd517c0042 admin admin] RBAC: Adding query filter params (role.id=9868670385c0469093001f6f2c310f1a, scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1, user.id=541bd71b355d4b7ca35372e11be54be3) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:49.649589 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdbc70-ca76-46a7-a32d-7efd517c0042 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:49.650374 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20bf27-1618-42e0-b33e-d7a0770f7b05 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:49.650710 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20bf27-1618-42e0-b33e-d7a0770f7b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:49.651042 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20bf27-1618-42e0-b33e-d7a0770f7b05 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:49.652185 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdbc70-ca76-46a7-a32d-7efd517c0042 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:49.658868 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 309/640] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:39:49 2022] GET /identity/v3/role_assignments?user.id=541bd71b355d4b7ca35372e11be54be3&scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1&role.id=9868670385c0469093001f6f2c310f1a => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:49.659724 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdbc70-ca76-46a7-a32d-7efd517c0042 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:49.670079 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdbc70-ca76-46a7-a32d-7efd517c0042 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:49.674444 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20bf27-1618-42e0-b33e-d7a0770f7b05 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:49.675106 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecebe6-d435-4902-9c8f-8149997ea14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:49.675970 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecebe6-d435-4902-9c8f-8149997ea14f admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:49.676245 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecebe6-d435-4902-9c8f-8149997ea14f admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:49.676344 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20bf27-1618-42e0-b33e-d7a0770f7b05 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:49.676520 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecebe6-d435-4902-9c8f-8149997ea14f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:49.689117 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eecebe6-d435-4902-9c8f-8149997ea14f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:49.696848 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-4eecebe6-d435-4902-9c8f-8149997ea14f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 05 14:39:49.698525 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 310/641] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Jan 5 14:39:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:49.703938 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecebe6-d435-4902-9c8f-8149997ea14f admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:49.716111 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-1a20bf27-1618-42e0-b33e-d7a0770f7b05 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:49.720398 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 332/642] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:49.722737 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecebe6-d435-4902-9c8f-8149997ea14f admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:49.725337 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20bf27-1618-42e0-b33e-d7a0770f7b05 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:49.732702 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2ec61-f3d0-4899-abaf-30372ce098e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:49.735325 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2ec61-f3d0-4899-abaf-30372ce098e7 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:49.735629 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2ec61-f3d0-4899-abaf-30372ce098e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:49.735920 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2ec61-f3d0-4899-abaf-30372ce098e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:49.737972 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2ec61-f3d0-4899-abaf-30372ce098e7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:49.738340 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2ec61-f3d0-4899-abaf-30372ce098e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:49.740404 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2ec61-f3d0-4899-abaf-30372ce098e7 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:49.747343 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20bf27-1618-42e0-b33e-d7a0770f7b05 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:49.757031 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94290b2d-66a4-42b6-9459-a5f927864d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:49.757749 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94290b2d-66a4-42b6-9459-a5f927864d0f admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:49.758911 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94290b2d-66a4-42b6-9459-a5f927864d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:49.759281 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94290b2d-66a4-42b6-9459-a5f927864d0f admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:49.760023 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94290b2d-66a4-42b6-9459-a5f927864d0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:49.760717 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94290b2d-66a4-42b6-9459-a5f927864d0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:49.763924 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 311/643] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Jan 5 14:39:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:49.764813 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94290b2d-66a4-42b6-9459-a5f927864d0f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:49.769319 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2ec61-f3d0-4899-abaf-30372ce098e7 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:49.780351 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2ec61-f3d0-4899-abaf-30372ce098e7 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:49.786180 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b4fe4-bfdc-4f3b-836e-e6be2d8e8675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:49.787056 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b4fe4-bfdc-4f3b-836e-e6be2d8e8675 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:49.787344 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b4fe4-bfdc-4f3b-836e-e6be2d8e8675 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:49.787622 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b4fe4-bfdc-4f3b-836e-e6be2d8e8675 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:49.791481 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 333/644] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:49.797152 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94290b2d-66a4-42b6-9459-a5f927864d0f admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:49.799894 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b4fe4-bfdc-4f3b-836e-e6be2d8e8675 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:49.801990 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b4fe4-bfdc-4f3b-836e-e6be2d8e8675 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:49.819768 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94290b2d-66a4-42b6-9459-a5f927864d0f admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:49.823026 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-1a6b4fe4-bfdc-4f3b-836e-e6be2d8e8675 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:49.824280 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 312/645] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:39:49.830120 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b4fe4-bfdc-4f3b-836e-e6be2d8e8675 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:49.830868 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb54d3-30ee-43db-bf70-970ecb7347f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:49.831924 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb54d3-30ee-43db-bf70-970ecb7347f3 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:49.832440 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb54d3-30ee-43db-bf70-970ecb7347f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:49.832911 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb54d3-30ee-43db-bf70-970ecb7347f3 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:49.841571 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b4fe4-bfdc-4f3b-836e-e6be2d8e8675 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:49.847135 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95356f8c-56ba-4ecb-a440-ac765452777e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:49.847866 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95356f8c-56ba-4ecb-a440-ac765452777e admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:49.848153 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95356f8c-56ba-4ecb-a440-ac765452777e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:49.848440 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95356f8c-56ba-4ecb-a440-ac765452777e admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:49.853096 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95356f8c-56ba-4ecb-a440-ac765452777e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:49.853096 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95356f8c-56ba-4ecb-a440-ac765452777e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:49.853096 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95356f8c-56ba-4ecb-a440-ac765452777e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:49.854461 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb54d3-30ee-43db-bf70-970ecb7347f3 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:49.856720 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb54d3-30ee-43db-bf70-970ecb7347f3 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:49.865935 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 313/646] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:49.872231 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95356f8c-56ba-4ecb-a440-ac765452777e admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:49.885109 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-bdfb54d3-30ee-43db-bf70-970ecb7347f3 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 05 14:39:49.885334 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95356f8c-56ba-4ecb-a440-ac765452777e admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:49.887041 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 334/647] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Jan 5 14:39:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:39:49.891584 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92906180-0749-432a-9c90-f76a7206b8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:49.891584 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92906180-0749-432a-9c90-f76a7206b8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:49.891584 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92906180-0749-432a-9c90-f76a7206b8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:49.891584 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92906180-0749-432a-9c90-f76a7206b8a3 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:49.893059 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb54d3-30ee-43db-bf70-970ecb7347f3 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:49.899187 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92906180-0749-432a-9c90-f76a7206b8a3 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:49.902794 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92906180-0749-432a-9c90-f76a7206b8a3 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:49.904685 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb54d3-30ee-43db-bf70-970ecb7347f3 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:49.909721 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e23b1-babe-4dd6-b99a-633243819d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:49.910749 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e23b1-babe-4dd6-b99a-633243819d5b admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:49.911225 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e23b1-babe-4dd6-b99a-633243819d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:49.911742 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e23b1-babe-4dd6-b99a-633243819d5b admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:49.912790 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e23b1-babe-4dd6-b99a-633243819d5b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:49.913409 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e23b1-babe-4dd6-b99a-633243819d5b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:49.915705 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e23b1-babe-4dd6-b99a-633243819d5b admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:49.918404 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-92906180-0749-432a-9c90-f76a7206b8a3 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 05 14:39:49.920795 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 314/648] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Jan 5 14:39:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:39:49.927297 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92906180-0749-432a-9c90-f76a7206b8a3 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:49.937347 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 335/649] 10.222.0.30 () {56 vars in 1154 bytes} [Wed Jan 5 14:39:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:49.941158 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92906180-0749-432a-9c90-f76a7206b8a3 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:49.943365 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e23b1-babe-4dd6-b99a-633243819d5b admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:49.945525 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bf99d-baa3-4354-b16a-1c13b8ba103a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:49.946235 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bf99d-baa3-4354-b16a-1c13b8ba103a admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:49.950213 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bf99d-baa3-4354-b16a-1c13b8ba103a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:49.950213 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bf99d-baa3-4354-b16a-1c13b8ba103a admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:49.950213 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bf99d-baa3-4354-b16a-1c13b8ba103a admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:49.950213 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bf99d-baa3-4354-b16a-1c13b8ba103a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:49.950878 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bf99d-baa3-4354-b16a-1c13b8ba103a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:49.955391 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e23b1-babe-4dd6-b99a-633243819d5b admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:49.960033 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b9600-a1c7-4d36-b7a6-5e84ab5eecb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:49.960673 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b9600-a1c7-4d36-b7a6-5e84ab5eecb3 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:49.960955 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b9600-a1c7-4d36-b7a6-5e84ab5eecb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:49.961391 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b9600-a1c7-4d36-b7a6-5e84ab5eecb3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:49.973992 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b9600-a1c7-4d36-b7a6-5e84ab5eecb3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:49.978964 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 315/650] 10.222.0.30 () {56 vars in 1160 bytes} [Wed Jan 5 14:39:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:49.979073 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b9600-a1c7-4d36-b7a6-5e84ab5eecb3 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:49.979927 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bf99d-baa3-4354-b16a-1c13b8ba103a admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:49.985860 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 336/651] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 05 14:39:49.991471 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b9600-a1c7-4d36-b7a6-5e84ab5eecb3 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:49.991606 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bf99d-baa3-4354-b16a-1c13b8ba103a admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:49.996939 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9488c4-32cb-4f49-8711-9f484d5318cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:49.997623 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9488c4-32cb-4f49-8711-9f484d5318cd admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:49.998179 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9488c4-32cb-4f49-8711-9f484d5318cd admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:49.998474 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9488c4-32cb-4f49-8711-9f484d5318cd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:50.000339 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b9600-a1c7-4d36-b7a6-5e84ab5eecb3 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:50.008260 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125b8b3-5db6-4f9e-a263-dcfd3cfac1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:50.008260 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125b8b3-5db6-4f9e-a263-dcfd3cfac1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:50.008633 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125b8b3-5db6-4f9e-a263-dcfd3cfac1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:50.008900 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125b8b3-5db6-4f9e-a263-dcfd3cfac1f5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:50.010929 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9488c4-32cb-4f49-8711-9f484d5318cd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:50.012926 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9488c4-32cb-4f49-8711-9f484d5318cd admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:50.026999 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125b8b3-5db6-4f9e-a263-dcfd3cfac1f5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:50.028883 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125b8b3-5db6-4f9e-a263-dcfd3cfac1f5 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:50.030378 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 316/652] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:39:50.035662 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9488c4-32cb-4f49-8711-9f484d5318cd admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:50.046720 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9488c4-32cb-4f49-8711-9f484d5318cd admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:50.049928 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-7125b8b3-5db6-4f9e-a263-dcfd3cfac1f5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:50.051162 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 337/653] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:39:50.051270 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ba478-9425-474e-ab8b-579b512bfe78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:50.052017 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ba478-9425-474e-ab8b-579b512bfe78 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:50.053594 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ba478-9425-474e-ab8b-579b512bfe78 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:50.053885 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ba478-9425-474e-ab8b-579b512bfe78 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:50.056559 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125b8b3-5db6-4f9e-a263-dcfd3cfac1f5 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:50.069331 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ba478-9425-474e-ab8b-579b512bfe78 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:50.070051 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125b8b3-5db6-4f9e-a263-dcfd3cfac1f5 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:50.071428 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ba478-9425-474e-ab8b-579b512bfe78 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:50.076218 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5bf98-53ae-4d4d-9575-128007348d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:50.076904 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5bf98-53ae-4d4d-9575-128007348d9c admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:50.077257 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5bf98-53ae-4d4d-9575-128007348d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:50.077580 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5bf98-53ae-4d4d-9575-128007348d9c admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:50.078303 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5bf98-53ae-4d4d-9575-128007348d9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:50.078601 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5bf98-53ae-4d4d-9575-128007348d9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:50.080333 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5bf98-53ae-4d4d-9575-128007348d9c admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:50.092622 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 338/654] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:50.094277 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-dc8ba478-9425-474e-ab8b-579b512bfe78 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:50.096891 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 317/655] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:50.097696 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5bf98-53ae-4d4d-9575-128007348d9c admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:50.104205 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ba478-9425-474e-ab8b-579b512bfe78 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:50.108773 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5bf98-53ae-4d4d-9575-128007348d9c admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:50.113489 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daee817-5315-450d-acdd-78596213cf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:50.114270 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daee817-5315-450d-acdd-78596213cf95 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:50.114602 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daee817-5315-450d-acdd-78596213cf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:50.114928 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daee817-5315-450d-acdd-78596213cf95 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:50.115961 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ba478-9425-474e-ab8b-579b512bfe78 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:50.120738 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d780ec-d73e-468b-b4e9-718d793d4a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:50.122472 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daee817-5315-450d-acdd-78596213cf95 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:50.122882 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d780ec-d73e-468b-b4e9-718d793d4a40 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:50.123374 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d780ec-d73e-468b-b4e9-718d793d4a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:50.123848 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d780ec-d73e-468b-b4e9-718d793d4a40 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:50.124515 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daee817-5315-450d-acdd-78596213cf95 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:50.125137 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d780ec-d73e-468b-b4e9-718d793d4a40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:50.125653 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d780ec-d73e-468b-b4e9-718d793d4a40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:50.127637 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d780ec-d73e-468b-b4e9-718d793d4a40 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:50.140247 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-9daee817-5315-450d-acdd-78596213cf95 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:39:50.140730 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 318/656] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:50.145113 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 339/657] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:39:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:39:50.150542 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d780ec-d73e-468b-b4e9-718d793d4a40 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:50.150662 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daee817-5315-450d-acdd-78596213cf95 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:50.160318 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d780ec-d73e-468b-b4e9-718d793d4a40 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:50.165193 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a4ca6-b0a9-4181-9a75-f2f9e0499020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:50.166737 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a4ca6-b0a9-4181-9a75-f2f9e0499020 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:50.167237 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a4ca6-b0a9-4181-9a75-f2f9e0499020 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:50.167704 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a4ca6-b0a9-4181-9a75-f2f9e0499020 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:50.171375 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daee817-5315-450d-acdd-78596213cf95 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:50.175247 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a4ca6-b0a9-4181-9a75-f2f9e0499020 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:50.177483 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a4ca6-b0a9-4181-9a75-f2f9e0499020 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:50.189738 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadc1ca-d6e1-425d-82de-746b3cbda3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:50.190407 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadc1ca-d6e1-425d-82de-746b3cbda3c6 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:50.190687 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadc1ca-d6e1-425d-82de-746b3cbda3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:50.190956 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadc1ca-d6e1-425d-82de-746b3cbda3c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:50.191753 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aadc1ca-d6e1-425d-82de-746b3cbda3c6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:50.192058 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aadc1ca-d6e1-425d-82de-746b3cbda3c6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:50.193721 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-858a4ca6-b0a9-4181-9a75-f2f9e0499020 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:39:50.193922 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aadc1ca-d6e1-425d-82de-746b3cbda3c6 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:50.200399 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 319/658] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:39:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:50.202147 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a4ca6-b0a9-4181-9a75-f2f9e0499020 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:50.211923 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a4ca6-b0a9-4181-9a75-f2f9e0499020 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:50.217805 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 340/659] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:39:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:50.223853 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadc1ca-d6e1-425d-82de-746b3cbda3c6 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:50.225645 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63180a98-bafe-46d5-92a0-32a53b60d605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:50.227001 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63180a98-bafe-46d5-92a0-32a53b60d605 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:50.229118 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63180a98-bafe-46d5-92a0-32a53b60d605 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:50.229693 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63180a98-bafe-46d5-92a0-32a53b60d605 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:50.230729 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63180a98-bafe-46d5-92a0-32a53b60d605 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:50.231904 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63180a98-bafe-46d5-92a0-32a53b60d605 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:50.236409 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63180a98-bafe-46d5-92a0-32a53b60d605 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:50.251437 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadc1ca-d6e1-425d-82de-746b3cbda3c6 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:50.264907 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ad6ad-f0dc-414a-b64d-87772e4f3452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:50.265954 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ad6ad-f0dc-414a-b64d-87772e4f3452 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:50.266494 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ad6ad-f0dc-414a-b64d-87772e4f3452 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:50.266977 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ad6ad-f0dc-414a-b64d-87772e4f3452 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:50.267581 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 320/660] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:39:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:50.268328 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ad6ad-f0dc-414a-b64d-87772e4f3452 admin admin] RBAC: Adding query filter params (role.id=9868670385c0469093001f6f2c310f1a, scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1, user.id=77db235e2f7046e4bdbad7f31b5e3ebc) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:50.268865 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ad6ad-f0dc-414a-b64d-87772e4f3452 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:50.271058 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ad6ad-f0dc-414a-b64d-87772e4f3452 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:50.274451 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63180a98-bafe-46d5-92a0-32a53b60d605 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:50.286423 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 341/661] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:39:50 2022] GET /identity/v3/role_assignments?user.id=77db235e2f7046e4bdbad7f31b5e3ebc&scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1&role.id=9868670385c0469093001f6f2c310f1a => generated 608 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:50.288057 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55744d76-62e4-4879-bdd4-8678ec55ca4a None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:50.288560 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55744d76-62e4-4879-bdd4-8678ec55ca4a None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:50.288678 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63180a98-bafe-46d5-92a0-32a53b60d605 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:50.289186 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55744d76-62e4-4879-bdd4-8678ec55ca4a None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:50.296935 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 342/662] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:50.297162 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a42e5a-1f93-4319-9792-e1bc06ded98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:50.297655 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a42e5a-1f93-4319-9792-e1bc06ded98b admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:50.301423 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a42e5a-1f93-4319-9792-e1bc06ded98b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:50.302094 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a42e5a-1f93-4319-9792-e1bc06ded98b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:50.303220 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a42e5a-1f93-4319-9792-e1bc06ded98b admin admin] RBAC: Adding query filter params (role.id=9868670385c0469093001f6f2c310f1a, scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1, user.id=a6234d716a014808a8a4eb22b903bbc9) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:50.303674 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde58c3-f00a-4afe-a522-65a1ab10573f None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:50.303989 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a42e5a-1f93-4319-9792-e1bc06ded98b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:50.304091 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde58c3-f00a-4afe-a522-65a1ab10573f None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:50.304340 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde58c3-f00a-4afe-a522-65a1ab10573f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:50.306646 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a42e5a-1f93-4319-9792-e1bc06ded98b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:50.317227 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 321/663] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:39:50 2022] GET /identity/v3/role_assignments?user.id=a6234d716a014808a8a4eb22b903bbc9&scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1&role.id=9868670385c0469093001f6f2c310f1a => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:50.324149 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-5dde58c3-f00a-4afe-a522-65a1ab10573f None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:50.325411 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-5dde58c3-f00a-4afe-a522-65a1ab10573f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:50.334388 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 343/664] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:50.360863 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a42e5a-1f93-4319-9792-e1bc06ded98b admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:50.379403 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a42e5a-1f93-4319-9792-e1bc06ded98b admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:50.387276 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e8693-53f4-4334-b982-faf061e35ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:50.388212 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e8693-53f4-4334-b982-faf061e35ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:50.388500 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e8693-53f4-4334-b982-faf061e35ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:50.388797 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e8693-53f4-4334-b982-faf061e35ec8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:50.412032 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e8693-53f4-4334-b982-faf061e35ec8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:50.419596 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-205e8693-53f4-4334-b982-faf061e35ec8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 05 14:39:50.421316 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 322/665] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Jan 5 14:39:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:50.427482 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde58c3-f00a-4afe-a522-65a1ab10573f None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:50.445733 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde58c3-f00a-4afe-a522-65a1ab10573f None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:50.463666 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ebfd5-c7be-4723-a4c0-880f386ae831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:50.464369 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ebfd5-c7be-4723-a4c0-880f386ae831 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:50.464648 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ebfd5-c7be-4723-a4c0-880f386ae831 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:50.464920 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ebfd5-c7be-4723-a4c0-880f386ae831 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:50.465728 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ebfd5-c7be-4723-a4c0-880f386ae831 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:50.466033 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ebfd5-c7be-4723-a4c0-880f386ae831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:50.467678 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ebfd5-c7be-4723-a4c0-880f386ae831 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:50.485736 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 344/666] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Jan 5 14:39:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:50.495297 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e8693-53f4-4334-b982-faf061e35ec8 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:50.523996 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e8693-53f4-4334-b982-faf061e35ec8 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:50.535016 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0689c6-7b9d-4a5c-ac58-292cebc7191b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:50.535837 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0689c6-7b9d-4a5c-ac58-292cebc7191b admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:50.536119 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0689c6-7b9d-4a5c-ac58-292cebc7191b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:50.536396 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0689c6-7b9d-4a5c-ac58-292cebc7191b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:50.550587 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0689c6-7b9d-4a5c-ac58-292cebc7191b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:50.552477 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0689c6-7b9d-4a5c-ac58-292cebc7191b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:50.572937 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-cb0689c6-7b9d-4a5c-ac58-292cebc7191b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:50.574216 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 323/667] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:50.579981 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ebfd5-c7be-4723-a4c0-880f386ae831 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:50.590595 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ebfd5-c7be-4723-a4c0-880f386ae831 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:50.595179 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5abc190-2725-49ab-a4dd-9320e0530dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:50.595894 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abc190-2725-49ab-a4dd-9320e0530dfb admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:50.596226 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abc190-2725-49ab-a4dd-9320e0530dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:50.596509 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abc190-2725-49ab-a4dd-9320e0530dfb admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:50.597287 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5abc190-2725-49ab-a4dd-9320e0530dfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:50.597591 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5abc190-2725-49ab-a4dd-9320e0530dfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:50.599311 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5abc190-2725-49ab-a4dd-9320e0530dfb admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:50.617189 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 345/668] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:50.619229 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0689c6-7b9d-4a5c-ac58-292cebc7191b admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:50.631431 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0689c6-7b9d-4a5c-ac58-292cebc7191b admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:50.636243 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c0692-c0b8-4d32-a76e-268e8ad7f5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:50.637148 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c0692-c0b8-4d32-a76e-268e8ad7f5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:50.637445 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c0692-c0b8-4d32-a76e-268e8ad7f5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:50.637752 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c0692-c0b8-4d32-a76e-268e8ad7f5d0 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:50.646401 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c0692-c0b8-4d32-a76e-268e8ad7f5d0 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:50.648579 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c0692-c0b8-4d32-a76e-268e8ad7f5d0 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:50.664976 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-472c0692-c0b8-4d32-a76e-268e8ad7f5d0 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 05 14:39:50.669293 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 324/669] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:39:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:50.673305 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5abc190-2725-49ab-a4dd-9320e0530dfb admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:50.684274 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5abc190-2725-49ab-a4dd-9320e0530dfb admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:50.689154 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a75db-61bf-47d7-b218-409b9a4a18e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:50.689796 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a75db-61bf-47d7-b218-409b9a4a18e0 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:50.690082 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a75db-61bf-47d7-b218-409b9a4a18e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:50.690406 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a75db-61bf-47d7-b218-409b9a4a18e0 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:50.691264 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a75db-61bf-47d7-b218-409b9a4a18e0 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:50.691639 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a75db-61bf-47d7-b218-409b9a4a18e0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:50.693587 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a75db-61bf-47d7-b218-409b9a4a18e0 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:50.712790 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 346/670] 10.222.0.30 () {56 vars in 1156 bytes} [Wed Jan 5 14:39:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:50.718761 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c0692-c0b8-4d32-a76e-268e8ad7f5d0 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:50.730831 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c0692-c0b8-4d32-a76e-268e8ad7f5d0 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:50.735381 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74dd0d-0123-44b0-b7d8-f395f1f7dfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:50.736215 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74dd0d-0123-44b0-b7d8-f395f1f7dfaa admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:50.736448 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74dd0d-0123-44b0-b7d8-f395f1f7dfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:50.736723 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74dd0d-0123-44b0-b7d8-f395f1f7dfaa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:50.747921 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74dd0d-0123-44b0-b7d8-f395f1f7dfaa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:50.749814 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74dd0d-0123-44b0-b7d8-f395f1f7dfaa admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:50.768792 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-9d74dd0d-0123-44b0-b7d8-f395f1f7dfaa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:50.774067 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 325/671] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:50.776476 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a75db-61bf-47d7-b218-409b9a4a18e0 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:50.787950 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a75db-61bf-47d7-b218-409b9a4a18e0 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:50.794148 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32539add-7659-4275-abf4-578e77ae0067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:50.794823 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32539add-7659-4275-abf4-578e77ae0067 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:50.795106 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32539add-7659-4275-abf4-578e77ae0067 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:50.795382 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32539add-7659-4275-abf4-578e77ae0067 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:50.796124 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32539add-7659-4275-abf4-578e77ae0067 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:50.796428 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32539add-7659-4275-abf4-578e77ae0067 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:50.798066 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32539add-7659-4275-abf4-578e77ae0067 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:50.815183 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 347/672] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:50.816522 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74dd0d-0123-44b0-b7d8-f395f1f7dfaa admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:50.830574 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74dd0d-0123-44b0-b7d8-f395f1f7dfaa admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:50.835898 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93281b37-abb8-4f01-aa12-8e2477e1a667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:50.836687 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93281b37-abb8-4f01-aa12-8e2477e1a667 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:50.836965 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93281b37-abb8-4f01-aa12-8e2477e1a667 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:50.837385 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93281b37-abb8-4f01-aa12-8e2477e1a667 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:50.847180 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93281b37-abb8-4f01-aa12-8e2477e1a667 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:50.849234 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93281b37-abb8-4f01-aa12-8e2477e1a667 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:50.863322 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-93281b37-abb8-4f01-aa12-8e2477e1a667 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:39:50.864817 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 326/673] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:39:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:50.871212 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32539add-7659-4275-abf4-578e77ae0067 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:50.891360 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32539add-7659-4275-abf4-578e77ae0067 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:50.898574 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758d396-f5f5-4811-9878-6858a862bd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:50.899240 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758d396-f5f5-4811-9878-6858a862bd3e admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:50.899521 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758d396-f5f5-4811-9878-6858a862bd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:50.899830 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758d396-f5f5-4811-9878-6858a862bd3e admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:50.900638 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758d396-f5f5-4811-9878-6858a862bd3e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:50.900943 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758d396-f5f5-4811-9878-6858a862bd3e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:50.902839 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758d396-f5f5-4811-9878-6858a862bd3e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:50.922161 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 348/674] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:39:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:50.927876 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93281b37-abb8-4f01-aa12-8e2477e1a667 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:50.942018 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93281b37-abb8-4f01-aa12-8e2477e1a667 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:50.948258 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635cd70-31c8-49a0-a299-a84a44374527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:50.949212 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635cd70-31c8-49a0-a299-a84a44374527 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:50.949579 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635cd70-31c8-49a0-a299-a84a44374527 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:50.949861 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635cd70-31c8-49a0-a299-a84a44374527 admin admin] PATH_INFO: `/v3/projects/fbf90e947f3a4fcdb6f42646a4bf34a1/users/c6ea13fd3e704b16aad5a38606ddc049/roles/9868670385c0469093001f6f2c310f1a` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:50.970490 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635cd70-31c8-49a0-a299-a84a44374527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf90e947f3a4fcdb6f42646a4bf34a1, user_id=c6ea13fd3e704b16aad5a38606ddc049, role_id=9868670385c0469093001f6f2c310f1a)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:50.973285 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635cd70-31c8-49a0-a299-a84a44374527 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:51.059306 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 327/675] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Jan 5 14:39:50 2022] PUT /identity/v3/projects/fbf90e947f3a4fcdb6f42646a4bf34a1/users/c6ea13fd3e704b16aad5a38606ddc049/roles/9868670385c0469093001f6f2c310f1a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:39:52.400912 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e665f-13ec-4b65-8daa-d2b92dc9d165 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:52.401488 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e665f-13ec-4b65-8daa-d2b92dc9d165 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:52.401488 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e665f-13ec-4b65-8daa-d2b92dc9d165 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:52.403576 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 349/676] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:52.408716 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82d3bc-9f5d-4c94-90c6-2a5de03cb17a None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:52.409150 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82d3bc-9f5d-4c94-90c6-2a5de03cb17a None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:52.409317 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82d3bc-9f5d-4c94-90c6-2a5de03cb17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:52.434022 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-8d82d3bc-9f5d-4c94-90c6-2a5de03cb17a None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:52.435237 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-8d82d3bc-9f5d-4c94-90c6-2a5de03cb17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:52.504903 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 328/677] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:52.560140 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e665f-13ec-4b65-8daa-d2b92dc9d165 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:52.585615 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fad4f-3c0e-47e4-bb79-85e3937ddbc2 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:52.586004 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fad4f-3c0e-47e4-bb79-85e3937ddbc2 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:52.586170 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fad4f-3c0e-47e4-bb79-85e3937ddbc2 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:52.587147 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e665f-13ec-4b65-8daa-d2b92dc9d165 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:52.588376 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 329/678] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 14:39:52.593113 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c7573-ec1c-43a0-9ef4-03fcba1bb086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:52.593906 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c7573-ec1c-43a0-9ef4-03fcba1bb086 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:52.594189 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c7573-ec1c-43a0-9ef4-03fcba1bb086 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:52.594463 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c7573-ec1c-43a0-9ef4-03fcba1bb086 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:52.594721 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b961c5-86bb-4a0e-aa3d-549ca397d728 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:52.595013 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b961c5-86bb-4a0e-aa3d-549ca397d728 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:52.595280 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b961c5-86bb-4a0e-aa3d-549ca397d728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:52.616488 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c7573-ec1c-43a0-9ef4-03fcba1bb086 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:52.618395 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c7573-ec1c-43a0-9ef4-03fcba1bb086 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:52.624561 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-09b961c5-86bb-4a0e-aa3d-549ca397d728 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:52.626564 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-09b961c5-86bb-4a0e-aa3d-549ca397d728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:52.649165 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 330/679] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:39:52.654545 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-ae4c7573-ec1c-43a0-9ef4-03fcba1bb086 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:52.655962 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 350/680] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:52.661622 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b961c5-86bb-4a0e-aa3d-549ca397d728 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:52.675235 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b961c5-86bb-4a0e-aa3d-549ca397d728 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:52.679802 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00ac58-4d83-41c5-8c98-870a40bcffb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:52.680457 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00ac58-4d83-41c5-8c98-870a40bcffb7 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:52.680740 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00ac58-4d83-41c5-8c98-870a40bcffb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:52.681569 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00ac58-4d83-41c5-8c98-870a40bcffb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:52.682304 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00ac58-4d83-41c5-8c98-870a40bcffb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:52.682609 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00ac58-4d83-41c5-8c98-870a40bcffb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:52.684216 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00ac58-4d83-41c5-8c98-870a40bcffb7 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:52.700074 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 331/681] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:52.705764 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c7573-ec1c-43a0-9ef4-03fcba1bb086 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:52.717912 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c7573-ec1c-43a0-9ef4-03fcba1bb086 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:52.725672 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8119d1-7c13-40e7-a0fa-83d0c50e5089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:52.726338 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8119d1-7c13-40e7-a0fa-83d0c50e5089 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:52.726622 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8119d1-7c13-40e7-a0fa-83d0c50e5089 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:52.726897 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8119d1-7c13-40e7-a0fa-83d0c50e5089 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:52.727620 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8119d1-7c13-40e7-a0fa-83d0c50e5089 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:52.729644 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8119d1-7c13-40e7-a0fa-83d0c50e5089 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:52.742218 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00ac58-4d83-41c5-8c98-870a40bcffb7 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:52.752852 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00ac58-4d83-41c5-8c98-870a40bcffb7 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:52.759813 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abf661-53d8-4c58-8c05-062f56bc1f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:52.760633 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abf661-53d8-4c58-8c05-062f56bc1f68 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:52.760918 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abf661-53d8-4c58-8c05-062f56bc1f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:52.761234 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abf661-53d8-4c58-8c05-062f56bc1f68 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:52.761957 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abf661-53d8-4c58-8c05-062f56bc1f68 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:52.763001 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING py.warnings [None req-49abf661-53d8-4c58-8c05-062f56bc1f68 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:39:52.763001 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: warnings.warn(msg) Jan 05 14:39:52.763001 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: Jan 05 14:39:52.763933 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abf661-53d8-4c58-8c05-062f56bc1f68 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:52.778718 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-49abf661-53d8-4c58-8c05-062f56bc1f68 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 05 14:39:52.784820 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 332/682] 10.222.0.30 () {56 vars in 1150 bytes} [Wed Jan 5 14:39:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:39:52.786083 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abf661-53d8-4c58-8c05-062f56bc1f68 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:52.797364 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abf661-53d8-4c58-8c05-062f56bc1f68 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:52.802191 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd0795-7b89-4652-8bae-56ffd5d1600a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:52.803098 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd0795-7b89-4652-8bae-56ffd5d1600a admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:52.803303 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd0795-7b89-4652-8bae-56ffd5d1600a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:52.803557 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd0795-7b89-4652-8bae-56ffd5d1600a admin admin] PATH_INFO: `/v3/services` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:52.804353 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd0795-7b89-4652-8bae-56ffd5d1600a admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:52.804665 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd0795-7b89-4652-8bae-56ffd5d1600a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:52.806407 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING py.warnings [None req-07dd0795-7b89-4652-8bae-56ffd5d1600a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:39:52.806407 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: warnings.warn(msg) Jan 05 14:39:52.806407 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: Jan 05 14:39:52.807343 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd0795-7b89-4652-8bae-56ffd5d1600a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:52.817457 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 333/683] 10.222.0.30 () {56 vars in 1145 bytes} [Wed Jan 5 14:39:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:52.819221 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd0795-7b89-4652-8bae-56ffd5d1600a admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:52.830131 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd0795-7b89-4652-8bae-56ffd5d1600a admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:52.834835 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378b034-fa17-4ed6-abcd-aa482642f205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:52.835612 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378b034-fa17-4ed6-abcd-aa482642f205 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:52.835810 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378b034-fa17-4ed6-abcd-aa482642f205 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:52.836104 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378b034-fa17-4ed6-abcd-aa482642f205 admin admin] PATH_INFO: `/v3/services` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:52.836832 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378b034-fa17-4ed6-abcd-aa482642f205 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:52.837701 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378b034-fa17-4ed6-abcd-aa482642f205 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:52.839307 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378b034-fa17-4ed6-abcd-aa482642f205 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:52.851881 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 334/685] 10.222.0.30 () {56 vars in 1145 bytes} [Wed Jan 5 14:39:52 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:52.857235 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 351/685] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Jan 5 14:39:52 2022] POST /identity/v3/users => generated 254 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:39:53.309277 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17364840-a4ba-4ba3-9a14-05242d59078d None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:53.309980 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17364840-a4ba-4ba3-9a14-05242d59078d None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:53.310465 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17364840-a4ba-4ba3-9a14-05242d59078d None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:53.312697 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 335/686] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:53.319091 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11a589-848c-49ec-9438-610d45b6d463 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:53.319636 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11a589-848c-49ec-9438-610d45b6d463 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:53.320105 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11a589-848c-49ec-9438-610d45b6d463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:53.340010 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-4c11a589-848c-49ec-9438-610d45b6d463 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:53.341658 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-4c11a589-848c-49ec-9438-610d45b6d463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:53.350122 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 352/687] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:53.373723 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17364840-a4ba-4ba3-9a14-05242d59078d None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:53.389467 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17364840-a4ba-4ba3-9a14-05242d59078d None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:53.396089 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730ed6b-7260-4e91-97ce-e91cd8046013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:53.397171 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730ed6b-7260-4e91-97ce-e91cd8046013 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:53.397648 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730ed6b-7260-4e91-97ce-e91cd8046013 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:53.398110 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730ed6b-7260-4e91-97ce-e91cd8046013 admin admin] PATH_INFO: `/v3/services/network` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:53.398956 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730ed6b-7260-4e91-97ce-e91cd8046013 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:53.401372 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730ed6b-7260-4e91-97ce-e91cd8046013 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:53.416642 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-9730ed6b-7260-4e91-97ce-e91cd8046013 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 05 14:39:53.418567 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 336/688] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:39:53 2022] GET /identity/v3/services/network => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:53.424558 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11a589-848c-49ec-9438-610d45b6d463 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:53.434896 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11a589-848c-49ec-9438-610d45b6d463 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:53.440153 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066241f2-addd-476e-94d9-a8552928d73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:53.440820 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066241f2-addd-476e-94d9-a8552928d73a admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:53.441131 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066241f2-addd-476e-94d9-a8552928d73a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:53.441417 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066241f2-addd-476e-94d9-a8552928d73a admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:53.442151 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066241f2-addd-476e-94d9-a8552928d73a admin admin] RBAC: Adding query filter params (name=network) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:53.442458 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066241f2-addd-476e-94d9-a8552928d73a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:53.443482 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING py.warnings [None req-066241f2-addd-476e-94d9-a8552928d73a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:39:53.443482 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: warnings.warn(msg) Jan 05 14:39:53.443482 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: Jan 05 14:39:53.444361 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066241f2-addd-476e-94d9-a8552928d73a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:53.451925 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 353/689] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Jan 5 14:39:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:53.457373 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730ed6b-7260-4e91-97ce-e91cd8046013 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:53.469992 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730ed6b-7260-4e91-97ce-e91cd8046013 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:53.474567 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78776f0c-c1c2-4fa4-a834-fa311f77fb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:53.475217 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78776f0c-c1c2-4fa4-a834-fa311f77fb22 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:53.475547 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78776f0c-c1c2-4fa4-a834-fa311f77fb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:53.475822 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78776f0c-c1c2-4fa4-a834-fa311f77fb22 admin admin] PATH_INFO: `/v3/services` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:53.476589 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78776f0c-c1c2-4fa4-a834-fa311f77fb22 admin admin] RBAC: Adding query filter params (type=network) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:53.476892 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78776f0c-c1c2-4fa4-a834-fa311f77fb22 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:53.479293 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78776f0c-c1c2-4fa4-a834-fa311f77fb22 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:53.484558 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 337/690] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Jan 5 14:39:53 2022] GET /identity/v3/services?type=network => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:53.508879 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15035a7c-6d4f-4bf8-b27c-fcd3c7a375ec None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:53.509268 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15035a7c-6d4f-4bf8-b27c-fcd3c7a375ec None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:53.509507 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15035a7c-6d4f-4bf8-b27c-fcd3c7a375ec None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:53.512854 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 354/691] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:53.517608 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df982f-4523-46dd-a305-f82db557fe61 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:53.517908 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df982f-4523-46dd-a305-f82db557fe61 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:53.518169 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df982f-4523-46dd-a305-f82db557fe61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:53.537871 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-b3df982f-4523-46dd-a305-f82db557fe61 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:53.539150 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-b3df982f-4523-46dd-a305-f82db557fe61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:53.551552 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 338/692] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:39:53.601198 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15035a7c-6d4f-4bf8-b27c-fcd3c7a375ec None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:53.620772 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15035a7c-6d4f-4bf8-b27c-fcd3c7a375ec None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:53.625390 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5561e9-a5a5-4ecd-8bb7-b868dee073b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:53.626193 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5561e9-a5a5-4ecd-8bb7-b868dee073b7 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:53.626473 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5561e9-a5a5-4ecd-8bb7-b868dee073b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:53.626740 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5561e9-a5a5-4ecd-8bb7-b868dee073b7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:53.645339 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5561e9-a5a5-4ecd-8bb7-b868dee073b7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:53.653236 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-5a5561e9-a5a5-4ecd-8bb7-b868dee073b7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 05 14:39:53.659068 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 355/693] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:39:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:53.660350 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df982f-4523-46dd-a305-f82db557fe61 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:53.674422 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df982f-4523-46dd-a305-f82db557fe61 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:53.686768 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246dc0ac-fa82-4f9b-82c3-27db008f9c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:53.687498 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dc0ac-fa82-4f9b-82c3-27db008f9c67 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:53.687779 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dc0ac-fa82-4f9b-82c3-27db008f9c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:53.688052 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dc0ac-fa82-4f9b-82c3-27db008f9c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:53.688877 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246dc0ac-fa82-4f9b-82c3-27db008f9c67 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:53.689293 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246dc0ac-fa82-4f9b-82c3-27db008f9c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:53.690972 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246dc0ac-fa82-4f9b-82c3-27db008f9c67 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:53.705878 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 339/694] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:53.711686 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5561e9-a5a5-4ecd-8bb7-b868dee073b7 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:53.726606 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5561e9-a5a5-4ecd-8bb7-b868dee073b7 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:53.737414 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132b603-b3c7-4790-81c2-fdf096e50a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:53.738243 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132b603-b3c7-4790-81c2-fdf096e50a54 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:53.738522 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132b603-b3c7-4790-81c2-fdf096e50a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:53.738798 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132b603-b3c7-4790-81c2-fdf096e50a54 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:53.762277 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132b603-b3c7-4790-81c2-fdf096e50a54 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:53.764241 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132b603-b3c7-4790-81c2-fdf096e50a54 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:53.787614 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-1132b603-b3c7-4790-81c2-fdf096e50a54 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:53.789936 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 356/695] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:53.795285 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246dc0ac-fa82-4f9b-82c3-27db008f9c67 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:53.810326 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246dc0ac-fa82-4f9b-82c3-27db008f9c67 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:53.820586 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba67d4-27ac-41ef-80ca-b802f12958d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:53.822255 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba67d4-27ac-41ef-80ca-b802f12958d5 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:53.822745 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba67d4-27ac-41ef-80ca-b802f12958d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:53.823241 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba67d4-27ac-41ef-80ca-b802f12958d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:53.824191 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba67d4-27ac-41ef-80ca-b802f12958d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:53.824695 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba67d4-27ac-41ef-80ca-b802f12958d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:53.827017 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba67d4-27ac-41ef-80ca-b802f12958d5 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:53.840064 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 340/696] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:53.845763 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132b603-b3c7-4790-81c2-fdf096e50a54 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:53.856767 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132b603-b3c7-4790-81c2-fdf096e50a54 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:53.861744 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37678316-0318-41f6-999b-17d5b8aa6b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:53.862753 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37678316-0318-41f6-999b-17d5b8aa6b24 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:53.863268 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37678316-0318-41f6-999b-17d5b8aa6b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:53.863759 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37678316-0318-41f6-999b-17d5b8aa6b24 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:53.872775 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37678316-0318-41f6-999b-17d5b8aa6b24 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:53.875236 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37678316-0318-41f6-999b-17d5b8aa6b24 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:53.890212 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-37678316-0318-41f6-999b-17d5b8aa6b24 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 05 14:39:53.892046 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 357/697] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Jan 5 14:39:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:53.897843 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba67d4-27ac-41ef-80ca-b802f12958d5 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:53.908397 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba67d4-27ac-41ef-80ca-b802f12958d5 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:53.913679 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852550f3-67df-4653-9459-e69f7c688d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:53.914638 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852550f3-67df-4653-9459-e69f7c688d07 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:53.915718 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852550f3-67df-4653-9459-e69f7c688d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:53.916245 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852550f3-67df-4653-9459-e69f7c688d07 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:53.917375 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852550f3-67df-4653-9459-e69f7c688d07 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:53.917906 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852550f3-67df-4653-9459-e69f7c688d07 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:53.920049 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852550f3-67df-4653-9459-e69f7c688d07 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:53.943261 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 341/698] 10.222.0.30 () {56 vars in 1154 bytes} [Wed Jan 5 14:39:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:53.950456 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37678316-0318-41f6-999b-17d5b8aa6b24 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:53.961720 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37678316-0318-41f6-999b-17d5b8aa6b24 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:53.966499 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d35da-a410-45bb-82c1-d816e15229e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:53.967203 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d35da-a410-45bb-82c1-d816e15229e1 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:53.967489 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d35da-a410-45bb-82c1-d816e15229e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:53.967824 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d35da-a410-45bb-82c1-d816e15229e1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:53.976638 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d35da-a410-45bb-82c1-d816e15229e1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:53.979063 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d35da-a410-45bb-82c1-d816e15229e1 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:53.988637 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 358/699] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:39:53.994950 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852550f3-67df-4653-9459-e69f7c688d07 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:54.005608 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852550f3-67df-4653-9459-e69f7c688d07 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:54.010314 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be2e0e-f969-492e-849c-41d1dcf93ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:54.011225 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be2e0e-f969-492e-849c-41d1dcf93ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:54.011507 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be2e0e-f969-492e-849c-41d1dcf93ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:54.011784 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be2e0e-f969-492e-849c-41d1dcf93ff7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:54.022838 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be2e0e-f969-492e-849c-41d1dcf93ff7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:54.024856 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be2e0e-f969-492e-849c-41d1dcf93ff7 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:54.043433 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-14be2e0e-f969-492e-849c-41d1dcf93ff7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:54.044940 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 342/700] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:54.050397 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d35da-a410-45bb-82c1-d816e15229e1 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:54.059553 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d35da-a410-45bb-82c1-d816e15229e1 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:54.064199 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1bd18-e334-4f7f-a7e7-ce94d6d32fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:54.064848 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1bd18-e334-4f7f-a7e7-ce94d6d32fed admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:54.065157 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1bd18-e334-4f7f-a7e7-ce94d6d32fed admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:54.065436 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1bd18-e334-4f7f-a7e7-ce94d6d32fed admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:54.066233 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1bd18-e334-4f7f-a7e7-ce94d6d32fed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:54.066538 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1bd18-e334-4f7f-a7e7-ce94d6d32fed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:54.068178 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1bd18-e334-4f7f-a7e7-ce94d6d32fed admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:54.081589 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 359/701] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:54.087020 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be2e0e-f969-492e-849c-41d1dcf93ff7 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:54.097545 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be2e0e-f969-492e-849c-41d1dcf93ff7 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:54.102318 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637f2c8-3b65-42aa-bae7-558baf93650f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:54.103211 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637f2c8-3b65-42aa-bae7-558baf93650f admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:54.103502 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637f2c8-3b65-42aa-bae7-558baf93650f admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:54.103780 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637f2c8-3b65-42aa-bae7-558baf93650f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:54.111295 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f637f2c8-3b65-42aa-bae7-558baf93650f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:54.113358 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f637f2c8-3b65-42aa-bae7-558baf93650f admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:54.130784 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-f637f2c8-3b65-42aa-bae7-558baf93650f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:39:54.133328 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 343/702] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:39:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:54.141297 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1bd18-e334-4f7f-a7e7-ce94d6d32fed admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:54.151888 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1bd18-e334-4f7f-a7e7-ce94d6d32fed admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:54.156597 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5455f-01e3-4e0f-8a37-1a1b9807fa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:54.157291 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5455f-01e3-4e0f-8a37-1a1b9807fa1d admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:54.157631 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5455f-01e3-4e0f-8a37-1a1b9807fa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:54.157909 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5455f-01e3-4e0f-8a37-1a1b9807fa1d admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:54.158770 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5455f-01e3-4e0f-8a37-1a1b9807fa1d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:54.159081 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5455f-01e3-4e0f-8a37-1a1b9807fa1d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:54.160995 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5455f-01e3-4e0f-8a37-1a1b9807fa1d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:54.173775 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 360/703] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:39:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:54.179641 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637f2c8-3b65-42aa-bae7-558baf93650f admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:54.192189 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637f2c8-3b65-42aa-bae7-558baf93650f admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:54.197008 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c2263-a241-4eb4-9b54-e835ef835670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:54.197734 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c2263-a241-4eb4-9b54-e835ef835670 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:54.198017 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c2263-a241-4eb4-9b54-e835ef835670 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:54.198298 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c2263-a241-4eb4-9b54-e835ef835670 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:54.199187 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c2263-a241-4eb4-9b54-e835ef835670 admin admin] RBAC: Adding query filter params (role.id=494131614fcf424f92e0817fa7ff6961, scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1, user.id=77db235e2f7046e4bdbad7f31b5e3ebc) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:54.199591 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c2263-a241-4eb4-9b54-e835ef835670 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:54.201562 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c2263-a241-4eb4-9b54-e835ef835670 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:54.208134 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 344/704] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:39:54 2022] GET /identity/v3/role_assignments?user.id=77db235e2f7046e4bdbad7f31b5e3ebc&scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1&role.id=494131614fcf424f92e0817fa7ff6961 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:54.227254 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79938a4-538a-4c01-94fc-59de8643a1a2 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:54.227611 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79938a4-538a-4c01-94fc-59de8643a1a2 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:54.227891 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79938a4-538a-4c01-94fc-59de8643a1a2 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:54.230104 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 361/705] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:54.236007 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d661c-315f-4979-b66f-5743818e1ff4 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:54.236295 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d661c-315f-4979-b66f-5743818e1ff4 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:54.236576 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d661c-315f-4979-b66f-5743818e1ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:54.260199 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-004d661c-315f-4979-b66f-5743818e1ff4 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:54.261449 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-004d661c-315f-4979-b66f-5743818e1ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:54.273015 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 345/706] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 05 14:39:54.314970 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79938a4-538a-4c01-94fc-59de8643a1a2 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:54.334953 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79938a4-538a-4c01-94fc-59de8643a1a2 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:54.345974 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c8019-7de2-4a80-beb8-dbe17460a782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:54.346802 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c8019-7de2-4a80-beb8-dbe17460a782 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:54.347089 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c8019-7de2-4a80-beb8-dbe17460a782 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:54.347372 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c8019-7de2-4a80-beb8-dbe17460a782 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:54.362226 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c8019-7de2-4a80-beb8-dbe17460a782 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:54.370131 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-411c8019-7de2-4a80-beb8-dbe17460a782 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 05 14:39:54.371725 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 362/707] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Jan 5 14:39:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:54.377656 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d661c-315f-4979-b66f-5743818e1ff4 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:54.391418 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d661c-315f-4979-b66f-5743818e1ff4 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:54.403989 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25dfeb3-c288-46a7-956e-86156bdca511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:54.404729 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25dfeb3-c288-46a7-956e-86156bdca511 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:54.405018 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25dfeb3-c288-46a7-956e-86156bdca511 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:54.405484 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25dfeb3-c288-46a7-956e-86156bdca511 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:54.406177 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25dfeb3-c288-46a7-956e-86156bdca511 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:54.406537 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25dfeb3-c288-46a7-956e-86156bdca511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:54.408219 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25dfeb3-c288-46a7-956e-86156bdca511 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:54.420787 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 346/708] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Jan 5 14:39:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:54.426025 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c8019-7de2-4a80-beb8-dbe17460a782 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:54.442683 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c8019-7de2-4a80-beb8-dbe17460a782 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:54.453619 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc645e-a611-406c-9669-4f0043d7a04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:54.454438 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc645e-a611-406c-9669-4f0043d7a04a admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:54.454724 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc645e-a611-406c-9669-4f0043d7a04a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:54.455000 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc645e-a611-406c-9669-4f0043d7a04a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:54.477297 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc645e-a611-406c-9669-4f0043d7a04a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:54.479718 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc645e-a611-406c-9669-4f0043d7a04a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:54.509821 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-f2bc645e-a611-406c-9669-4f0043d7a04a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:54.511039 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 363/709] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:54.516833 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25dfeb3-c288-46a7-956e-86156bdca511 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:54.532823 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25dfeb3-c288-46a7-956e-86156bdca511 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:54.540829 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2592e-4c72-491c-acbc-f4b7b6622e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:54.541989 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2592e-4c72-491c-acbc-f4b7b6622e5e admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:54.542549 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2592e-4c72-491c-acbc-f4b7b6622e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:54.543061 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2592e-4c72-491c-acbc-f4b7b6622e5e admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:54.544066 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2592e-4c72-491c-acbc-f4b7b6622e5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:54.544629 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2592e-4c72-491c-acbc-f4b7b6622e5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:54.550837 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2592e-4c72-491c-acbc-f4b7b6622e5e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:54.572945 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 347/710] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:54.578392 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc645e-a611-406c-9669-4f0043d7a04a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:54.594113 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc645e-a611-406c-9669-4f0043d7a04a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:54.606721 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d12a27-5418-48f0-8790-53e46b169cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:54.607535 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d12a27-5418-48f0-8790-53e46b169cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:54.607823 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d12a27-5418-48f0-8790-53e46b169cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:54.608102 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d12a27-5418-48f0-8790-53e46b169cd3 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:54.626220 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d12a27-5418-48f0-8790-53e46b169cd3 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:54.628510 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d12a27-5418-48f0-8790-53e46b169cd3 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:54.649098 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-40d12a27-5418-48f0-8790-53e46b169cd3 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 05 14:39:54.651265 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 364/711] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:39:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:54.656760 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2592e-4c72-491c-acbc-f4b7b6622e5e admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:54.668095 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2592e-4c72-491c-acbc-f4b7b6622e5e admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:54.676475 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff25bc0-2466-4869-be87-a147a1baa8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:54.677593 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff25bc0-2466-4869-be87-a147a1baa8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:54.678118 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff25bc0-2466-4869-be87-a147a1baa8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:54.678603 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff25bc0-2466-4869-be87-a147a1baa8a4 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:54.679744 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff25bc0-2466-4869-be87-a147a1baa8a4 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:54.680255 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff25bc0-2466-4869-be87-a147a1baa8a4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:54.682498 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff25bc0-2466-4869-be87-a147a1baa8a4 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:54.704555 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 348/712] 10.222.0.30 () {56 vars in 1156 bytes} [Wed Jan 5 14:39:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:54.709742 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d12a27-5418-48f0-8790-53e46b169cd3 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:54.721167 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d12a27-5418-48f0-8790-53e46b169cd3 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:54.728814 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181028d-393d-4b59-abb5-4060863cd986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:54.729790 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181028d-393d-4b59-abb5-4060863cd986 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:54.730279 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181028d-393d-4b59-abb5-4060863cd986 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:54.730803 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181028d-393d-4b59-abb5-4060863cd986 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:54.744961 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181028d-393d-4b59-abb5-4060863cd986 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:54.747171 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181028d-393d-4b59-abb5-4060863cd986 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:54.757831 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 365/713] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:39:54.763926 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff25bc0-2466-4869-be87-a147a1baa8a4 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:54.775680 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff25bc0-2466-4869-be87-a147a1baa8a4 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:54.782263 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2361d-43b9-41e5-8d23-c7e5c055c829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:54.783438 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2361d-43b9-41e5-8d23-c7e5c055c829 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:54.783973 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2361d-43b9-41e5-8d23-c7e5c055c829 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:54.784470 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2361d-43b9-41e5-8d23-c7e5c055c829 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:54.800780 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2361d-43b9-41e5-8d23-c7e5c055c829 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:54.802991 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2361d-43b9-41e5-8d23-c7e5c055c829 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:54.822835 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-72e2361d-43b9-41e5-8d23-c7e5c055c829 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:54.824652 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 349/714] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:54.829934 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181028d-393d-4b59-abb5-4060863cd986 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:54.839495 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181028d-393d-4b59-abb5-4060863cd986 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:54.849467 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edefa9-905a-435c-b386-71b4417878e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:54.850458 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edefa9-905a-435c-b386-71b4417878e7 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:54.850962 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edefa9-905a-435c-b386-71b4417878e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:54.851494 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edefa9-905a-435c-b386-71b4417878e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:54.852491 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edefa9-905a-435c-b386-71b4417878e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:54.853045 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edefa9-905a-435c-b386-71b4417878e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:54.854971 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edefa9-905a-435c-b386-71b4417878e7 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:54.869849 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 366/715] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:54.875331 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2361d-43b9-41e5-8d23-c7e5c055c829 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:54.887273 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2361d-43b9-41e5-8d23-c7e5c055c829 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:54.893459 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54b4c6-21ec-4b7a-8bfa-45ea9a46871c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:54.894526 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54b4c6-21ec-4b7a-8bfa-45ea9a46871c admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:54.895057 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54b4c6-21ec-4b7a-8bfa-45ea9a46871c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:54.895610 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54b4c6-21ec-4b7a-8bfa-45ea9a46871c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:54.906669 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54b4c6-21ec-4b7a-8bfa-45ea9a46871c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:54.908959 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54b4c6-21ec-4b7a-8bfa-45ea9a46871c admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:54.925854 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-5f54b4c6-21ec-4b7a-8bfa-45ea9a46871c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:39:54.927379 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 350/716] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:39:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:54.933026 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edefa9-905a-435c-b386-71b4417878e7 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:54.943580 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edefa9-905a-435c-b386-71b4417878e7 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:54.954234 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada89a2-d4a3-45ac-b2c4-f872ea3f469a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:54.954898 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada89a2-d4a3-45ac-b2c4-f872ea3f469a admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:54.955226 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada89a2-d4a3-45ac-b2c4-f872ea3f469a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:54.955508 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada89a2-d4a3-45ac-b2c4-f872ea3f469a admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:54.956307 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada89a2-d4a3-45ac-b2c4-f872ea3f469a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:54.956618 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada89a2-d4a3-45ac-b2c4-f872ea3f469a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:54.958502 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada89a2-d4a3-45ac-b2c4-f872ea3f469a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:54.978480 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 367/717] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:39:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:54.983899 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54b4c6-21ec-4b7a-8bfa-45ea9a46871c admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:54.998626 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54b4c6-21ec-4b7a-8bfa-45ea9a46871c admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:55.006359 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b91961-b937-4888-bb0e-22e93522e29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:55.007247 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b91961-b937-4888-bb0e-22e93522e29e admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:55.007766 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b91961-b937-4888-bb0e-22e93522e29e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:55.008239 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b91961-b937-4888-bb0e-22e93522e29e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:55.009516 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b91961-b937-4888-bb0e-22e93522e29e admin admin] RBAC: Adding query filter params (role.id=9868670385c0469093001f6f2c310f1a, scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1, user.id=c6ea13fd3e704b16aad5a38606ddc049) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:55.010032 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b91961-b937-4888-bb0e-22e93522e29e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:55.012206 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b91961-b937-4888-bb0e-22e93522e29e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:55.022213 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 351/718] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:39:54 2022] GET /identity/v3/role_assignments?user.id=c6ea13fd3e704b16aad5a38606ddc049&scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1&role.id=9868670385c0469093001f6f2c310f1a => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:55.940653 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3ffe0-c5dd-4848-b683-e9a7defc5a37 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:55.941193 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3ffe0-c5dd-4848-b683-e9a7defc5a37 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:55.941269 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3ffe0-c5dd-4848-b683-e9a7defc5a37 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:55.943340 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 368/719] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:55.948928 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac03a4a-4e7a-40a0-ae46-6829c31f0d15 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:55.949427 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac03a4a-4e7a-40a0-ae46-6829c31f0d15 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:55.949612 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac03a4a-4e7a-40a0-ae46-6829c31f0d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:55.971073 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-1ac03a4a-4e7a-40a0-ae46-6829c31f0d15 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:55.972258 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-1ac03a4a-4e7a-40a0-ae46-6829c31f0d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:55.981603 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 352/720] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 05 14:39:56.018172 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3ffe0-c5dd-4848-b683-e9a7defc5a37 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:56.034952 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3ffe0-c5dd-4848-b683-e9a7defc5a37 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:56.039485 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63718c1f-42fc-4d54-a8c6-6dd7e1b20d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:56.040160 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63718c1f-42fc-4d54-a8c6-6dd7e1b20d6d admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:56.040448 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63718c1f-42fc-4d54-a8c6-6dd7e1b20d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:56.040723 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63718c1f-42fc-4d54-a8c6-6dd7e1b20d6d admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:56.041506 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63718c1f-42fc-4d54-a8c6-6dd7e1b20d6d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:56.042531 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING py.warnings [None req-63718c1f-42fc-4d54-a8c6-6dd7e1b20d6d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:39:56.042531 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: warnings.warn(msg) Jan 05 14:39:56.042531 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: Jan 05 14:39:56.043412 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63718c1f-42fc-4d54-a8c6-6dd7e1b20d6d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:56.160677 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 369/721] 10.222.0.30 () {60 vars in 1162 bytes} [Wed Jan 5 14:39:56 2022] POST /identity/v3/services => generated 251 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:39:56.198607 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278e53a-1517-4198-b293-8f044f02f3d1 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:56.198903 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278e53a-1517-4198-b293-8f044f02f3d1 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:56.199058 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278e53a-1517-4198-b293-8f044f02f3d1 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:56.201198 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 353/722] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:56.206962 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ab1f4-6e7e-47fd-8e14-f738ad01997e None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:56.207262 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ab1f4-6e7e-47fd-8e14-f738ad01997e None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:56.207527 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ab1f4-6e7e-47fd-8e14-f738ad01997e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:56.230220 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-613ab1f4-6e7e-47fd-8e14-f738ad01997e None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:56.231434 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-613ab1f4-6e7e-47fd-8e14-f738ad01997e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:56.251696 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 370/723] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:56 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:39:56.306695 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278e53a-1517-4198-b293-8f044f02f3d1 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:56.321866 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278e53a-1517-4198-b293-8f044f02f3d1 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:56.331376 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18222b-44e9-4baa-8e85-b4f9762f12bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:56.332187 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18222b-44e9-4baa-8e85-b4f9762f12bf admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:56.332469 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18222b-44e9-4baa-8e85-b4f9762f12bf admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:56.332753 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18222b-44e9-4baa-8e85-b4f9762f12bf admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:56.346864 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18222b-44e9-4baa-8e85-b4f9762f12bf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:56.354338 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-ee18222b-44e9-4baa-8e85-b4f9762f12bf admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 05 14:39:56.355909 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 354/724] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Jan 5 14:39:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:56.361485 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ab1f4-6e7e-47fd-8e14-f738ad01997e None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:56.374383 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ab1f4-6e7e-47fd-8e14-f738ad01997e None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:56.385957 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b13d8d-0fdc-47b7-9266-d6a8deeef640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:56.386655 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b13d8d-0fdc-47b7-9266-d6a8deeef640 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:56.386930 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b13d8d-0fdc-47b7-9266-d6a8deeef640 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:56.387205 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b13d8d-0fdc-47b7-9266-d6a8deeef640 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:56.387979 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b13d8d-0fdc-47b7-9266-d6a8deeef640 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:56.388283 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b13d8d-0fdc-47b7-9266-d6a8deeef640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:56.389935 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b13d8d-0fdc-47b7-9266-d6a8deeef640 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:56.407440 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 371/725] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Jan 5 14:39:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:56.412985 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18222b-44e9-4baa-8e85-b4f9762f12bf admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:56.423981 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18222b-44e9-4baa-8e85-b4f9762f12bf admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:56.436637 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084b758-a19d-4934-af14-f2d580376e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:56.437471 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084b758-a19d-4934-af14-f2d580376e30 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:56.437753 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084b758-a19d-4934-af14-f2d580376e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:56.438025 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084b758-a19d-4934-af14-f2d580376e30 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:56.452896 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084b758-a19d-4934-af14-f2d580376e30 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:56.454644 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084b758-a19d-4934-af14-f2d580376e30 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:56.479272 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-a084b758-a19d-4934-af14-f2d580376e30 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:56.480803 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 355/726] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:56.486259 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b13d8d-0fdc-47b7-9266-d6a8deeef640 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:56.503962 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b13d8d-0fdc-47b7-9266-d6a8deeef640 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:56.509873 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f945c-9eee-46b3-b490-362d04804d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:56.510544 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f945c-9eee-46b3-b490-362d04804d04 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:56.510827 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f945c-9eee-46b3-b490-362d04804d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:56.511112 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f945c-9eee-46b3-b490-362d04804d04 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:56.511850 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f945c-9eee-46b3-b490-362d04804d04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:56.512160 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f945c-9eee-46b3-b490-362d04804d04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:56.513913 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f945c-9eee-46b3-b490-362d04804d04 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:56.527964 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 372/727] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:56.533564 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084b758-a19d-4934-af14-f2d580376e30 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:56.543583 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084b758-a19d-4934-af14-f2d580376e30 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:56.551523 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50f8cf-7104-42f1-8eaf-7331f727bf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:56.552386 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50f8cf-7104-42f1-8eaf-7331f727bf9e admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:56.552945 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50f8cf-7104-42f1-8eaf-7331f727bf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:56.553459 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50f8cf-7104-42f1-8eaf-7331f727bf9e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:56.566516 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50f8cf-7104-42f1-8eaf-7331f727bf9e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:56.568924 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50f8cf-7104-42f1-8eaf-7331f727bf9e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:56.591862 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-4d50f8cf-7104-42f1-8eaf-7331f727bf9e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 05 14:39:56.593774 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 356/728] 10.222.0.30 () {56 vars in 1138 bytes} [Wed Jan 5 14:39:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:56.600566 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f945c-9eee-46b3-b490-362d04804d04 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:56.614363 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f945c-9eee-46b3-b490-362d04804d04 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:56.622723 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086082c5-8864-4825-82a7-78daeccff109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:56.623421 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086082c5-8864-4825-82a7-78daeccff109 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:56.623707 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086082c5-8864-4825-82a7-78daeccff109 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:56.623984 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086082c5-8864-4825-82a7-78daeccff109 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:56.624860 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086082c5-8864-4825-82a7-78daeccff109 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:56.625206 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086082c5-8864-4825-82a7-78daeccff109 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:56.627380 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086082c5-8864-4825-82a7-78daeccff109 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:56.657113 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 373/729] 10.222.0.30 () {56 vars in 1170 bytes} [Wed Jan 5 14:39:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:56.662352 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50f8cf-7104-42f1-8eaf-7331f727bf9e admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:56.681192 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50f8cf-7104-42f1-8eaf-7331f727bf9e admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:56.689714 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ea034-a750-42e5-8e3a-240ff1f71f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:56.690610 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ea034-a750-42e5-8e3a-240ff1f71f2f admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:56.691111 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ea034-a750-42e5-8e3a-240ff1f71f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:56.691593 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ea034-a750-42e5-8e3a-240ff1f71f2f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:56.700871 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ea034-a750-42e5-8e3a-240ff1f71f2f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:56.702992 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ea034-a750-42e5-8e3a-240ff1f71f2f admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:56.712897 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18703e-3779-442f-b90d-d8a86905aaa3 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:56.713227 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18703e-3779-442f-b90d-d8a86905aaa3 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:56.713632 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18703e-3779-442f-b90d-d8a86905aaa3 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:56.715539 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 374/730] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:56.719900 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 357/731] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:56 2022] GET /identity/v3/auth/tokens => generated 1018 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:39:56.720975 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3148c44-613a-4e29-8c43-b690638fbcf1 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:56.721510 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3148c44-613a-4e29-8c43-b690638fbcf1 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:56.722001 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3148c44-613a-4e29-8c43-b690638fbcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:56.724955 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ea034-a750-42e5-8e3a-240ff1f71f2f admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:56.734424 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ea034-a750-42e5-8e3a-240ff1f71f2f admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:56.745893 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-f3148c44-613a-4e29-8c43-b690638fbcf1 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:56.747391 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-f3148c44-613a-4e29-8c43-b690638fbcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:56.750655 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98827faf-6aea-43c1-a3b5-a637be04134a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:56.751491 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98827faf-6aea-43c1-a3b5-a637be04134a admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:56.751740 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98827faf-6aea-43c1-a3b5-a637be04134a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:56.752277 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98827faf-6aea-43c1-a3b5-a637be04134a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:56.756943 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 375/732] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:56 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:39:56.773650 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98827faf-6aea-43c1-a3b5-a637be04134a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:56.776124 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98827faf-6aea-43c1-a3b5-a637be04134a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:56.800807 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-98827faf-6aea-43c1-a3b5-a637be04134a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:56.802356 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 358/733] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:39:56.807691 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3148c44-613a-4e29-8c43-b690638fbcf1 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:56.812124 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98827faf-6aea-43c1-a3b5-a637be04134a admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:56.823488 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98827faf-6aea-43c1-a3b5-a637be04134a admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:56.823958 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3148c44-613a-4e29-8c43-b690638fbcf1 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:56.830770 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6f046-1121-4cd6-89f0-954b13d5e244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:56.831503 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6f046-1121-4cd6-89f0-954b13d5e244 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:56.831935 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6f046-1121-4cd6-89f0-954b13d5e244 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:56.832291 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6f046-1121-4cd6-89f0-954b13d5e244 admin admin] PATH_INFO: `/v3/services` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:56.833279 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6f046-1121-4cd6-89f0-954b13d5e244 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:56.834016 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b1be5-40c2-48dc-be7e-b76917ef93f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:56.834520 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING py.warnings [None req-b6d6f046-1121-4cd6-89f0-954b13d5e244 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:39:56.834520 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: warnings.warn(msg) Jan 05 14:39:56.834520 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: Jan 05 14:39:56.835217 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b1be5-40c2-48dc-be7e-b76917ef93f6 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:56.835597 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6f046-1121-4cd6-89f0-954b13d5e244 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:56.835874 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b1be5-40c2-48dc-be7e-b76917ef93f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:56.836333 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b1be5-40c2-48dc-be7e-b76917ef93f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:56.837319 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b1be5-40c2-48dc-be7e-b76917ef93f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:56.837802 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b1be5-40c2-48dc-be7e-b76917ef93f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:56.839820 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b1be5-40c2-48dc-be7e-b76917ef93f6 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:56.857226 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 376/734] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:56.862431 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b1be5-40c2-48dc-be7e-b76917ef93f6 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:56.872797 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b1be5-40c2-48dc-be7e-b76917ef93f6 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:56.877797 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c87726-8ed1-4592-b0c5-571e1acf1f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:56.878589 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c87726-8ed1-4592-b0c5-571e1acf1f29 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:56.878881 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c87726-8ed1-4592-b0c5-571e1acf1f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:56.879160 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c87726-8ed1-4592-b0c5-571e1acf1f29 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:56.886446 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c87726-8ed1-4592-b0c5-571e1acf1f29 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:56.888416 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c87726-8ed1-4592-b0c5-571e1acf1f29 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:56.902546 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-60c87726-8ed1-4592-b0c5-571e1acf1f29 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:39:56.904381 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 377/735] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:39:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:56.910000 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c87726-8ed1-4592-b0c5-571e1acf1f29 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:56.920868 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c87726-8ed1-4592-b0c5-571e1acf1f29 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:56.925933 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db77d8e-64e1-40d4-80ba-343e7b7a5cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:56.930964 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db77d8e-64e1-40d4-80ba-343e7b7a5cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:56.930964 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db77d8e-64e1-40d4-80ba-343e7b7a5cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:56.930964 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db77d8e-64e1-40d4-80ba-343e7b7a5cb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:56.930964 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db77d8e-64e1-40d4-80ba-343e7b7a5cb4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:56.930964 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db77d8e-64e1-40d4-80ba-343e7b7a5cb4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:56.930964 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db77d8e-64e1-40d4-80ba-343e7b7a5cb4 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:56.948415 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 378/736] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:39:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:56.949680 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db77d8e-64e1-40d4-80ba-343e7b7a5cb4 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:56.966880 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db77d8e-64e1-40d4-80ba-343e7b7a5cb4 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:56.967101 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 359/737] 10.222.0.30 () {60 vars in 1162 bytes} [Wed Jan 5 14:39:56 2022] POST /identity/v3/services => generated 240 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 14:39:56.977361 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141b070-b16a-4049-9290-4db24ba0f663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:56.978978 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141b070-b16a-4049-9290-4db24ba0f663 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:56.979424 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141b070-b16a-4049-9290-4db24ba0f663 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:56.979852 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141b070-b16a-4049-9290-4db24ba0f663 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:56.981035 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141b070-b16a-4049-9290-4db24ba0f663 admin admin] RBAC: Adding query filter params (role.id=9868670385c0469093001f6f2c310f1a, scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1, user.id=29314b0be6534c79b36f31402d51d17b) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:56.981591 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141b070-b16a-4049-9290-4db24ba0f663 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:56.983929 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141b070-b16a-4049-9290-4db24ba0f663 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:56.997250 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 379/738] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:39:56 2022] GET /identity/v3/role_assignments?user.id=29314b0be6534c79b36f31402d51d17b&scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1&role.id=9868670385c0469093001f6f2c310f1a => generated 259 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:57.200031 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5ecdb-4372-4742-9ab0-b936f56d5cf1 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:57.200557 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5ecdb-4372-4742-9ab0-b936f56d5cf1 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:57.200974 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5ecdb-4372-4742-9ab0-b936f56d5cf1 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:57.203262 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 360/739] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:57.209350 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16401aec-c77f-4dc7-bf39-cbbde82f33b2 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:57.209685 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16401aec-c77f-4dc7-bf39-cbbde82f33b2 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:57.209919 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16401aec-c77f-4dc7-bf39-cbbde82f33b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:57.231371 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-16401aec-c77f-4dc7-bf39-cbbde82f33b2 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:57.232511 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-16401aec-c77f-4dc7-bf39-cbbde82f33b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:57.240741 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 380/740] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:57 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:39:57.265957 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5ecdb-4372-4742-9ab0-b936f56d5cf1 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:57.280041 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5ecdb-4372-4742-9ab0-b936f56d5cf1 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:57.285413 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f376a7-ab87-42ea-bfb6-312242eb5ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:57.286269 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f376a7-ab87-42ea-bfb6-312242eb5ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:57.286589 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f376a7-ab87-42ea-bfb6-312242eb5ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:57.286880 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f376a7-ab87-42ea-bfb6-312242eb5ec8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:57.299054 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f376a7-ab87-42ea-bfb6-312242eb5ec8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:57.307021 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-c4f376a7-ab87-42ea-bfb6-312242eb5ec8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 05 14:39:57.308529 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 361/741] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:39:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:57.314357 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16401aec-c77f-4dc7-bf39-cbbde82f33b2 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:57.323745 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16401aec-c77f-4dc7-bf39-cbbde82f33b2 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:57.328484 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5d5a5-2854-4164-ae13-f34be719defe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:57.329184 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5d5a5-2854-4164-ae13-f34be719defe admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:57.329470 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5d5a5-2854-4164-ae13-f34be719defe admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:57.329751 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5d5a5-2854-4164-ae13-f34be719defe admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:57.330521 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5d5a5-2854-4164-ae13-f34be719defe admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:57.330829 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5d5a5-2854-4164-ae13-f34be719defe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:57.332499 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5d5a5-2854-4164-ae13-f34be719defe admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:57.342283 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 381/742] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:57.347844 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f376a7-ab87-42ea-bfb6-312242eb5ec8 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:57.357907 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f376a7-ab87-42ea-bfb6-312242eb5ec8 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:57.362663 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65410c-eee6-425c-9356-6db94edea411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:57.363503 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65410c-eee6-425c-9356-6db94edea411 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:57.363785 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65410c-eee6-425c-9356-6db94edea411 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:57.364061 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65410c-eee6-425c-9356-6db94edea411 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:57.376642 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65410c-eee6-425c-9356-6db94edea411 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:57.378912 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65410c-eee6-425c-9356-6db94edea411 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:57.396043 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-1c65410c-eee6-425c-9356-6db94edea411 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:57.397571 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 362/743] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:57.403748 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5d5a5-2854-4164-ae13-f34be719defe admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:57.413964 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5d5a5-2854-4164-ae13-f34be719defe admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:57.418762 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa04cf-2323-48a1-af2a-ee2399b29e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:57.419482 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa04cf-2323-48a1-af2a-ee2399b29e52 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:57.419766 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa04cf-2323-48a1-af2a-ee2399b29e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:57.420044 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa04cf-2323-48a1-af2a-ee2399b29e52 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:57.420833 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa04cf-2323-48a1-af2a-ee2399b29e52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:57.421171 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa04cf-2323-48a1-af2a-ee2399b29e52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:57.422833 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa04cf-2323-48a1-af2a-ee2399b29e52 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:57.436227 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 382/744] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:57.441672 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65410c-eee6-425c-9356-6db94edea411 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:57.452406 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65410c-eee6-425c-9356-6db94edea411 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:57.457168 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5501503-b0ad-4ed2-93b0-69c0a8cf7b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:57.458006 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5501503-b0ad-4ed2-93b0-69c0a8cf7b9f admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:57.458291 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5501503-b0ad-4ed2-93b0-69c0a8cf7b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:57.458572 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5501503-b0ad-4ed2-93b0-69c0a8cf7b9f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:57.467202 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5501503-b0ad-4ed2-93b0-69c0a8cf7b9f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:57.469348 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5501503-b0ad-4ed2-93b0-69c0a8cf7b9f admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:57.483934 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-f5501503-b0ad-4ed2-93b0-69c0a8cf7b9f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 05 14:39:57.489422 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 363/745] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Jan 5 14:39:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:57.490897 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa04cf-2323-48a1-af2a-ee2399b29e52 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:57.501430 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa04cf-2323-48a1-af2a-ee2399b29e52 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:57.506452 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99903177-4d5d-4246-8ad6-4a857108210d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:57.507175 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99903177-4d5d-4246-8ad6-4a857108210d admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:57.507511 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99903177-4d5d-4246-8ad6-4a857108210d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:57.507792 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99903177-4d5d-4246-8ad6-4a857108210d admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:57.508714 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99903177-4d5d-4246-8ad6-4a857108210d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:57.509603 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99903177-4d5d-4246-8ad6-4a857108210d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:57.511575 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99903177-4d5d-4246-8ad6-4a857108210d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:57.536404 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 383/746] 10.222.0.30 () {56 vars in 1154 bytes} [Wed Jan 5 14:39:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:57.542459 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5501503-b0ad-4ed2-93b0-69c0a8cf7b9f admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:57.555919 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5501503-b0ad-4ed2-93b0-69c0a8cf7b9f admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:57.562258 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066f67a-f933-47f2-9ab8-aed2f642343b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:57.563101 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066f67a-f933-47f2-9ab8-aed2f642343b admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:57.563384 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066f67a-f933-47f2-9ab8-aed2f642343b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:57.563658 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066f67a-f933-47f2-9ab8-aed2f642343b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:57.582552 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066f67a-f933-47f2-9ab8-aed2f642343b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:57.584466 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066f67a-f933-47f2-9ab8-aed2f642343b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:57.609336 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-f066f67a-f933-47f2-9ab8-aed2f642343b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:57.610909 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 364/747] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:57.616382 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99903177-4d5d-4246-8ad6-4a857108210d admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:57.634570 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99903177-4d5d-4246-8ad6-4a857108210d admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:57.646207 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152998e2-85a0-4df5-ae94-a47b6a414b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:57.647146 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152998e2-85a0-4df5-ae94-a47b6a414b8a admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:57.647627 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152998e2-85a0-4df5-ae94-a47b6a414b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:57.648097 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152998e2-85a0-4df5-ae94-a47b6a414b8a admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:57.649038 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152998e2-85a0-4df5-ae94-a47b6a414b8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:57.650692 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152998e2-85a0-4df5-ae94-a47b6a414b8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:57.652550 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152998e2-85a0-4df5-ae94-a47b6a414b8a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:57.671281 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 384/748] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:57.676836 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066f67a-f933-47f2-9ab8-aed2f642343b admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:57.690039 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066f67a-f933-47f2-9ab8-aed2f642343b admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:57.697486 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70043d-814c-44c0-9ced-9d6708e9163b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:57.698379 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70043d-814c-44c0-9ced-9d6708e9163b admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:57.698662 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70043d-814c-44c0-9ced-9d6708e9163b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:57.698934 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70043d-814c-44c0-9ced-9d6708e9163b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:57.718229 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70043d-814c-44c0-9ced-9d6708e9163b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:57.720269 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70043d-814c-44c0-9ced-9d6708e9163b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:57.737103 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-fa70043d-814c-44c0-9ced-9d6708e9163b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:39:57.738214 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 365/749] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:39:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:57.743902 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152998e2-85a0-4df5-ae94-a47b6a414b8a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:57.762486 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152998e2-85a0-4df5-ae94-a47b6a414b8a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:57.772833 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26647e8c-e75c-494e-a0b7-2d2d731f7917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:57.773751 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26647e8c-e75c-494e-a0b7-2d2d731f7917 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:57.774235 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26647e8c-e75c-494e-a0b7-2d2d731f7917 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:57.775286 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26647e8c-e75c-494e-a0b7-2d2d731f7917 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:57.776279 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26647e8c-e75c-494e-a0b7-2d2d731f7917 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:57.776786 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26647e8c-e75c-494e-a0b7-2d2d731f7917 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:57.782898 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26647e8c-e75c-494e-a0b7-2d2d731f7917 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:57.800510 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 385/750] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:39:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:57.807087 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70043d-814c-44c0-9ced-9d6708e9163b admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:57.822993 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70043d-814c-44c0-9ced-9d6708e9163b admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:57.830299 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94e84b-0cd4-43cf-90c4-fff8dedbbd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:57.831238 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94e84b-0cd4-43cf-90c4-fff8dedbbd29 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:57.831525 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94e84b-0cd4-43cf-90c4-fff8dedbbd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:57.831798 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94e84b-0cd4-43cf-90c4-fff8dedbbd29 admin admin] PATH_INFO: `/v3/projects/fbf90e947f3a4fcdb6f42646a4bf34a1/users/77db235e2f7046e4bdbad7f31b5e3ebc/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:57.834998 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94e84b-0cd4-43cf-90c4-fff8dedbbd29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf90e947f3a4fcdb6f42646a4bf34a1, user_id=77db235e2f7046e4bdbad7f31b5e3ebc, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:57.837817 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94e84b-0cd4-43cf-90c4-fff8dedbbd29 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:57.965718 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 366/751] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Jan 5 14:39:57 2022] PUT /identity/v3/projects/fbf90e947f3a4fcdb6f42646a4bf34a1/users/77db235e2f7046e4bdbad7f31b5e3ebc/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:39:58.591762 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c80c18-489f-4d02-9caf-e178ed53100c None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:58.592299 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c80c18-489f-4d02-9caf-e178ed53100c None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:58.592514 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c80c18-489f-4d02-9caf-e178ed53100c None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:58.596557 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 386/752] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:58.601797 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535e838-b92d-468c-ad6e-b11162b5a4fc None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:58.602231 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535e838-b92d-468c-ad6e-b11162b5a4fc None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:58.602421 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535e838-b92d-468c-ad6e-b11162b5a4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:58.630112 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-0535e838-b92d-468c-ad6e-b11162b5a4fc None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:58.631334 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-0535e838-b92d-468c-ad6e-b11162b5a4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:58.705047 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 367/753] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:58 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:39:58.751470 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c80c18-489f-4d02-9caf-e178ed53100c None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:58.770764 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c80c18-489f-4d02-9caf-e178ed53100c None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:58.775278 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be476605-9ff1-4dd8-8b67-c43d8a340ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:58.776061 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be476605-9ff1-4dd8-8b67-c43d8a340ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:58.776406 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be476605-9ff1-4dd8-8b67-c43d8a340ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:58.776684 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be476605-9ff1-4dd8-8b67-c43d8a340ca5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:58.791462 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be476605-9ff1-4dd8-8b67-c43d8a340ca5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:39:58.798528 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-be476605-9ff1-4dd8-8b67-c43d8a340ca5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 05 14:39:58.804212 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 387/754] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:39:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:58.805578 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535e838-b92d-468c-ad6e-b11162b5a4fc None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:58.815022 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535e838-b92d-468c-ad6e-b11162b5a4fc None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:58.821778 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650ffbc-4b3e-4ad5-a4ff-8e0dc0ba0e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:58.822439 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650ffbc-4b3e-4ad5-a4ff-8e0dc0ba0e96 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:58.822722 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650ffbc-4b3e-4ad5-a4ff-8e0dc0ba0e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:58.823004 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650ffbc-4b3e-4ad5-a4ff-8e0dc0ba0e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:58.823768 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650ffbc-4b3e-4ad5-a4ff-8e0dc0ba0e96 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:58.824074 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650ffbc-4b3e-4ad5-a4ff-8e0dc0ba0e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:58.825719 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650ffbc-4b3e-4ad5-a4ff-8e0dc0ba0e96 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:58.836476 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 368/755] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:39:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:58.842648 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be476605-9ff1-4dd8-8b67-c43d8a340ca5 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:58.854158 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be476605-9ff1-4dd8-8b67-c43d8a340ca5 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:58.861659 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffb55b-26c2-48aa-91e4-0bdeb5872b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:58.862447 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffb55b-26c2-48aa-91e4-0bdeb5872b48 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:58.862727 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffb55b-26c2-48aa-91e4-0bdeb5872b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:58.862998 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffb55b-26c2-48aa-91e4-0bdeb5872b48 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:58.874313 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ffb55b-26c2-48aa-91e4-0bdeb5872b48 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:58.876133 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ffb55b-26c2-48aa-91e4-0bdeb5872b48 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:58.897565 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-c8ffb55b-26c2-48aa-91e4-0bdeb5872b48 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:58.899059 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 388/756] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:58.905013 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650ffbc-4b3e-4ad5-a4ff-8e0dc0ba0e96 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:58.914895 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650ffbc-4b3e-4ad5-a4ff-8e0dc0ba0e96 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:58.919592 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382f49e-3bc0-44f7-aed6-45c40ceaf23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:58.920284 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382f49e-3bc0-44f7-aed6-45c40ceaf23d admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:58.920567 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382f49e-3bc0-44f7-aed6-45c40ceaf23d admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:58.920878 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382f49e-3bc0-44f7-aed6-45c40ceaf23d admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:58.921682 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382f49e-3bc0-44f7-aed6-45c40ceaf23d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:58.921981 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382f49e-3bc0-44f7-aed6-45c40ceaf23d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:58.923636 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382f49e-3bc0-44f7-aed6-45c40ceaf23d admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:58.935894 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 369/757] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:58.941180 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffb55b-26c2-48aa-91e4-0bdeb5872b48 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:58.952637 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffb55b-26c2-48aa-91e4-0bdeb5872b48 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:58.958026 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573d14f-f97e-4446-8bfc-5836f82e6066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:58.961924 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573d14f-f97e-4446-8bfc-5836f82e6066 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:58.961924 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573d14f-f97e-4446-8bfc-5836f82e6066 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:58.961924 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573d14f-f97e-4446-8bfc-5836f82e6066 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:58.969538 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573d14f-f97e-4446-8bfc-5836f82e6066 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:58.971638 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573d14f-f97e-4446-8bfc-5836f82e6066 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:58.987364 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-0573d14f-f97e-4446-8bfc-5836f82e6066 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 05 14:39:58.989029 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 389/758] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:39:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:39:58.994703 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382f49e-3bc0-44f7-aed6-45c40ceaf23d admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:59.014119 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382f49e-3bc0-44f7-aed6-45c40ceaf23d admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:59.021264 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481d33f-bc3d-4bf5-91e3-7cd195230a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:59.021870 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481d33f-bc3d-4bf5-91e3-7cd195230a9a admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:59.022154 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481d33f-bc3d-4bf5-91e3-7cd195230a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:59.022438 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481d33f-bc3d-4bf5-91e3-7cd195230a9a admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:59.023285 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481d33f-bc3d-4bf5-91e3-7cd195230a9a admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:59.023595 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481d33f-bc3d-4bf5-91e3-7cd195230a9a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:59.026069 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481d33f-bc3d-4bf5-91e3-7cd195230a9a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:59.056747 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 370/759] 10.222.0.30 () {56 vars in 1156 bytes} [Wed Jan 5 14:39:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:59.062068 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573d14f-f97e-4446-8bfc-5836f82e6066 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:59.075332 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573d14f-f97e-4446-8bfc-5836f82e6066 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:59.084466 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2993af8-ebc4-4bcd-ba70-a747337b715a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:59.085459 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2993af8-ebc4-4bcd-ba70-a747337b715a admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:59.085993 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2993af8-ebc4-4bcd-ba70-a747337b715a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:59.086478 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2993af8-ebc4-4bcd-ba70-a747337b715a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:59.101149 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2993af8-ebc4-4bcd-ba70-a747337b715a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:59.103779 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2993af8-ebc4-4bcd-ba70-a747337b715a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:59.115493 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 390/760] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:39:59 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:39:59.120727 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481d33f-bc3d-4bf5-91e3-7cd195230a9a admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:59.134821 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481d33f-bc3d-4bf5-91e3-7cd195230a9a admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:59.146264 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f30737-e90e-4d54-a48c-037bf5c4fef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:59.147064 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f30737-e90e-4d54-a48c-037bf5c4fef5 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:59.147351 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f30737-e90e-4d54-a48c-037bf5c4fef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:59.147630 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f30737-e90e-4d54-a48c-037bf5c4fef5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:59.164713 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f30737-e90e-4d54-a48c-037bf5c4fef5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:59.167115 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f30737-e90e-4d54-a48c-037bf5c4fef5 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:59.195493 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-f4f30737-e90e-4d54-a48c-037bf5c4fef5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:39:59.197569 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 371/761] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:59.202907 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2993af8-ebc4-4bcd-ba70-a747337b715a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:59.215064 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2993af8-ebc4-4bcd-ba70-a747337b715a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:59.220598 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5c901-b956-43cc-aae7-c3867c2d87e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:59.221554 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5c901-b956-43cc-aae7-c3867c2d87e7 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:59.222058 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5c901-b956-43cc-aae7-c3867c2d87e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:59.222541 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5c901-b956-43cc-aae7-c3867c2d87e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:59.223488 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe5c901-b956-43cc-aae7-c3867c2d87e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:59.223988 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe5c901-b956-43cc-aae7-c3867c2d87e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:59.225869 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe5c901-b956-43cc-aae7-c3867c2d87e7 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:59.243833 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 391/762] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:59.248829 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f30737-e90e-4d54-a48c-037bf5c4fef5 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:59.262567 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f30737-e90e-4d54-a48c-037bf5c4fef5 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:59.273463 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e72dc-c590-4d01-aebb-ba0c46b27d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:59.274199 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e72dc-c590-4d01-aebb-ba0c46b27d92 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:59.275036 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e72dc-c590-4d01-aebb-ba0c46b27d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:59.275329 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e72dc-c590-4d01-aebb-ba0c46b27d92 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:59.294262 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e72dc-c590-4d01-aebb-ba0c46b27d92 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:59.296244 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e72dc-c590-4d01-aebb-ba0c46b27d92 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:59.313346 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-bc4e72dc-c590-4d01-aebb-ba0c46b27d92 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:39:59.314832 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 372/763] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:39:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:59.320081 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5c901-b956-43cc-aae7-c3867c2d87e7 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:59.333888 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5c901-b956-43cc-aae7-c3867c2d87e7 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:59.342208 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76ddd2-5784-46c8-8b06-148383dacd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:59.343151 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76ddd2-5784-46c8-8b06-148383dacd3d admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:59.343688 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76ddd2-5784-46c8-8b06-148383dacd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:59.344200 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76ddd2-5784-46c8-8b06-148383dacd3d admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:59.345259 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76ddd2-5784-46c8-8b06-148383dacd3d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:59.345772 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76ddd2-5784-46c8-8b06-148383dacd3d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:59.347859 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76ddd2-5784-46c8-8b06-148383dacd3d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:59.365791 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 392/764] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:39:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:59.372011 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e72dc-c590-4d01-aebb-ba0c46b27d92 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:59.390577 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e72dc-c590-4d01-aebb-ba0c46b27d92 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:59.405708 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ee2c0-467b-42ab-9680-5caf487c7f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:59.406359 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ee2c0-467b-42ab-9680-5caf487c7f16 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:59.406646 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ee2c0-467b-42ab-9680-5caf487c7f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:59.406922 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ee2c0-467b-42ab-9680-5caf487c7f16 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:59.407777 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ee2c0-467b-42ab-9680-5caf487c7f16 admin admin] RBAC: Adding query filter params (role.id=494131614fcf424f92e0817fa7ff6961, scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1, user.id=c6ea13fd3e704b16aad5a38606ddc049) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:59.408088 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ee2c0-467b-42ab-9680-5caf487c7f16 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:59.410000 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ee2c0-467b-42ab-9680-5caf487c7f16 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:59.416016 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 373/765] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:39:59 2022] GET /identity/v3/role_assignments?user.id=c6ea13fd3e704b16aad5a38606ddc049&scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1&role.id=494131614fcf424f92e0817fa7ff6961 => generated 259 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:59.642532 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ce245-0d76-40cc-aa7a-ac10dda5c06d None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:59.643078 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ce245-0d76-40cc-aa7a-ac10dda5c06d None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:59.643078 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ce245-0d76-40cc-aa7a-ac10dda5c06d None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:59.645249 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 393/766] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:59.651766 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa9d10-3ee8-4313-ad54-db6f25039523 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:59.652274 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa9d10-3ee8-4313-ad54-db6f25039523 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:59.652380 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa9d10-3ee8-4313-ad54-db6f25039523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:59.679280 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-baaa9d10-3ee8-4313-ad54-db6f25039523 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:59.680499 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-baaa9d10-3ee8-4313-ad54-db6f25039523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:59.692945 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 374/767] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:59 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:39:59.720948 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ce245-0d76-40cc-aa7a-ac10dda5c06d None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:59.737767 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ce245-0d76-40cc-aa7a-ac10dda5c06d None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:59.744506 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096bff2-5699-4c59-a067-21d6d2815adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:59.745351 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096bff2-5699-4c59-a067-21d6d2815adf admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:59.745639 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096bff2-5699-4c59-a067-21d6d2815adf admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:59.745915 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096bff2-5699-4c59-a067-21d6d2815adf admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:59.746617 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096bff2-5699-4c59-a067-21d6d2815adf admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:59.747618 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING py.warnings [None req-c096bff2-5699-4c59-a067-21d6d2815adf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:39:59.747618 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: warnings.warn(msg) Jan 05 14:39:59.747618 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: Jan 05 14:39:59.748495 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096bff2-5699-4c59-a067-21d6d2815adf admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:59.766738 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-c096bff2-5699-4c59-a067-21d6d2815adf admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 05 14:39:59.771509 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 394/768] 10.222.0.30 () {56 vars in 1150 bytes} [Wed Jan 5 14:39:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:39:59.774865 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa9d10-3ee8-4313-ad54-db6f25039523 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:59.787114 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa9d10-3ee8-4313-ad54-db6f25039523 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:59.796855 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6376851-5506-448a-89f0-535dc49da5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:59.797559 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6376851-5506-448a-89f0-535dc49da5e7 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:59.797845 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6376851-5506-448a-89f0-535dc49da5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:59.798125 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6376851-5506-448a-89f0-535dc49da5e7 admin admin] PATH_INFO: `/v3/services` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:59.798857 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6376851-5506-448a-89f0-535dc49da5e7 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:59.799167 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6376851-5506-448a-89f0-535dc49da5e7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:59.800778 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6376851-5506-448a-89f0-535dc49da5e7 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:59.810229 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 375/769] 10.222.0.30 () {56 vars in 1145 bytes} [Wed Jan 5 14:39:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:59.815895 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096bff2-5699-4c59-a067-21d6d2815adf admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:59.830900 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096bff2-5699-4c59-a067-21d6d2815adf admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:59.836801 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb959e27-e5f8-430a-a8e8-a41ed1d87c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:59.837817 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb959e27-e5f8-430a-a8e8-a41ed1d87c7d admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:59.838317 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb959e27-e5f8-430a-a8e8-a41ed1d87c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:59.838870 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb959e27-e5f8-430a-a8e8-a41ed1d87c7d admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:59.839799 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb959e27-e5f8-430a-a8e8-a41ed1d87c7d admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:59.840345 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb959e27-e5f8-430a-a8e8-a41ed1d87c7d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:59.842253 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb959e27-e5f8-430a-a8e8-a41ed1d87c7d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:59.854987 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 395/770] 10.222.0.30 () {56 vars in 1145 bytes} [Wed Jan 5 14:39:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:59.861387 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6376851-5506-448a-89f0-535dc49da5e7 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:59.874130 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6376851-5506-448a-89f0-535dc49da5e7 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:59.876800 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81887b18-5f85-4a58-85c1-b47068936f0d None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:59.877385 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81887b18-5f85-4a58-85c1-b47068936f0d None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:59.877679 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81887b18-5f85-4a58-85c1-b47068936f0d None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:59.879866 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 396/771] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:39:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:39:59.885401 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecd5cd-dea3-4e43-b296-c0374e12e737 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:59.885693 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecd5cd-dea3-4e43-b296-c0374e12e737 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:59.886051 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecd5cd-dea3-4e43-b296-c0374e12e737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:59.889739 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c323e-2526-4cde-99c2-e3b1c91c27c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:59.890403 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c323e-2526-4cde-99c2-e3b1c91c27c7 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:59.890696 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c323e-2526-4cde-99c2-e3b1c91c27c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:59.890977 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c323e-2526-4cde-99c2-e3b1c91c27c7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:59.891787 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c323e-2526-4cde-99c2-e3b1c91c27c7 admin admin] RBAC: Adding query filter params (interface=public, service_id=b714a6fe2ea647e196d1892f7580f26d, region_id=RegionOne) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:39:59.892099 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c323e-2526-4cde-99c2-e3b1c91c27c7 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:59.893465 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING py.warnings [None req-437c323e-2526-4cde-99c2-e3b1c91c27c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:39:59.893465 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: warnings.warn(msg) Jan 05 14:39:59.893465 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: Jan 05 14:39:59.895214 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c323e-2526-4cde-99c2-e3b1c91c27c7 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:59.905715 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-71ecd5cd-dea3-4e43-b296-c0374e12e737 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:39:59.907155 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-71ecd5cd-dea3-4e43-b296-c0374e12e737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:39:59.912235 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 376/772] 10.222.0.30 () {56 vars in 1272 bytes} [Wed Jan 5 14:39:59 2022] GET /identity/v3/endpoints?service_id=b714a6fe2ea647e196d1892f7580f26d&interface=public®ion_id=RegionOne => generated 194 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:39:59.916597 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 397/773] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:39:59 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:39:59.922255 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c323e-2526-4cde-99c2-e3b1c91c27c7 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:59.938468 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c323e-2526-4cde-99c2-e3b1c91c27c7 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:59.944091 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9d11f-bffd-4511-82d3-768816e84e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:59.945015 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9d11f-bffd-4511-82d3-768816e84e47 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:59.945632 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9d11f-bffd-4511-82d3-768816e84e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:59.946091 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9d11f-bffd-4511-82d3-768816e84e47 admin admin] PATH_INFO: `/v3/services` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:59.947500 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9d11f-bffd-4511-82d3-768816e84e47 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:39:59.949415 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9d11f-bffd-4511-82d3-768816e84e47 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:39:59.958024 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 377/774] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jan 5 14:39:59 2022] GET /identity/v3/services => generated 772 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:39:59.972524 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecd5cd-dea3-4e43-b296-c0374e12e737 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:39:59.974323 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecd5cd-dea3-4e43-b296-c0374e12e737 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:39:59.979741 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e536cb-1d59-4a07-88f4-ec42dc429758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:39:59.980626 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e536cb-1d59-4a07-88f4-ec42dc429758 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:39:59.980911 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e536cb-1d59-4a07-88f4-ec42dc429758 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:39:59.981269 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e536cb-1d59-4a07-88f4-ec42dc429758 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:39:59.994099 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e536cb-1d59-4a07-88f4-ec42dc429758 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:40:00.002710 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-f7e536cb-1d59-4a07-88f4-ec42dc429758 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 05 14:40:00.004347 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 398/775] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Jan 5 14:39:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:00.012285 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9d11f-bffd-4511-82d3-768816e84e47 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:00.023008 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9d11f-bffd-4511-82d3-768816e84e47 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:00.033363 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080811a-1462-4b8c-b8e1-705d5e546beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:00.034115 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080811a-1462-4b8c-b8e1-705d5e546beb admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:00.034405 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080811a-1462-4b8c-b8e1-705d5e546beb admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:00.034689 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080811a-1462-4b8c-b8e1-705d5e546beb admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:00.035535 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080811a-1462-4b8c-b8e1-705d5e546beb admin admin] RBAC: Adding query filter params (name=service) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:00.035850 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080811a-1462-4b8c-b8e1-705d5e546beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:00.037636 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080811a-1462-4b8c-b8e1-705d5e546beb admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:00.054246 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 378/776] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Jan 5 14:40:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:00.060908 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b099f-de96-4b61-8a1d-1c3a247fe25d None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:00.061267 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b099f-de96-4b61-8a1d-1c3a247fe25d None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:00.061490 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b099f-de96-4b61-8a1d-1c3a247fe25d None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:00.063683 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 399/777] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:00.069595 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32631e23-d560-4ba5-904f-6583f75f00d7 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:00.070015 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32631e23-d560-4ba5-904f-6583f75f00d7 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:00.070426 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32631e23-d560-4ba5-904f-6583f75f00d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:00.072871 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080811a-1462-4b8c-b8e1-705d5e546beb admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:00.092803 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080811a-1462-4b8c-b8e1-705d5e546beb admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:00.100742 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-32631e23-d560-4ba5-904f-6583f75f00d7 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:00.102139 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-32631e23-d560-4ba5-904f-6583f75f00d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:00.106436 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef894251-afba-4fb9-9cbe-d1e48629e46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:00.107209 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef894251-afba-4fb9-9cbe-d1e48629e46c admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:00.107485 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef894251-afba-4fb9-9cbe-d1e48629e46c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:00.107761 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef894251-afba-4fb9-9cbe-d1e48629e46c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:00.111291 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 400/778] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:00 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:00.124051 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef894251-afba-4fb9-9cbe-d1e48629e46c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:00.126131 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef894251-afba-4fb9-9cbe-d1e48629e46c admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:00.138089 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32631e23-d560-4ba5-904f-6583f75f00d7 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:00.144913 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-ef894251-afba-4fb9-9cbe-d1e48629e46c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:40:00.146500 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 379/779] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:00.152751 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef894251-afba-4fb9-9cbe-d1e48629e46c admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:00.155412 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32631e23-d560-4ba5-904f-6583f75f00d7 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:00.163284 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef894251-afba-4fb9-9cbe-d1e48629e46c admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:00.168815 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c65ec7-52d7-424d-8626-c5e7c1b4d412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:00.169633 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c65ec7-52d7-424d-8626-c5e7c1b4d412 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:00.169926 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c65ec7-52d7-424d-8626-c5e7c1b4d412 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:00.170184 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c65ec7-52d7-424d-8626-c5e7c1b4d412 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:00.170991 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c65ec7-52d7-424d-8626-c5e7c1b4d412 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:00.171297 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c65ec7-52d7-424d-8626-c5e7c1b4d412 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:00.173125 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c65ec7-52d7-424d-8626-c5e7c1b4d412 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:00.177850 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49875ef-6671-4266-939e-197c2f746a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:00.178668 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49875ef-6671-4266-939e-197c2f746a54 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:00.178950 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49875ef-6671-4266-939e-197c2f746a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:00.179224 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49875ef-6671-4266-939e-197c2f746a54 admin admin] PATH_INFO: `/v3/services/network` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:00.179901 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49875ef-6671-4266-939e-197c2f746a54 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:00.181577 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49875ef-6671-4266-939e-197c2f746a54 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:00.186026 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 380/780] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:00.191291 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c65ec7-52d7-424d-8626-c5e7c1b4d412 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:00.201459 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c65ec7-52d7-424d-8626-c5e7c1b4d412 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:00.205231 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-d49875ef-6671-4266-939e-197c2f746a54 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 05 14:40:00.206314 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbfbd1e-5dfd-47fa-9b44-e5fedc630c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:00.206858 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 401/781] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:40:00 2022] GET /identity/v3/services/network => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:40:00.207131 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbfbd1e-5dfd-47fa-9b44-e5fedc630c51 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:00.207471 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbfbd1e-5dfd-47fa-9b44-e5fedc630c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:00.207777 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbfbd1e-5dfd-47fa-9b44-e5fedc630c51 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:00.212972 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49875ef-6671-4266-939e-197c2f746a54 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:00.217688 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbfbd1e-5dfd-47fa-9b44-e5fedc630c51 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:00.219804 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbfbd1e-5dfd-47fa-9b44-e5fedc630c51 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:00.231425 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49875ef-6671-4266-939e-197c2f746a54 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:00.235032 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-8fbfbd1e-5dfd-47fa-9b44-e5fedc630c51 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 05 14:40:00.236541 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 381/782] 10.222.0.30 () {56 vars in 1138 bytes} [Wed Jan 5 14:40:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:40:00.241895 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbfbd1e-5dfd-47fa-9b44-e5fedc630c51 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:00.253229 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbfbd1e-5dfd-47fa-9b44-e5fedc630c51 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:00.257812 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974931f9-bcd4-4806-acdd-8a85d3559751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:00.258168 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88510218-f566-4d9a-9552-b377c846c967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:00.258508 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974931f9-bcd4-4806-acdd-8a85d3559751 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:00.258783 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88510218-f566-4d9a-9552-b377c846c967 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:00.258994 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974931f9-bcd4-4806-acdd-8a85d3559751 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:00.259143 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974931f9-bcd4-4806-acdd-8a85d3559751 admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:00.259310 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88510218-f566-4d9a-9552-b377c846c967 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:00.259452 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88510218-f566-4d9a-9552-b377c846c967 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:00.259860 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974931f9-bcd4-4806-acdd-8a85d3559751 admin admin] RBAC: Adding query filter params (name=network) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:00.260169 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974931f9-bcd4-4806-acdd-8a85d3559751 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:00.260372 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88510218-f566-4d9a-9552-b377c846c967 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:00.260693 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88510218-f566-4d9a-9552-b377c846c967 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:00.261837 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974931f9-bcd4-4806-acdd-8a85d3559751 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:00.262663 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88510218-f566-4d9a-9552-b377c846c967 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:00.279478 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 402/783] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Jan 5 14:40:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:40:00.286053 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974931f9-bcd4-4806-acdd-8a85d3559751 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:00.289292 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 382/784] 10.222.0.30 () {56 vars in 1170 bytes} [Wed Jan 5 14:40:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:40:00.295456 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88510218-f566-4d9a-9552-b377c846c967 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:00.302837 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974931f9-bcd4-4806-acdd-8a85d3559751 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:00.310507 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88510218-f566-4d9a-9552-b377c846c967 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:00.312920 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500203c-61ba-4354-917e-0d549f975f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:00.314658 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500203c-61ba-4354-917e-0d549f975f42 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:00.314658 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500203c-61ba-4354-917e-0d549f975f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:00.314658 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500203c-61ba-4354-917e-0d549f975f42 admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:00.314878 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500203c-61ba-4354-917e-0d549f975f42 admin admin] RBAC: Adding query filter params (type=network) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:00.315130 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500203c-61ba-4354-917e-0d549f975f42 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:00.316703 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500203c-61ba-4354-917e-0d549f975f42 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:00.324073 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 403/785] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Jan 5 14:40:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:00.330382 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500203c-61ba-4354-917e-0d549f975f42 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:00.331316 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1444a-ad8e-4670-8115-5cba554e3402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:00.332101 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1444a-ad8e-4670-8115-5cba554e3402 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:00.332379 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1444a-ad8e-4670-8115-5cba554e3402 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:00.332646 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1444a-ad8e-4670-8115-5cba554e3402 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:00.344883 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1444a-ad8e-4670-8115-5cba554e3402 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:00.345590 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500203c-61ba-4354-917e-0d549f975f42 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:00.346856 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1444a-ad8e-4670-8115-5cba554e3402 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:00.351324 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f963f-2e31-4b9c-a3ec-982bd1b2e33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:00.352203 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f963f-2e31-4b9c-a3ec-982bd1b2e33f admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:00.352814 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f963f-2e31-4b9c-a3ec-982bd1b2e33f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:00.354022 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f963f-2e31-4b9c-a3ec-982bd1b2e33f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:00.355509 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f963f-2e31-4b9c-a3ec-982bd1b2e33f admin admin] RBAC: Adding query filter params (interface=public, service_id=7ae07808821f4cee9f2b8ea5396a4e27, region_id=RegionOne) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:00.356722 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f963f-2e31-4b9c-a3ec-982bd1b2e33f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:00.358785 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING py.warnings [None req-339f963f-2e31-4b9c-a3ec-982bd1b2e33f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:40:00.358785 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: warnings.warn(msg) Jan 05 14:40:00.358785 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: Jan 05 14:40:00.360015 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f963f-2e31-4b9c-a3ec-982bd1b2e33f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:00.365034 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-ecf1444a-ad8e-4670-8115-5cba554e3402 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:40:00.366616 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 383/786] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:40:00.371167 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 404/787] 10.222.0.30 () {56 vars in 1272 bytes} [Wed Jan 5 14:40:00 2022] GET /identity/v3/endpoints?service_id=7ae07808821f4cee9f2b8ea5396a4e27&interface=public®ion_id=RegionOne => generated 194 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:00.376375 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1444a-ad8e-4670-8115-5cba554e3402 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:00.380788 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f963f-2e31-4b9c-a3ec-982bd1b2e33f admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:00.393505 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f963f-2e31-4b9c-a3ec-982bd1b2e33f admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:00.394598 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1444a-ad8e-4670-8115-5cba554e3402 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:00.398397 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c2061-d6cd-4a65-94d7-53ac4d35a1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:00.399000 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c2061-d6cd-4a65-94d7-53ac4d35a1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:00.399362 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c2061-d6cd-4a65-94d7-53ac4d35a1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:00.399647 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c2061-d6cd-4a65-94d7-53ac4d35a1b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:00.400437 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c2061-d6cd-4a65-94d7-53ac4d35a1b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:00.400726 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c2061-d6cd-4a65-94d7-53ac4d35a1b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:00.401427 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5f3f7-f775-484e-95ca-37922ef414f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:00.402310 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5f3f7-f775-484e-95ca-37922ef414f6 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:00.402430 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c2061-d6cd-4a65-94d7-53ac4d35a1b1 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:00.402899 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5f3f7-f775-484e-95ca-37922ef414f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:00.403373 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5f3f7-f775-484e-95ca-37922ef414f6 admin admin] PATH_INFO: `/v3/services` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:00.404267 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5f3f7-f775-484e-95ca-37922ef414f6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:00.406868 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5f3f7-f775-484e-95ca-37922ef414f6 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:00.414202 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 384/788] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jan 5 14:40:00 2022] GET /identity/v3/services => generated 772 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:00.425105 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 405/789] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:00.427006 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5f3f7-f775-484e-95ca-37922ef414f6 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:00.444870 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5f3f7-f775-484e-95ca-37922ef414f6 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:00.461929 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7577a-1cbe-4254-990a-27925d632c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:00.462788 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7577a-1cbe-4254-990a-27925d632c84 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:00.463073 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7577a-1cbe-4254-990a-27925d632c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:00.463349 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7577a-1cbe-4254-990a-27925d632c84 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:00.479019 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7577a-1cbe-4254-990a-27925d632c84 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:00.481033 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7577a-1cbe-4254-990a-27925d632c84 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:00.508403 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-fab7577a-1cbe-4254-990a-27925d632c84 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:40:00.508403 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 385/790] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:40:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:00.516930 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c2061-d6cd-4a65-94d7-53ac4d35a1b1 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:00.534249 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c2061-d6cd-4a65-94d7-53ac4d35a1b1 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:00.541569 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35b7ac-d8fe-4e2f-886c-9074b88ab946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:00.542714 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35b7ac-d8fe-4e2f-886c-9074b88ab946 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:00.543198 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35b7ac-d8fe-4e2f-886c-9074b88ab946 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:00.543663 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35b7ac-d8fe-4e2f-886c-9074b88ab946 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:00.544694 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35b7ac-d8fe-4e2f-886c-9074b88ab946 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:00.545227 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35b7ac-d8fe-4e2f-886c-9074b88ab946 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:00.547442 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35b7ac-d8fe-4e2f-886c-9074b88ab946 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:00.570120 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 406/791] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:40:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:00.576490 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7577a-1cbe-4254-990a-27925d632c84 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:00.594544 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7577a-1cbe-4254-990a-27925d632c84 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:00.613106 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f685b-ed76-4231-8ce1-b3ec2c15a531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:00.614007 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f685b-ed76-4231-8ce1-b3ec2c15a531 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:00.614291 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f685b-ed76-4231-8ce1-b3ec2c15a531 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:00.614570 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f685b-ed76-4231-8ce1-b3ec2c15a531 admin admin] PATH_INFO: `/v3/projects/fbf90e947f3a4fcdb6f42646a4bf34a1/users/29314b0be6534c79b36f31402d51d17b/roles/9868670385c0469093001f6f2c310f1a` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:00.640247 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f685b-ed76-4231-8ce1-b3ec2c15a531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf90e947f3a4fcdb6f42646a4bf34a1, user_id=29314b0be6534c79b36f31402d51d17b, role_id=9868670385c0469093001f6f2c310f1a)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:00.643006 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f685b-ed76-4231-8ce1-b3ec2c15a531 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:00.742141 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 386/792] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Jan 5 14:40:00 2022] PUT /identity/v3/projects/fbf90e947f3a4fcdb6f42646a4bf34a1/users/29314b0be6534c79b36f31402d51d17b/roles/9868670385c0469093001f6f2c310f1a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:40:01.170599 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d629e4-9805-4131-8102-4b5ddffadfc6 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:01.171138 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d629e4-9805-4131-8102-4b5ddffadfc6 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:01.171138 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d629e4-9805-4131-8102-4b5ddffadfc6 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:01.172949 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 407/793] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:01.178561 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccc36f-075f-48c3-983f-a4e0b5bc7b84 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:01.178850 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccc36f-075f-48c3-983f-a4e0b5bc7b84 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:01.179127 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccc36f-075f-48c3-983f-a4e0b5bc7b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:01.201096 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-6eccc36f-075f-48c3-983f-a4e0b5bc7b84 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:01.202306 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-6eccc36f-075f-48c3-983f-a4e0b5bc7b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:01.270542 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 387/794] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:01 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:01.296494 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d629e4-9805-4131-8102-4b5ddffadfc6 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:01.310036 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d629e4-9805-4131-8102-4b5ddffadfc6 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:01.316105 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85bfaa-e463-4ff0-acff-c17cac08f67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:01.316935 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85bfaa-e463-4ff0-acff-c17cac08f67e admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:01.317275 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85bfaa-e463-4ff0-acff-c17cac08f67e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:01.317547 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85bfaa-e463-4ff0-acff-c17cac08f67e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:01.331388 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85bfaa-e463-4ff0-acff-c17cac08f67e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:40:01.338868 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-8d85bfaa-e463-4ff0-acff-c17cac08f67e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 05 14:40:01.340407 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 408/795] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:40:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:01.345962 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eccc36f-075f-48c3-983f-a4e0b5bc7b84 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:01.363399 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eccc36f-075f-48c3-983f-a4e0b5bc7b84 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:01.368505 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7fe8c-f3b6-4b27-8c00-309e88666a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:01.369423 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7fe8c-f3b6-4b27-8c00-309e88666a30 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:01.369923 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7fe8c-f3b6-4b27-8c00-309e88666a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:01.370407 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7fe8c-f3b6-4b27-8c00-309e88666a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:01.371353 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7fe8c-f3b6-4b27-8c00-309e88666a30 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:01.371951 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7fe8c-f3b6-4b27-8c00-309e88666a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:01.373783 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7fe8c-f3b6-4b27-8c00-309e88666a30 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:01.387642 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 388/796] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:40:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:01.392948 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85bfaa-e463-4ff0-acff-c17cac08f67e admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:01.406899 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85bfaa-e463-4ff0-acff-c17cac08f67e admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:01.411679 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e260487-22ab-40ac-8148-44f946b768f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:01.412538 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e260487-22ab-40ac-8148-44f946b768f2 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:01.412848 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e260487-22ab-40ac-8148-44f946b768f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:01.413165 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e260487-22ab-40ac-8148-44f946b768f2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:01.437808 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e260487-22ab-40ac-8148-44f946b768f2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:01.440485 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e260487-22ab-40ac-8148-44f946b768f2 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:01.460446 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-7e260487-22ab-40ac-8148-44f946b768f2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:40:01.462572 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 409/797] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:01.467856 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7fe8c-f3b6-4b27-8c00-309e88666a30 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:01.481503 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7fe8c-f3b6-4b27-8c00-309e88666a30 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:01.503373 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3542db-118a-4e7b-9cf9-b1eda4a88ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:01.504368 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3542db-118a-4e7b-9cf9-b1eda4a88ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:01.504856 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3542db-118a-4e7b-9cf9-b1eda4a88ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:01.505352 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3542db-118a-4e7b-9cf9-b1eda4a88ae5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:01.506281 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3542db-118a-4e7b-9cf9-b1eda4a88ae5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:01.506803 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3542db-118a-4e7b-9cf9-b1eda4a88ae5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:01.508593 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3542db-118a-4e7b-9cf9-b1eda4a88ae5 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:01.527029 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 389/798] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:01.532613 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e260487-22ab-40ac-8148-44f946b768f2 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:01.549741 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e260487-22ab-40ac-8148-44f946b768f2 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:01.554830 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0452d34-3d01-43a9-9933-70201c3e0900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:01.556026 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0452d34-3d01-43a9-9933-70201c3e0900 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:01.556603 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0452d34-3d01-43a9-9933-70201c3e0900 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:01.557111 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0452d34-3d01-43a9-9933-70201c3e0900 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:01.568331 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0452d34-3d01-43a9-9933-70201c3e0900 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:01.570383 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0452d34-3d01-43a9-9933-70201c3e0900 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:01.595040 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-e0452d34-3d01-43a9-9933-70201c3e0900 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 05 14:40:01.596442 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 410/799] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Jan 5 14:40:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:01.601986 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3542db-118a-4e7b-9cf9-b1eda4a88ae5 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:01.623243 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3542db-118a-4e7b-9cf9-b1eda4a88ae5 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:01.637761 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca4f6b-bbde-4e4b-b635-c47e838dfc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:01.638452 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca4f6b-bbde-4e4b-b635-c47e838dfc4b admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:01.638734 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca4f6b-bbde-4e4b-b635-c47e838dfc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:01.639016 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca4f6b-bbde-4e4b-b635-c47e838dfc4b admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:01.639879 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca4f6b-bbde-4e4b-b635-c47e838dfc4b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:01.640191 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca4f6b-bbde-4e4b-b635-c47e838dfc4b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:01.642085 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca4f6b-bbde-4e4b-b635-c47e838dfc4b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:01.671614 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 390/800] 10.222.0.30 () {56 vars in 1154 bytes} [Wed Jan 5 14:40:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:01.676844 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0452d34-3d01-43a9-9933-70201c3e0900 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:01.691326 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0452d34-3d01-43a9-9933-70201c3e0900 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:01.706491 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e46451-abf1-4ad2-9f8e-7c7acac81856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:01.707146 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e46451-abf1-4ad2-9f8e-7c7acac81856 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:01.707432 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e46451-abf1-4ad2-9f8e-7c7acac81856 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:01.707706 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e46451-abf1-4ad2-9f8e-7c7acac81856 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:01.721881 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e46451-abf1-4ad2-9f8e-7c7acac81856 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:01.723783 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e46451-abf1-4ad2-9f8e-7c7acac81856 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:01.737173 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 411/801] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:40:01 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:40:01.740092 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca4f6b-bbde-4e4b-b635-c47e838dfc4b admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:01.750705 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca4f6b-bbde-4e4b-b635-c47e838dfc4b admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:01.755879 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22879e71-aa17-4b45-922c-e0b7877d181d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:01.756761 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22879e71-aa17-4b45-922c-e0b7877d181d admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:01.757047 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22879e71-aa17-4b45-922c-e0b7877d181d admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:01.757360 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22879e71-aa17-4b45-922c-e0b7877d181d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:01.777526 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22879e71-aa17-4b45-922c-e0b7877d181d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:01.779513 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22879e71-aa17-4b45-922c-e0b7877d181d admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:01.804750 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-22879e71-aa17-4b45-922c-e0b7877d181d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:40:01.806668 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 391/802] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:01.812106 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e46451-abf1-4ad2-9f8e-7c7acac81856 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:01.821130 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e46451-abf1-4ad2-9f8e-7c7acac81856 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:01.833749 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e7825-37e1-4e80-a306-be9a117d7a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:01.834408 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e7825-37e1-4e80-a306-be9a117d7a37 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:01.834691 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e7825-37e1-4e80-a306-be9a117d7a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:01.834966 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e7825-37e1-4e80-a306-be9a117d7a37 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:01.835699 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e7825-37e1-4e80-a306-be9a117d7a37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:01.836000 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e7825-37e1-4e80-a306-be9a117d7a37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:01.838194 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e7825-37e1-4e80-a306-be9a117d7a37 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:01.852655 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 412/803] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:01.857250 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22879e71-aa17-4b45-922c-e0b7877d181d admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:01.866847 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22879e71-aa17-4b45-922c-e0b7877d181d admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:01.871900 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803374f-2d76-4d9d-8fa6-61b2541de63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:01.872675 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803374f-2d76-4d9d-8fa6-61b2541de63c admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:01.872950 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803374f-2d76-4d9d-8fa6-61b2541de63c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:01.873260 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803374f-2d76-4d9d-8fa6-61b2541de63c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:01.880472 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803374f-2d76-4d9d-8fa6-61b2541de63c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:01.882432 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803374f-2d76-4d9d-8fa6-61b2541de63c admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:01.895612 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-e803374f-2d76-4d9d-8fa6-61b2541de63c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:40:01.901176 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 392/804] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:40:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:01.903206 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e7825-37e1-4e80-a306-be9a117d7a37 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:01.912868 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e7825-37e1-4e80-a306-be9a117d7a37 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:01.917499 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a782f8-6654-481d-8261-63c4858ebd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:01.918144 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a782f8-6654-481d-8261-63c4858ebd45 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:01.918422 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a782f8-6654-481d-8261-63c4858ebd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:01.918694 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a782f8-6654-481d-8261-63c4858ebd45 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:01.919486 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a782f8-6654-481d-8261-63c4858ebd45 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:01.919788 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a782f8-6654-481d-8261-63c4858ebd45 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:01.921765 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a782f8-6654-481d-8261-63c4858ebd45 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:01.937198 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 413/805] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:40:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:01.939783 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803374f-2d76-4d9d-8fa6-61b2541de63c admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:01.962293 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803374f-2d76-4d9d-8fa6-61b2541de63c admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:01.962293 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e56ff-c28b-4ecb-bc2d-d66a1abfaa2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:01.962293 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e56ff-c28b-4ecb-bc2d-d66a1abfaa2e admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:01.962293 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e56ff-c28b-4ecb-bc2d-d66a1abfaa2e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:01.963023 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e56ff-c28b-4ecb-bc2d-d66a1abfaa2e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:01.963023 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e56ff-c28b-4ecb-bc2d-d66a1abfaa2e admin admin] RBAC: Adding query filter params (role.id=494131614fcf424f92e0817fa7ff6961, scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1, user.id=77db235e2f7046e4bdbad7f31b5e3ebc) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:01.963023 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e56ff-c28b-4ecb-bc2d-d66a1abfaa2e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:01.963023 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e56ff-c28b-4ecb-bc2d-d66a1abfaa2e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:01.973185 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 393/806] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:40:01 2022] GET /identity/v3/role_assignments?user.id=77db235e2f7046e4bdbad7f31b5e3ebc&scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1&role.id=494131614fcf424f92e0817fa7ff6961 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:02.314311 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e48c52-7eec-49a7-a8f2-7e20c9021a7b None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:02.314992 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e48c52-7eec-49a7-a8f2-7e20c9021a7b None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:02.314992 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e48c52-7eec-49a7-a8f2-7e20c9021a7b None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:02.316804 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 414/807] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:02.322269 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be68fcf-5020-4bfd-a72b-2cc3e74fb827 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:02.322555 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be68fcf-5020-4bfd-a72b-2cc3e74fb827 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:02.322832 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be68fcf-5020-4bfd-a72b-2cc3e74fb827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:02.341716 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-8be68fcf-5020-4bfd-a72b-2cc3e74fb827 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:02.342880 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-8be68fcf-5020-4bfd-a72b-2cc3e74fb827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:02.355601 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 394/808] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:02 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:40:02.376736 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e48c52-7eec-49a7-a8f2-7e20c9021a7b None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:02.389566 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e48c52-7eec-49a7-a8f2-7e20c9021a7b None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:02.393939 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ace64f-4033-4460-ab4e-99685719c57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:02.394773 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ace64f-4033-4460-ab4e-99685719c57a admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:02.395056 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ace64f-4033-4460-ab4e-99685719c57a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:02.395328 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ace64f-4033-4460-ab4e-99685719c57a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:02.406378 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ace64f-4033-4460-ab4e-99685719c57a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:40:02.413435 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-55ace64f-4033-4460-ab4e-99685719c57a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 05 14:40:02.419502 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 415/809] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:40:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:40:02.420831 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be68fcf-5020-4bfd-a72b-2cc3e74fb827 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:02.429818 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be68fcf-5020-4bfd-a72b-2cc3e74fb827 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:02.434866 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648d2ad-78bb-40b9-b89d-9c804167ca1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:02.435695 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648d2ad-78bb-40b9-b89d-9c804167ca1b admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:02.435978 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648d2ad-78bb-40b9-b89d-9c804167ca1b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:02.436251 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648d2ad-78bb-40b9-b89d-9c804167ca1b admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:02.437000 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648d2ad-78bb-40b9-b89d-9c804167ca1b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:02.437329 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648d2ad-78bb-40b9-b89d-9c804167ca1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:02.439088 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648d2ad-78bb-40b9-b89d-9c804167ca1b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:02.452402 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 395/810] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:40:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:02.453779 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ace64f-4033-4460-ab4e-99685719c57a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:02.465458 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ace64f-4033-4460-ab4e-99685719c57a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:02.470355 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f3409-fd19-4fbd-8188-fd8a87f2fb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:02.471171 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f3409-fd19-4fbd-8188-fd8a87f2fb25 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:02.471451 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f3409-fd19-4fbd-8188-fd8a87f2fb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:02.471725 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f3409-fd19-4fbd-8188-fd8a87f2fb25 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:02.483466 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f3409-fd19-4fbd-8188-fd8a87f2fb25 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:02.485374 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f3409-fd19-4fbd-8188-fd8a87f2fb25 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:02.503025 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-d71f3409-fd19-4fbd-8188-fd8a87f2fb25 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:40:02.509410 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 416/811] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:02.514772 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648d2ad-78bb-40b9-b89d-9c804167ca1b admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:02.524208 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648d2ad-78bb-40b9-b89d-9c804167ca1b admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:02.529545 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454e71e-6f32-40a2-bf24-c46606f68b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:02.530240 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454e71e-6f32-40a2-bf24-c46606f68b08 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:02.530520 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454e71e-6f32-40a2-bf24-c46606f68b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:02.530792 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454e71e-6f32-40a2-bf24-c46606f68b08 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:02.531573 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454e71e-6f32-40a2-bf24-c46606f68b08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:02.531878 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454e71e-6f32-40a2-bf24-c46606f68b08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:02.533560 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454e71e-6f32-40a2-bf24-c46606f68b08 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:02.553199 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 396/812] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:02.554607 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f3409-fd19-4fbd-8188-fd8a87f2fb25 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:02.564928 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f3409-fd19-4fbd-8188-fd8a87f2fb25 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:02.569655 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be523007-111a-4a45-8d36-265c0bbadc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:02.570441 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be523007-111a-4a45-8d36-265c0bbadc44 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:02.570774 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be523007-111a-4a45-8d36-265c0bbadc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:02.571047 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be523007-111a-4a45-8d36-265c0bbadc44 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:02.578985 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be523007-111a-4a45-8d36-265c0bbadc44 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:02.581117 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be523007-111a-4a45-8d36-265c0bbadc44 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:02.596439 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-be523007-111a-4a45-8d36-265c0bbadc44 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 05 14:40:02.601186 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 417/813] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:40:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:02.603670 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454e71e-6f32-40a2-bf24-c46606f68b08 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:02.613542 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454e71e-6f32-40a2-bf24-c46606f68b08 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:02.619736 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f8c2c-23e1-47cb-88c5-eb24bd25cd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:02.620394 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f8c2c-23e1-47cb-88c5-eb24bd25cd76 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:02.620722 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f8c2c-23e1-47cb-88c5-eb24bd25cd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:02.621969 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f8c2c-23e1-47cb-88c5-eb24bd25cd76 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:02.621969 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f8c2c-23e1-47cb-88c5-eb24bd25cd76 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:02.623229 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f8c2c-23e1-47cb-88c5-eb24bd25cd76 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:02.629108 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f8c2c-23e1-47cb-88c5-eb24bd25cd76 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:02.647668 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 397/814] 10.222.0.30 () {56 vars in 1156 bytes} [Wed Jan 5 14:40:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:02.652007 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be523007-111a-4a45-8d36-265c0bbadc44 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:02.662150 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be523007-111a-4a45-8d36-265c0bbadc44 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:02.671127 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7524e9-dfbb-4487-ba70-7118381e56b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:02.671976 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7524e9-dfbb-4487-ba70-7118381e56b2 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:02.672564 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7524e9-dfbb-4487-ba70-7118381e56b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:02.672843 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7524e9-dfbb-4487-ba70-7118381e56b2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:02.684097 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7524e9-dfbb-4487-ba70-7118381e56b2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:02.686079 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7524e9-dfbb-4487-ba70-7118381e56b2 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:02.714835 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-ae7524e9-dfbb-4487-ba70-7118381e56b2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:40:02.716076 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 418/815] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:02.722160 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f8c2c-23e1-47cb-88c5-eb24bd25cd76 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:02.733334 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f8c2c-23e1-47cb-88c5-eb24bd25cd76 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:02.739866 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be34a1-53cc-4c28-bd40-471cd32e3cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:02.740635 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be34a1-53cc-4c28-bd40-471cd32e3cae admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:02.740918 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be34a1-53cc-4c28-bd40-471cd32e3cae admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:02.741267 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be34a1-53cc-4c28-bd40-471cd32e3cae admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:02.742015 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be34a1-53cc-4c28-bd40-471cd32e3cae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:02.742319 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be34a1-53cc-4c28-bd40-471cd32e3cae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:02.744692 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be34a1-53cc-4c28-bd40-471cd32e3cae admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:02.762636 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 398/816] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:02.764067 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7524e9-dfbb-4487-ba70-7118381e56b2 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:02.774836 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7524e9-dfbb-4487-ba70-7118381e56b2 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:02.779700 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55d0e6-21fe-4d7b-aadb-8f3eb18f487f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:02.780631 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55d0e6-21fe-4d7b-aadb-8f3eb18f487f admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:02.780965 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55d0e6-21fe-4d7b-aadb-8f3eb18f487f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:02.781280 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55d0e6-21fe-4d7b-aadb-8f3eb18f487f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:02.789409 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55d0e6-21fe-4d7b-aadb-8f3eb18f487f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:02.792034 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55d0e6-21fe-4d7b-aadb-8f3eb18f487f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:02.807001 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-cf55d0e6-21fe-4d7b-aadb-8f3eb18f487f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:40:02.812867 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 419/817] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:40:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:02.814270 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be34a1-53cc-4c28-bd40-471cd32e3cae admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:02.824499 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be34a1-53cc-4c28-bd40-471cd32e3cae admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:02.829166 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7f88a-adef-4025-8a51-521ba0250412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:02.829917 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7f88a-adef-4025-8a51-521ba0250412 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:02.830196 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7f88a-adef-4025-8a51-521ba0250412 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:02.830469 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7f88a-adef-4025-8a51-521ba0250412 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:02.831313 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7f88a-adef-4025-8a51-521ba0250412 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:02.831617 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7f88a-adef-4025-8a51-521ba0250412 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:02.833675 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7f88a-adef-4025-8a51-521ba0250412 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:02.852153 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 399/818] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:40:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:02.854021 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55d0e6-21fe-4d7b-aadb-8f3eb18f487f admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:02.864903 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55d0e6-21fe-4d7b-aadb-8f3eb18f487f admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:02.869719 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37ac0e-53b5-48fa-87d0-620262fede87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:02.870650 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37ac0e-53b5-48fa-87d0-620262fede87 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:02.870928 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37ac0e-53b5-48fa-87d0-620262fede87 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:02.871202 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37ac0e-53b5-48fa-87d0-620262fede87 admin admin] PATH_INFO: `/v3/projects/fbf90e947f3a4fcdb6f42646a4bf34a1/users/c6ea13fd3e704b16aad5a38606ddc049/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:02.873308 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37ac0e-53b5-48fa-87d0-620262fede87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf90e947f3a4fcdb6f42646a4bf34a1, user_id=c6ea13fd3e704b16aad5a38606ddc049, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:02.876065 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37ac0e-53b5-48fa-87d0-620262fede87 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:03.023756 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 420/819] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Jan 5 14:40:02 2022] PUT /identity/v3/projects/fbf90e947f3a4fcdb6f42646a4bf34a1/users/c6ea13fd3e704b16aad5a38606ddc049/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 14:40:03.223568 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d919027-c721-4275-980e-ef9db50b1759 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:03.223959 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d919027-c721-4275-980e-ef9db50b1759 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:03.224130 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d919027-c721-4275-980e-ef9db50b1759 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:03.226167 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 400/820] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:03.231864 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc8cfc-ceb3-4cdc-af2e-d8aee405fc87 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:03.232156 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc8cfc-ceb3-4cdc-af2e-d8aee405fc87 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:03.232423 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc8cfc-ceb3-4cdc-af2e-d8aee405fc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:03.258211 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-1fbc8cfc-ceb3-4cdc-af2e-d8aee405fc87 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:03.259479 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-1fbc8cfc-ceb3-4cdc-af2e-d8aee405fc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:03.340162 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 421/821] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:03 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:40:03.357571 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066af8d-a622-471c-9f1d-0ca2dc1408b6 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:03.357853 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066af8d-a622-471c-9f1d-0ca2dc1408b6 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:03.358113 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066af8d-a622-471c-9f1d-0ca2dc1408b6 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:03.360914 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 401/822] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:03.365206 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614decfb-c67c-40d9-9af6-30cdcb0cdf8f None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:03.365506 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614decfb-c67c-40d9-9af6-30cdcb0cdf8f None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:03.365790 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614decfb-c67c-40d9-9af6-30cdcb0cdf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:03.373990 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066af8d-a622-471c-9f1d-0ca2dc1408b6 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:03.386733 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-614decfb-c67c-40d9-9af6-30cdcb0cdf8f None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:03.387924 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-614decfb-c67c-40d9-9af6-30cdcb0cdf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:03.389775 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066af8d-a622-471c-9f1d-0ca2dc1408b6 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:03.397693 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c30f58-ddc7-4044-aa30-098bbd8af1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:03.398530 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c30f58-ddc7-4044-aa30-098bbd8af1df admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:03.398813 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c30f58-ddc7-4044-aa30-098bbd8af1df admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:03.399020 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 422/823] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:03 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:03.399185 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c30f58-ddc7-4044-aa30-098bbd8af1df admin admin] PATH_INFO: `/v3/services/network` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:03.400573 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c30f58-ddc7-4044-aa30-098bbd8af1df admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:03.402287 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c30f58-ddc7-4044-aa30-098bbd8af1df admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:03.414568 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-37c30f58-ddc7-4044-aa30-098bbd8af1df admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 05 14:40:03.421191 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 402/824] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:40:03 2022] GET /identity/v3/services/network => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:03.423178 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614decfb-c67c-40d9-9af6-30cdcb0cdf8f None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:03.427133 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c30f58-ddc7-4044-aa30-098bbd8af1df admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:03.435818 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614decfb-c67c-40d9-9af6-30cdcb0cdf8f None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:03.438009 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c30f58-ddc7-4044-aa30-098bbd8af1df admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:03.442334 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73d2bc-5af9-408c-b7ea-b186f8e75247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:03.443031 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73d2bc-5af9-408c-b7ea-b186f8e75247 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:03.443420 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73d2bc-5af9-408c-b7ea-b186f8e75247 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:03.443706 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73d2bc-5af9-408c-b7ea-b186f8e75247 admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:03.444333 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe108b-9e9e-483f-89a8-e731e58da159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:03.444481 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c73d2bc-5af9-408c-b7ea-b186f8e75247 admin admin] RBAC: Adding query filter params (name=network) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:03.444743 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c73d2bc-5af9-408c-b7ea-b186f8e75247 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:03.447625 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c73d2bc-5af9-408c-b7ea-b186f8e75247 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:03.448636 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe108b-9e9e-483f-89a8-e731e58da159 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:03.449203 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe108b-9e9e-483f-89a8-e731e58da159 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:03.450012 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe108b-9e9e-483f-89a8-e731e58da159 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:03.451262 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe108b-9e9e-483f-89a8-e731e58da159 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:03.457089 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 423/825] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Jan 5 14:40:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:03.457303 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe108b-9e9e-483f-89a8-e731e58da159 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:03.459327 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73d2bc-5af9-408c-b7ea-b186f8e75247 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:03.470040 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73d2bc-5af9-408c-b7ea-b186f8e75247 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:03.470814 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-cdbe108b-9e9e-483f-89a8-e731e58da159 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 05 14:40:03.474399 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 403/826] 10.222.0.30 () {56 vars in 1150 bytes} [Wed Jan 5 14:40:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:03.479658 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe108b-9e9e-483f-89a8-e731e58da159 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:03.485288 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33192770-db1c-44ab-8609-caafbc03784c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:03.486313 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33192770-db1c-44ab-8609-caafbc03784c admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:03.486788 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33192770-db1c-44ab-8609-caafbc03784c admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:03.487711 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33192770-db1c-44ab-8609-caafbc03784c admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:03.489701 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33192770-db1c-44ab-8609-caafbc03784c admin admin] RBAC: Adding query filter params (type=network) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:03.490225 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33192770-db1c-44ab-8609-caafbc03784c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:03.492763 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33192770-db1c-44ab-8609-caafbc03784c admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:03.502199 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe108b-9e9e-483f-89a8-e731e58da159 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:03.503606 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 424/827] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Jan 5 14:40:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:40:03.517088 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5001224-3e09-4eae-a192-2a4f48529c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:03.517088 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5001224-3e09-4eae-a192-2a4f48529c42 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:03.517088 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5001224-3e09-4eae-a192-2a4f48529c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:03.517088 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5001224-3e09-4eae-a192-2a4f48529c42 admin admin] PATH_INFO: `/v3/services` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:03.517441 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5001224-3e09-4eae-a192-2a4f48529c42 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:03.517441 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5001224-3e09-4eae-a192-2a4f48529c42 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:03.517441 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5001224-3e09-4eae-a192-2a4f48529c42 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:03.518595 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33192770-db1c-44ab-8609-caafbc03784c admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:03.522220 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 404/828] 10.222.0.30 () {56 vars in 1145 bytes} [Wed Jan 5 14:40:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:03.534094 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5001224-3e09-4eae-a192-2a4f48529c42 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:03.539355 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33192770-db1c-44ab-8609-caafbc03784c admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:03.549005 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2b9ca-3fd8-4cbe-b0df-33b1b1c412f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:03.549709 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2b9ca-3fd8-4cbe-b0df-33b1b1c412f7 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:03.549994 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2b9ca-3fd8-4cbe-b0df-33b1b1c412f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:03.550269 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2b9ca-3fd8-4cbe-b0df-33b1b1c412f7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:03.551032 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2b9ca-3fd8-4cbe-b0df-33b1b1c412f7 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:03.552054 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING py.warnings [None req-fef2b9ca-3fd8-4cbe-b0df-33b1b1c412f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:40:03.552054 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: warnings.warn(msg) Jan 05 14:40:03.552054 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: Jan 05 14:40:03.552930 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2b9ca-3fd8-4cbe-b0df-33b1b1c412f7 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:03.556507 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5001224-3e09-4eae-a192-2a4f48529c42 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:03.565231 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1875d-4c13-4c59-993d-4eac6c7b8b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:03.565890 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1875d-4c13-4c59-993d-4eac6c7b8b39 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:03.566175 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1875d-4c13-4c59-993d-4eac6c7b8b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:03.566454 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1875d-4c13-4c59-993d-4eac6c7b8b39 admin admin] PATH_INFO: `/v3/services` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:03.567172 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1875d-4c13-4c59-993d-4eac6c7b8b39 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:03.567477 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1875d-4c13-4c59-993d-4eac6c7b8b39 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:03.569095 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1875d-4c13-4c59-993d-4eac6c7b8b39 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:03.579088 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 405/829] 10.222.0.30 () {56 vars in 1145 bytes} [Wed Jan 5 14:40:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:03.584476 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1875d-4c13-4c59-993d-4eac6c7b8b39 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:03.595783 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1875d-4c13-4c59-993d-4eac6c7b8b39 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:03.600783 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80aae2-0fb8-49af-aaa5-45ea9d0046ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:03.601573 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80aae2-0fb8-49af-aaa5-45ea9d0046ed admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:03.601863 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80aae2-0fb8-49af-aaa5-45ea9d0046ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:03.602199 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80aae2-0fb8-49af-aaa5-45ea9d0046ed admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:03.602992 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80aae2-0fb8-49af-aaa5-45ea9d0046ed admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:03.604151 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING py.warnings [None req-8b80aae2-0fb8-49af-aaa5-45ea9d0046ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:40:03.604151 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: warnings.warn(msg) Jan 05 14:40:03.604151 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: Jan 05 14:40:03.605208 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80aae2-0fb8-49af-aaa5-45ea9d0046ed admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:03.682882 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 425/830] 10.222.0.30 () {60 vars in 1165 bytes} [Wed Jan 5 14:40:03 2022] POST /identity/v3/endpoints => generated 327 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:40:03.725352 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 406/831] 10.222.0.30 () {60 vars in 1165 bytes} [Wed Jan 5 14:40:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:40:03.905601 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921716c-3355-48fa-b5ee-a62afd6829fd None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:03.905934 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921716c-3355-48fa-b5ee-a62afd6829fd None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:03.906163 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921716c-3355-48fa-b5ee-a62afd6829fd None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:03.908263 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 426/832] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:03.913971 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbb644-6182-4756-9659-9658bf7d515c None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:03.914474 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbb644-6182-4756-9659-9658bf7d515c None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:03.914577 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbb644-6182-4756-9659-9658bf7d515c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:03.945570 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-cafbb644-6182-4756-9659-9658bf7d515c None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:03.946799 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-cafbb644-6182-4756-9659-9658bf7d515c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:03.982700 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 407/833] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:03 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:40:04.032893 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921716c-3355-48fa-b5ee-a62afd6829fd None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:04.049982 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921716c-3355-48fa-b5ee-a62afd6829fd None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:04.054471 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e1198-b15e-444d-9f0e-7b60fb0be17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:04.055285 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e1198-b15e-444d-9f0e-7b60fb0be17e admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:04.056108 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e1198-b15e-444d-9f0e-7b60fb0be17e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:04.056384 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e1198-b15e-444d-9f0e-7b60fb0be17e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:04.067961 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e1198-b15e-444d-9f0e-7b60fb0be17e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:40:04.075397 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-199e1198-b15e-444d-9f0e-7b60fb0be17e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 05 14:40:04.077008 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 427/834] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Jan 5 14:40:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:04.083157 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbb644-6182-4756-9659-9658bf7d515c None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:04.093999 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbb644-6182-4756-9659-9658bf7d515c None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:04.098490 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1f605-4c40-4b1d-a515-13e1afe5d89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:04.099157 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1f605-4c40-4b1d-a515-13e1afe5d89f admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:04.099436 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1f605-4c40-4b1d-a515-13e1afe5d89f admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:04.099712 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1f605-4c40-4b1d-a515-13e1afe5d89f admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:04.100467 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1f605-4c40-4b1d-a515-13e1afe5d89f admin admin] RBAC: Adding query filter params (name=service) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:04.100771 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1f605-4c40-4b1d-a515-13e1afe5d89f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:04.102474 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1f605-4c40-4b1d-a515-13e1afe5d89f admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:04.111343 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 408/835] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Jan 5 14:40:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:04.116654 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e1198-b15e-444d-9f0e-7b60fb0be17e admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:04.129335 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e1198-b15e-444d-9f0e-7b60fb0be17e admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:04.133899 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c6d2d-dabe-4df9-a162-18f1d53db6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:04.134714 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c6d2d-dabe-4df9-a162-18f1d53db6eb admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:04.134994 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c6d2d-dabe-4df9-a162-18f1d53db6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:04.135263 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c6d2d-dabe-4df9-a162-18f1d53db6eb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:04.145759 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c6d2d-dabe-4df9-a162-18f1d53db6eb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:04.147570 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c6d2d-dabe-4df9-a162-18f1d53db6eb admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:04.165720 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-fa3c6d2d-dabe-4df9-a162-18f1d53db6eb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:40:04.167348 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 428/836] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:40:04.172469 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1f605-4c40-4b1d-a515-13e1afe5d89f admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:04.184662 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1f605-4c40-4b1d-a515-13e1afe5d89f admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:04.190094 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665aa46-2ca9-4da4-892b-81a298b6387e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:04.190755 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665aa46-2ca9-4da4-892b-81a298b6387e admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:04.191090 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665aa46-2ca9-4da4-892b-81a298b6387e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:04.191364 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665aa46-2ca9-4da4-892b-81a298b6387e admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:04.192146 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1665aa46-2ca9-4da4-892b-81a298b6387e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:04.192453 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1665aa46-2ca9-4da4-892b-81a298b6387e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:04.194137 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1665aa46-2ca9-4da4-892b-81a298b6387e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:04.208221 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 409/837] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:40:04.214153 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c6d2d-dabe-4df9-a162-18f1d53db6eb admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:04.223996 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c6d2d-dabe-4df9-a162-18f1d53db6eb admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:04.230870 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658119f4-da27-474a-ab1e-6615df0096ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:04.231736 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658119f4-da27-474a-ab1e-6615df0096ec admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:04.232013 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658119f4-da27-474a-ab1e-6615df0096ec admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:04.232286 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658119f4-da27-474a-ab1e-6615df0096ec admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:04.241966 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658119f4-da27-474a-ab1e-6615df0096ec admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:04.244138 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658119f4-da27-474a-ab1e-6615df0096ec admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:04.263142 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-658119f4-da27-474a-ab1e-6615df0096ec admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 05 14:40:04.264678 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 429/838] 10.222.0.30 () {56 vars in 1138 bytes} [Wed Jan 5 14:40:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:04.270116 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665aa46-2ca9-4da4-892b-81a298b6387e admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:04.279806 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665aa46-2ca9-4da4-892b-81a298b6387e admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:04.284337 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb3aec-771e-4955-b0a3-bf4f0164ec50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:04.285042 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb3aec-771e-4955-b0a3-bf4f0164ec50 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:04.285362 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb3aec-771e-4955-b0a3-bf4f0164ec50 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:04.285644 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb3aec-771e-4955-b0a3-bf4f0164ec50 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:04.286535 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb3aec-771e-4955-b0a3-bf4f0164ec50 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:04.286842 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb3aec-771e-4955-b0a3-bf4f0164ec50 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:04.288848 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb3aec-771e-4955-b0a3-bf4f0164ec50 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:04.307134 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 410/839] 10.222.0.30 () {56 vars in 1170 bytes} [Wed Jan 5 14:40:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:40:04.312614 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658119f4-da27-474a-ab1e-6615df0096ec admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:04.323108 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658119f4-da27-474a-ab1e-6615df0096ec admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:04.328082 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573e68c-0d79-4dcc-8835-f56ed2f568fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:04.328983 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573e68c-0d79-4dcc-8835-f56ed2f568fd admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:04.329442 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573e68c-0d79-4dcc-8835-f56ed2f568fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:04.329856 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573e68c-0d79-4dcc-8835-f56ed2f568fd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:04.338300 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f573e68c-0d79-4dcc-8835-f56ed2f568fd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:04.340253 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f573e68c-0d79-4dcc-8835-f56ed2f568fd admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:04.350067 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 430/840] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:40:04 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:40:04.356209 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb3aec-771e-4955-b0a3-bf4f0164ec50 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:04.366245 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb3aec-771e-4955-b0a3-bf4f0164ec50 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:04.371122 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9312826-fe24-4990-8cdd-9c05f829847e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:04.372108 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9312826-fe24-4990-8cdd-9c05f829847e admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:04.372528 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9312826-fe24-4990-8cdd-9c05f829847e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:04.372947 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9312826-fe24-4990-8cdd-9c05f829847e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:04.384555 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9312826-fe24-4990-8cdd-9c05f829847e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:04.386673 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9312826-fe24-4990-8cdd-9c05f829847e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:04.404259 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-b9312826-fe24-4990-8cdd-9c05f829847e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:40:04.405965 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 411/841] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:04.411510 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573e68c-0d79-4dcc-8835-f56ed2f568fd admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:04.421146 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573e68c-0d79-4dcc-8835-f56ed2f568fd admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:04.425977 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d554b-7f42-4d3c-881c-7d703d8fad9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:04.426888 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d554b-7f42-4d3c-881c-7d703d8fad9a admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:04.427352 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d554b-7f42-4d3c-881c-7d703d8fad9a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:04.427766 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d554b-7f42-4d3c-881c-7d703d8fad9a admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:04.428688 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d554b-7f42-4d3c-881c-7d703d8fad9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:04.429183 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d554b-7f42-4d3c-881c-7d703d8fad9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:04.431084 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d554b-7f42-4d3c-881c-7d703d8fad9a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:04.443287 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 431/842] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:04.449382 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9312826-fe24-4990-8cdd-9c05f829847e admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:04.459443 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9312826-fe24-4990-8cdd-9c05f829847e admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:04.464467 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d64fa-e20b-4c2f-8ac5-48b2810d95a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:04.465545 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d64fa-e20b-4c2f-8ac5-48b2810d95a8 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:04.466018 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d64fa-e20b-4c2f-8ac5-48b2810d95a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:04.466431 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d64fa-e20b-4c2f-8ac5-48b2810d95a8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:04.473737 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d64fa-e20b-4c2f-8ac5-48b2810d95a8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:04.475953 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d64fa-e20b-4c2f-8ac5-48b2810d95a8 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:04.490158 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-f13d64fa-e20b-4c2f-8ac5-48b2810d95a8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:40:04.491962 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 412/843] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:40:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:04.498198 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d554b-7f42-4d3c-881c-7d703d8fad9a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:04.509616 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d554b-7f42-4d3c-881c-7d703d8fad9a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:04.515221 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04922aa2-ceed-4e0c-b7d8-8fbe0b5c83d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:04.516033 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04922aa2-ceed-4e0c-b7d8-8fbe0b5c83d5 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:04.516497 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04922aa2-ceed-4e0c-b7d8-8fbe0b5c83d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:04.516929 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04922aa2-ceed-4e0c-b7d8-8fbe0b5c83d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:04.517940 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04922aa2-ceed-4e0c-b7d8-8fbe0b5c83d5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:04.518405 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04922aa2-ceed-4e0c-b7d8-8fbe0b5c83d5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:04.520499 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04922aa2-ceed-4e0c-b7d8-8fbe0b5c83d5 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:04.534521 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 432/844] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:40:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:04.541146 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d64fa-e20b-4c2f-8ac5-48b2810d95a8 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:04.552007 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d64fa-e20b-4c2f-8ac5-48b2810d95a8 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:04.557621 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08c6b6-bd5d-4e16-8b59-c887bfb6361d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:04.558463 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08c6b6-bd5d-4e16-8b59-c887bfb6361d admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:04.558891 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08c6b6-bd5d-4e16-8b59-c887bfb6361d admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:04.559337 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08c6b6-bd5d-4e16-8b59-c887bfb6361d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:04.560384 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08c6b6-bd5d-4e16-8b59-c887bfb6361d admin admin] RBAC: Adding query filter params (role.id=9868670385c0469093001f6f2c310f1a, scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1, user.id=29314b0be6534c79b36f31402d51d17b) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:04.560842 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08c6b6-bd5d-4e16-8b59-c887bfb6361d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:04.562901 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08c6b6-bd5d-4e16-8b59-c887bfb6361d admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:04.569457 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 413/845] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:40:04 2022] GET /identity/v3/role_assignments?user.id=29314b0be6534c79b36f31402d51d17b&scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1&role.id=9868670385c0469093001f6f2c310f1a => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:05.173429 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221c872-b811-45e5-8af4-e35b013f6372 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:05.173829 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221c872-b811-45e5-8af4-e35b013f6372 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:05.174005 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221c872-b811-45e5-8af4-e35b013f6372 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:05.176006 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 433/846] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:05.182712 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3130f-83d2-4fdd-a9d3-5ea6afb0db72 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:05.183185 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3130f-83d2-4fdd-a9d3-5ea6afb0db72 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:05.183276 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3130f-83d2-4fdd-a9d3-5ea6afb0db72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:05.201407 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-1be3130f-83d2-4fdd-a9d3-5ea6afb0db72 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:05.202597 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-1be3130f-83d2-4fdd-a9d3-5ea6afb0db72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:05.210576 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 414/847] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:05 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:05.233151 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221c872-b811-45e5-8af4-e35b013f6372 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:05.245420 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221c872-b811-45e5-8af4-e35b013f6372 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:05.249837 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e05663c-eaf7-4618-9d88-7d3cdf739879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:05.250632 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05663c-eaf7-4618-9d88-7d3cdf739879 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:05.250912 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05663c-eaf7-4618-9d88-7d3cdf739879 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:05.251182 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05663c-eaf7-4618-9d88-7d3cdf739879 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:05.252097 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e05663c-eaf7-4618-9d88-7d3cdf739879 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:05.253718 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e05663c-eaf7-4618-9d88-7d3cdf739879 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:05.265745 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-9e05663c-eaf7-4618-9d88-7d3cdf739879 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 05 14:40:05.267225 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 434/848] 10.222.0.30 () {56 vars in 1153 bytes} [Wed Jan 5 14:40:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:05.272968 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3130f-83d2-4fdd-a9d3-5ea6afb0db72 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:05.282119 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3130f-83d2-4fdd-a9d3-5ea6afb0db72 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:05.286778 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0aa42-ee81-46c1-9045-db1696683322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:05.287430 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0aa42-ee81-46c1-9045-db1696683322 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:05.287715 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0aa42-ee81-46c1-9045-db1696683322 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:05.287995 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0aa42-ee81-46c1-9045-db1696683322 admin admin] PATH_INFO: `/v3/services` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:05.288718 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0aa42-ee81-46c1-9045-db1696683322 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:05.289026 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0aa42-ee81-46c1-9045-db1696683322 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:05.291353 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0aa42-ee81-46c1-9045-db1696683322 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:05.298017 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 415/849] 10.222.0.30 () {56 vars in 1147 bytes} [Wed Jan 5 14:40:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:05.303132 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e05663c-eaf7-4618-9d88-7d3cdf739879 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:05.313001 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e05663c-eaf7-4618-9d88-7d3cdf739879 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:05.317576 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c465bf-2898-4557-a5d9-3ebb15d2255b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:05.318212 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c465bf-2898-4557-a5d9-3ebb15d2255b admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:05.318493 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c465bf-2898-4557-a5d9-3ebb15d2255b admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:05.318778 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c465bf-2898-4557-a5d9-3ebb15d2255b admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:05.319490 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c465bf-2898-4557-a5d9-3ebb15d2255b admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:05.319792 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c465bf-2898-4557-a5d9-3ebb15d2255b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:05.321442 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c465bf-2898-4557-a5d9-3ebb15d2255b admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:05.326227 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 435/850] 10.222.0.30 () {56 vars in 1147 bytes} [Wed Jan 5 14:40:05 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:05.793970 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d8235-68fa-4e8c-b8b3-d25c412131c2 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:05.794326 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d8235-68fa-4e8c-b8b3-d25c412131c2 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:05.794502 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d8235-68fa-4e8c-b8b3-d25c412131c2 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:05.796494 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 416/851] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:05.801711 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a4c8c-11b0-404e-a804-6199fd1be997 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:05.802165 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a4c8c-11b0-404e-a804-6199fd1be997 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:05.802241 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a4c8c-11b0-404e-a804-6199fd1be997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:05.821833 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-c91a4c8c-11b0-404e-a804-6199fd1be997 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:05.823056 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-c91a4c8c-11b0-404e-a804-6199fd1be997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:05.831240 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 436/852] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:05 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:05.856837 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d8235-68fa-4e8c-b8b3-d25c412131c2 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:05.869739 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d8235-68fa-4e8c-b8b3-d25c412131c2 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:05.874417 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa0f14-bc13-4842-b943-6c5c1b20793f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:05.875414 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa0f14-bc13-4842-b943-6c5c1b20793f admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:05.875890 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa0f14-bc13-4842-b943-6c5c1b20793f admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:05.876381 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa0f14-bc13-4842-b943-6c5c1b20793f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:05.887707 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa0f14-bc13-4842-b943-6c5c1b20793f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:40:05.895013 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-28aa0f14-bc13-4842-b943-6c5c1b20793f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 05 14:40:05.896678 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 417/853] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:40:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:05.902268 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a4c8c-11b0-404e-a804-6199fd1be997 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:05.911290 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a4c8c-11b0-404e-a804-6199fd1be997 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:05.916444 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6db5d-565a-497e-ba5a-360382821724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:05.917131 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6db5d-565a-497e-ba5a-360382821724 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:05.917418 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6db5d-565a-497e-ba5a-360382821724 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:05.917695 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6db5d-565a-497e-ba5a-360382821724 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:05.918455 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6db5d-565a-497e-ba5a-360382821724 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:05.918757 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6db5d-565a-497e-ba5a-360382821724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:05.920336 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6db5d-565a-497e-ba5a-360382821724 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:05.929015 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 437/854] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:40:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:05.934435 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa0f14-bc13-4842-b943-6c5c1b20793f admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:05.945550 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa0f14-bc13-4842-b943-6c5c1b20793f admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:05.950729 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb889dc0-bf07-4254-a253-bbbfd2bee990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:05.951497 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb889dc0-bf07-4254-a253-bbbfd2bee990 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:05.963122 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb889dc0-bf07-4254-a253-bbbfd2bee990 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:05.963122 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb889dc0-bf07-4254-a253-bbbfd2bee990 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:05.963122 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb889dc0-bf07-4254-a253-bbbfd2bee990 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:05.964305 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb889dc0-bf07-4254-a253-bbbfd2bee990 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:05.982564 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-fb889dc0-bf07-4254-a253-bbbfd2bee990 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:40:05.984185 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 418/855] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:05.990087 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6db5d-565a-497e-ba5a-360382821724 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:06.000434 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6db5d-565a-497e-ba5a-360382821724 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:06.005386 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb51fef-5c5e-4963-92fa-4b0cd06bc010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:06.006064 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb51fef-5c5e-4963-92fa-4b0cd06bc010 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:06.006346 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb51fef-5c5e-4963-92fa-4b0cd06bc010 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:06.006622 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb51fef-5c5e-4963-92fa-4b0cd06bc010 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:06.007362 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb51fef-5c5e-4963-92fa-4b0cd06bc010 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:06.007665 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb51fef-5c5e-4963-92fa-4b0cd06bc010 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:06.009849 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb51fef-5c5e-4963-92fa-4b0cd06bc010 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:06.022721 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 438/856] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:06.028383 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb889dc0-bf07-4254-a253-bbbfd2bee990 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:06.038275 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb889dc0-bf07-4254-a253-bbbfd2bee990 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:06.043399 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe31370-c984-4609-8b5f-3f4968df08ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:06.044237 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe31370-c984-4609-8b5f-3f4968df08ad admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:06.044461 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe31370-c984-4609-8b5f-3f4968df08ad admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:06.044738 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe31370-c984-4609-8b5f-3f4968df08ad admin admin] PATH_INFO: `/v3/users/swift` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:06.052506 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe31370-c984-4609-8b5f-3f4968df08ad admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:06.054639 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe31370-c984-4609-8b5f-3f4968df08ad admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:06.069332 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-8fe31370-c984-4609-8b5f-3f4968df08ad admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 05 14:40:06.070880 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 419/857] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:40:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:06.076578 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb51fef-5c5e-4963-92fa-4b0cd06bc010 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:06.087391 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb51fef-5c5e-4963-92fa-4b0cd06bc010 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:06.091977 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b325a4-9ffb-4896-bbfc-8d3b040cb321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:06.092641 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b325a4-9ffb-4896-bbfc-8d3b040cb321 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:06.092968 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b325a4-9ffb-4896-bbfc-8d3b040cb321 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:06.093286 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b325a4-9ffb-4896-bbfc-8d3b040cb321 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:06.094203 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b325a4-9ffb-4896-bbfc-8d3b040cb321 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:06.094506 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b325a4-9ffb-4896-bbfc-8d3b040cb321 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:06.096404 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b325a4-9ffb-4896-bbfc-8d3b040cb321 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:06.115037 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 439/858] 10.222.0.30 () {56 vars in 1156 bytes} [Wed Jan 5 14:40:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:06.121100 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe31370-c984-4609-8b5f-3f4968df08ad admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:06.131264 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe31370-c984-4609-8b5f-3f4968df08ad admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:06.136132 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909ebd1-fa69-49c1-9872-7e6962df5074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:06.136765 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909ebd1-fa69-49c1-9872-7e6962df5074 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:06.137125 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909ebd1-fa69-49c1-9872-7e6962df5074 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:06.137412 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909ebd1-fa69-49c1-9872-7e6962df5074 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:06.145884 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909ebd1-fa69-49c1-9872-7e6962df5074 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:06.147717 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909ebd1-fa69-49c1-9872-7e6962df5074 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:06.157555 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 420/859] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:40:06 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:40:06.163187 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b325a4-9ffb-4896-bbfc-8d3b040cb321 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:06.173173 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b325a4-9ffb-4896-bbfc-8d3b040cb321 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:06.177913 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c7304-45eb-4a0b-8edd-2073745d2765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:06.178702 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c7304-45eb-4a0b-8edd-2073745d2765 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:06.178986 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c7304-45eb-4a0b-8edd-2073745d2765 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:06.179317 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c7304-45eb-4a0b-8edd-2073745d2765 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:06.190496 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c7304-45eb-4a0b-8edd-2073745d2765 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:06.192402 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c7304-45eb-4a0b-8edd-2073745d2765 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:06.210719 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-333c7304-45eb-4a0b-8edd-2073745d2765 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:40:06.212769 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 440/860] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:06.218231 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909ebd1-fa69-49c1-9872-7e6962df5074 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:06.227143 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909ebd1-fa69-49c1-9872-7e6962df5074 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:06.231928 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf9638-8583-465a-838d-47c1fef6278f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:06.232620 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf9638-8583-465a-838d-47c1fef6278f admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:06.232909 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf9638-8583-465a-838d-47c1fef6278f admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:06.233227 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf9638-8583-465a-838d-47c1fef6278f admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:06.234021 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf9638-8583-465a-838d-47c1fef6278f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:06.234326 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf9638-8583-465a-838d-47c1fef6278f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:06.236074 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf9638-8583-465a-838d-47c1fef6278f admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:06.248426 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 421/861] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:06.254066 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c7304-45eb-4a0b-8edd-2073745d2765 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:06.264362 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c7304-45eb-4a0b-8edd-2073745d2765 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:06.269091 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887af288-04db-44ca-9378-5ab2174d8ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:06.269922 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887af288-04db-44ca-9378-5ab2174d8ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:06.270246 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887af288-04db-44ca-9378-5ab2174d8ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:06.270525 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887af288-04db-44ca-9378-5ab2174d8ed8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:06.278104 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887af288-04db-44ca-9378-5ab2174d8ed8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:06.280098 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887af288-04db-44ca-9378-5ab2174d8ed8 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:06.293506 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-887af288-04db-44ca-9378-5ab2174d8ed8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:40:06.295056 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 441/862] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:40:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:06.300606 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf9638-8583-465a-838d-47c1fef6278f admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:06.311089 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf9638-8583-465a-838d-47c1fef6278f admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:06.315714 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15eedf3-ae79-4d0c-beef-f41f4056fd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:06.316359 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15eedf3-ae79-4d0c-beef-f41f4056fd18 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:06.316639 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15eedf3-ae79-4d0c-beef-f41f4056fd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:06.316962 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15eedf3-ae79-4d0c-beef-f41f4056fd18 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:06.317789 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15eedf3-ae79-4d0c-beef-f41f4056fd18 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:06.318150 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15eedf3-ae79-4d0c-beef-f41f4056fd18 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:06.320052 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15eedf3-ae79-4d0c-beef-f41f4056fd18 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:06.332681 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 422/863] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:40:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:06.339040 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887af288-04db-44ca-9378-5ab2174d8ed8 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:06.349789 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887af288-04db-44ca-9378-5ab2174d8ed8 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:06.356190 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b306b-2e34-463c-9a41-b8ad007e56b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:06.357411 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b306b-2e34-463c-9a41-b8ad007e56b0 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:06.357918 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b306b-2e34-463c-9a41-b8ad007e56b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:06.358254 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b306b-2e34-463c-9a41-b8ad007e56b0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:06.359106 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b306b-2e34-463c-9a41-b8ad007e56b0 admin admin] RBAC: Adding query filter params (role.id=494131614fcf424f92e0817fa7ff6961, scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1, user.id=c6ea13fd3e704b16aad5a38606ddc049) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:06.359477 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b306b-2e34-463c-9a41-b8ad007e56b0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:06.361482 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b306b-2e34-463c-9a41-b8ad007e56b0 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:06.369009 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 442/864] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:40:06 2022] GET /identity/v3/role_assignments?user.id=c6ea13fd3e704b16aad5a38606ddc049&scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1&role.id=494131614fcf424f92e0817fa7ff6961 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:06.458823 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5456021-d79c-4cbc-ba53-f81ec8739073 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:06.459169 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5456021-d79c-4cbc-ba53-f81ec8739073 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:06.459375 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5456021-d79c-4cbc-ba53-f81ec8739073 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:06.461486 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 423/865] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 14:40:06.469870 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8d9a7-d0b1-469f-8501-a37ec07852e5 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:06.470171 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8d9a7-d0b1-469f-8501-a37ec07852e5 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:06.470422 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8d9a7-d0b1-469f-8501-a37ec07852e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:06.489534 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-00b8d9a7-d0b1-469f-8501-a37ec07852e5 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:06.490746 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-00b8d9a7-d0b1-469f-8501-a37ec07852e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:06.500129 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 443/866] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:06 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:40:06.526907 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5456021-d79c-4cbc-ba53-f81ec8739073 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:06.539069 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5456021-d79c-4cbc-ba53-f81ec8739073 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:06.544421 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade1ac5-f20f-4a37-8559-cb9581e725f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:06.545639 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade1ac5-f20f-4a37-8559-cb9581e725f1 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:06.546148 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade1ac5-f20f-4a37-8559-cb9581e725f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:06.546636 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade1ac5-f20f-4a37-8559-cb9581e725f1 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:06.547505 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade1ac5-f20f-4a37-8559-cb9581e725f1 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:06.549543 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade1ac5-f20f-4a37-8559-cb9581e725f1 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:06.561944 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-cade1ac5-f20f-4a37-8559-cb9581e725f1 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 05 14:40:06.568523 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 424/867] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Jan 5 14:40:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:06.570189 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8d9a7-d0b1-469f-8501-a37ec07852e5 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:06.580266 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8d9a7-d0b1-469f-8501-a37ec07852e5 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:06.585176 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75018e52-7eab-46cf-a0b5-534d905b6ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:06.585867 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75018e52-7eab-46cf-a0b5-534d905b6ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:06.586197 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75018e52-7eab-46cf-a0b5-534d905b6ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:06.586482 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75018e52-7eab-46cf-a0b5-534d905b6ae4 admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:06.587290 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75018e52-7eab-46cf-a0b5-534d905b6ae4 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:06.587598 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75018e52-7eab-46cf-a0b5-534d905b6ae4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:06.589396 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75018e52-7eab-46cf-a0b5-534d905b6ae4 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:06.594999 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 444/868] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Jan 5 14:40:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:06.600577 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade1ac5-f20f-4a37-8559-cb9581e725f1 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:06.613694 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade1ac5-f20f-4a37-8559-cb9581e725f1 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:06.619098 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd420e9-8016-4c7a-ace6-df39c7acd103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:06.619978 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd420e9-8016-4c7a-ace6-df39c7acd103 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:06.620456 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd420e9-8016-4c7a-ace6-df39c7acd103 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:06.620945 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd420e9-8016-4c7a-ace6-df39c7acd103 admin admin] PATH_INFO: `/v3/services` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:06.621704 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd420e9-8016-4c7a-ace6-df39c7acd103 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:06.622009 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd420e9-8016-4c7a-ace6-df39c7acd103 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:06.623617 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd420e9-8016-4c7a-ace6-df39c7acd103 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:06.628921 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 425/869] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Jan 5 14:40:06 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:07.155528 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17dac1-4746-4ab2-8bb5-f62fdd447aca None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:07.156066 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17dac1-4746-4ab2-8bb5-f62fdd447aca None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:07.156066 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17dac1-4746-4ab2-8bb5-f62fdd447aca None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:07.158112 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 445/870] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:07.163397 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558e055-a8a5-48b0-918a-8c0f1627279f None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:07.163686 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558e055-a8a5-48b0-918a-8c0f1627279f None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:07.163965 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558e055-a8a5-48b0-918a-8c0f1627279f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:07.183361 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-f558e055-a8a5-48b0-918a-8c0f1627279f None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:07.184541 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-f558e055-a8a5-48b0-918a-8c0f1627279f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:07.192517 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 426/871] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:07 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:40:07.217931 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17dac1-4746-4ab2-8bb5-f62fdd447aca None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:07.230654 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17dac1-4746-4ab2-8bb5-f62fdd447aca None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:07.235016 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a494a-b6b2-4373-b516-37fbd4d07384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:07.235805 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a494a-b6b2-4373-b516-37fbd4d07384 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:07.236084 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a494a-b6b2-4373-b516-37fbd4d07384 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:07.236359 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a494a-b6b2-4373-b516-37fbd4d07384 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:07.246717 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a494a-b6b2-4373-b516-37fbd4d07384 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:40:07.254466 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-068a494a-b6b2-4373-b516-37fbd4d07384 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 05 14:40:07.255938 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 446/872] 10.222.0.30 () {56 vars in 1141 bytes} [Wed Jan 5 14:40:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:07.262234 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558e055-a8a5-48b0-918a-8c0f1627279f None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:07.271261 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558e055-a8a5-48b0-918a-8c0f1627279f None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:07.275988 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39111736-5107-4285-9d23-ecd52a371370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:07.276637 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39111736-5107-4285-9d23-ecd52a371370 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:07.276914 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39111736-5107-4285-9d23-ecd52a371370 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:07.277227 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39111736-5107-4285-9d23-ecd52a371370 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:07.277982 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39111736-5107-4285-9d23-ecd52a371370 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:07.278285 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39111736-5107-4285-9d23-ecd52a371370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:07.279868 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39111736-5107-4285-9d23-ecd52a371370 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:07.288325 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 427/873] 10.222.0.30 () {56 vars in 1136 bytes} [Wed Jan 5 14:40:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:07.294133 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a494a-b6b2-4373-b516-37fbd4d07384 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:07.304245 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a494a-b6b2-4373-b516-37fbd4d07384 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:07.309191 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3705187-449b-42ea-9f2c-06a0d5e67a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:07.310026 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3705187-449b-42ea-9f2c-06a0d5e67a15 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:07.310308 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3705187-449b-42ea-9f2c-06a0d5e67a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:07.310580 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3705187-449b-42ea-9f2c-06a0d5e67a15 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:07.321654 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3705187-449b-42ea-9f2c-06a0d5e67a15 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:07.323608 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3705187-449b-42ea-9f2c-06a0d5e67a15 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:07.341011 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-b3705187-449b-42ea-9f2c-06a0d5e67a15 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:40:07.342506 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 447/874] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:07.348162 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39111736-5107-4285-9d23-ecd52a371370 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:07.358986 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39111736-5107-4285-9d23-ecd52a371370 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:07.364153 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d068762-10c1-46a8-b26d-3f6f123686f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:07.364834 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d068762-10c1-46a8-b26d-3f6f123686f7 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:07.365142 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d068762-10c1-46a8-b26d-3f6f123686f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:07.365470 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d068762-10c1-46a8-b26d-3f6f123686f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:07.366241 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d068762-10c1-46a8-b26d-3f6f123686f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:07.366611 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d068762-10c1-46a8-b26d-3f6f123686f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:07.368520 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d068762-10c1-46a8-b26d-3f6f123686f7 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:07.382571 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 428/875] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:07.388764 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3705187-449b-42ea-9f2c-06a0d5e67a15 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:07.398833 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3705187-449b-42ea-9f2c-06a0d5e67a15 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:07.403800 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78e45d-90fe-4bff-b33a-5c38eb6fcf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:07.404660 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78e45d-90fe-4bff-b33a-5c38eb6fcf37 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:07.404943 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78e45d-90fe-4bff-b33a-5c38eb6fcf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:07.405295 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78e45d-90fe-4bff-b33a-5c38eb6fcf37 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:07.413247 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78e45d-90fe-4bff-b33a-5c38eb6fcf37 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:07.415819 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78e45d-90fe-4bff-b33a-5c38eb6fcf37 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:07.430984 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-3f78e45d-90fe-4bff-b33a-5c38eb6fcf37 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 05 14:40:07.432436 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 448/876] 10.222.0.30 () {56 vars in 1138 bytes} [Wed Jan 5 14:40:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:07.438023 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d068762-10c1-46a8-b26d-3f6f123686f7 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:07.448530 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d068762-10c1-46a8-b26d-3f6f123686f7 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:07.453159 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17dcc98-e060-4945-89d7-f85ad31f2ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:07.453868 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dcc98-e060-4945-89d7-f85ad31f2ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:07.454146 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dcc98-e060-4945-89d7-f85ad31f2ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:07.454417 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dcc98-e060-4945-89d7-f85ad31f2ab5 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:07.455311 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17dcc98-e060-4945-89d7-f85ad31f2ab5 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:07.455612 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17dcc98-e060-4945-89d7-f85ad31f2ab5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:07.457592 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17dcc98-e060-4945-89d7-f85ad31f2ab5 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:07.476348 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 429/877] 10.222.0.30 () {56 vars in 1170 bytes} [Wed Jan 5 14:40:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:07.482397 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78e45d-90fe-4bff-b33a-5c38eb6fcf37 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:07.493098 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78e45d-90fe-4bff-b33a-5c38eb6fcf37 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:07.499563 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3870a88-a5bb-4de9-afb0-da72f4f0855f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:07.500255 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3870a88-a5bb-4de9-afb0-da72f4f0855f admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:07.500535 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3870a88-a5bb-4de9-afb0-da72f4f0855f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:07.500810 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3870a88-a5bb-4de9-afb0-da72f4f0855f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:07.515793 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3870a88-a5bb-4de9-afb0-da72f4f0855f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:07.517886 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3870a88-a5bb-4de9-afb0-da72f4f0855f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:07.529811 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 449/878] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:40:07 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:40:07.535454 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17dcc98-e060-4945-89d7-f85ad31f2ab5 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:07.545996 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17dcc98-e060-4945-89d7-f85ad31f2ab5 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:07.550630 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688ddb7-d149-49fd-80c3-f3f31b37b9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:07.551514 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688ddb7-d149-49fd-80c3-f3f31b37b9ea admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:07.551791 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688ddb7-d149-49fd-80c3-f3f31b37b9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:07.552066 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688ddb7-d149-49fd-80c3-f3f31b37b9ea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:07.563206 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688ddb7-d149-49fd-80c3-f3f31b37b9ea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:07.565109 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688ddb7-d149-49fd-80c3-f3f31b37b9ea admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:07.582506 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-6688ddb7-d149-49fd-80c3-f3f31b37b9ea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:40:07.583896 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 430/879] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:07.589893 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3870a88-a5bb-4de9-afb0-da72f4f0855f admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:07.598964 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3870a88-a5bb-4de9-afb0-da72f4f0855f admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:07.603855 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbc3f5-80ce-42b3-9d1f-ec471601bf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:07.604530 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbc3f5-80ce-42b3-9d1f-ec471601bf88 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:07.604858 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbc3f5-80ce-42b3-9d1f-ec471601bf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:07.605221 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbc3f5-80ce-42b3-9d1f-ec471601bf88 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:07.605971 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcbc3f5-80ce-42b3-9d1f-ec471601bf88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:07.606271 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcbc3f5-80ce-42b3-9d1f-ec471601bf88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:07.607960 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcbc3f5-80ce-42b3-9d1f-ec471601bf88 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:07.622274 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 450/880] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:07.627923 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688ddb7-d149-49fd-80c3-f3f31b37b9ea admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:07.638382 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688ddb7-d149-49fd-80c3-f3f31b37b9ea admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:07.642981 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e5d16-d6b2-44c1-9476-73b67137c772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:07.643801 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e5d16-d6b2-44c1-9476-73b67137c772 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:07.644110 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e5d16-d6b2-44c1-9476-73b67137c772 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:07.644391 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e5d16-d6b2-44c1-9476-73b67137c772 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:07.652318 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e5d16-d6b2-44c1-9476-73b67137c772 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:07.654337 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e5d16-d6b2-44c1-9476-73b67137c772 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:07.668073 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-f96e5d16-d6b2-44c1-9476-73b67137c772 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:40:07.669538 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 431/881] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:40:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:40:07.675240 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbc3f5-80ce-42b3-9d1f-ec471601bf88 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:07.687416 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbc3f5-80ce-42b3-9d1f-ec471601bf88 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:07.692018 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4195dbb-342a-4763-9b74-cbdbba5d5ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:07.692677 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4195dbb-342a-4763-9b74-cbdbba5d5ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:07.692961 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4195dbb-342a-4763-9b74-cbdbba5d5ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:07.693276 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4195dbb-342a-4763-9b74-cbdbba5d5ef2 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:07.694082 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4195dbb-342a-4763-9b74-cbdbba5d5ef2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:07.694386 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4195dbb-342a-4763-9b74-cbdbba5d5ef2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:07.696310 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4195dbb-342a-4763-9b74-cbdbba5d5ef2 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:07.708941 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 451/882] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:40:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:07.715271 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e5d16-d6b2-44c1-9476-73b67137c772 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:07.726260 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e5d16-d6b2-44c1-9476-73b67137c772 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:07.733199 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789cd052-2805-4b7b-a2fa-53eb64539b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:07.734123 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789cd052-2805-4b7b-a2fa-53eb64539b0b admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:07.734580 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789cd052-2805-4b7b-a2fa-53eb64539b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:07.735092 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789cd052-2805-4b7b-a2fa-53eb64539b0b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:07.736102 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789cd052-2805-4b7b-a2fa-53eb64539b0b admin admin] RBAC: Adding query filter params (role.id=401d03aa1ee442828aa97481f13b473c, scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1, user.id=29314b0be6534c79b36f31402d51d17b) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:07.736636 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789cd052-2805-4b7b-a2fa-53eb64539b0b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:07.738802 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789cd052-2805-4b7b-a2fa-53eb64539b0b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:07.745867 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 432/883] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:40:07 2022] GET /identity/v3/role_assignments?user.id=29314b0be6534c79b36f31402d51d17b&scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1&role.id=401d03aa1ee442828aa97481f13b473c => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:07.829658 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c0651-75ee-478a-b636-44c7733d96e4 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:07.829961 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c0651-75ee-478a-b636-44c7733d96e4 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:07.830231 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c0651-75ee-478a-b636-44c7733d96e4 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:07.832389 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 452/884] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:07.839059 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef387806-5e4a-479e-b7bf-cd0552229161 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:07.839709 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef387806-5e4a-479e-b7bf-cd0552229161 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:07.840231 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef387806-5e4a-479e-b7bf-cd0552229161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:07.860118 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-ef387806-5e4a-479e-b7bf-cd0552229161 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:07.861637 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-ef387806-5e4a-479e-b7bf-cd0552229161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:07.870797 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 433/885] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:07 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:07.895568 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c0651-75ee-478a-b636-44c7733d96e4 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:07.909496 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c0651-75ee-478a-b636-44c7733d96e4 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:07.914037 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da01833-e2a4-495c-b13c-0993372368cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:07.914748 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da01833-e2a4-495c-b13c-0993372368cf admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:07.915064 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da01833-e2a4-495c-b13c-0993372368cf admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:07.915340 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da01833-e2a4-495c-b13c-0993372368cf admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:07.916105 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da01833-e2a4-495c-b13c-0993372368cf admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:07.917782 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da01833-e2a4-495c-b13c-0993372368cf admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:08.025874 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 453/886] 10.222.0.30 () {60 vars in 1162 bytes} [Wed Jan 5 14:40:07 2022] POST /identity/v3/services => generated 269 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:40:08.915469 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df78515-6235-4ec4-a3c0-ff87b0a396d9 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:08.916007 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df78515-6235-4ec4-a3c0-ff87b0a396d9 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:08.916007 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df78515-6235-4ec4-a3c0-ff87b0a396d9 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:08.918129 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 434/887] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:08.925015 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4af0e-3269-4774-ab10-93b731179742 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:08.925544 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4af0e-3269-4774-ab10-93b731179742 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:08.925630 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4af0e-3269-4774-ab10-93b731179742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:08.944534 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-85e4af0e-3269-4774-ab10-93b731179742 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:08.945793 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-85e4af0e-3269-4774-ab10-93b731179742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:08.969174 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 454/888] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:08 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:08.986781 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df78515-6235-4ec4-a3c0-ff87b0a396d9 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:08.999708 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df78515-6235-4ec4-a3c0-ff87b0a396d9 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:09.004432 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910760ff-0bbe-482d-8780-fd146ed23881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:09.005248 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910760ff-0bbe-482d-8780-fd146ed23881 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:09.005565 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910760ff-0bbe-482d-8780-fd146ed23881 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:09.005843 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910760ff-0bbe-482d-8780-fd146ed23881 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:09.006509 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910760ff-0bbe-482d-8780-fd146ed23881 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:09.008107 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910760ff-0bbe-482d-8780-fd146ed23881 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:09.020411 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-910760ff-0bbe-482d-8780-fd146ed23881 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 05 14:40:09.025696 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 435/889] 10.222.0.30 () {56 vars in 1147 bytes} [Wed Jan 5 14:40:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:09.028853 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4af0e-3269-4774-ab10-93b731179742 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:09.037825 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4af0e-3269-4774-ab10-93b731179742 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:09.042446 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54928d89-426c-478c-9c63-fd750a3d9b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:09.043105 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54928d89-426c-478c-9c63-fd750a3d9b05 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:09.043388 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54928d89-426c-478c-9c63-fd750a3d9b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:09.043664 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54928d89-426c-478c-9c63-fd750a3d9b05 admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:09.044386 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54928d89-426c-478c-9c63-fd750a3d9b05 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:09.044689 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54928d89-426c-478c-9c63-fd750a3d9b05 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:09.046345 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54928d89-426c-478c-9c63-fd750a3d9b05 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:09.055918 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 455/890] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Jan 5 14:40:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:09.057460 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910760ff-0bbe-482d-8780-fd146ed23881 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:09.067220 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910760ff-0bbe-482d-8780-fd146ed23881 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:09.071926 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76da9cb-521e-43a1-a063-f8d93a210561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:09.072569 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76da9cb-521e-43a1-a063-f8d93a210561 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:09.072853 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76da9cb-521e-43a1-a063-f8d93a210561 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:09.073159 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76da9cb-521e-43a1-a063-f8d93a210561 admin admin] PATH_INFO: `/v3/services` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:09.073881 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76da9cb-521e-43a1-a063-f8d93a210561 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:09.074186 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76da9cb-521e-43a1-a063-f8d93a210561 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:09.075783 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76da9cb-521e-43a1-a063-f8d93a210561 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:09.085197 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 436/891] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Jan 5 14:40:09 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:09.153926 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8056b98-96c9-4330-9c1c-85d38f7090a3 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:09.154281 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8056b98-96c9-4330-9c1c-85d38f7090a3 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:09.154478 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8056b98-96c9-4330-9c1c-85d38f7090a3 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:09.156579 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 456/892] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:09.162193 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90215b08-6c02-423b-8d62-1c281e3b0001 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:09.162488 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90215b08-6c02-423b-8d62-1c281e3b0001 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:09.162747 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90215b08-6c02-423b-8d62-1c281e3b0001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:09.182700 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-90215b08-6c02-423b-8d62-1c281e3b0001 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:09.183839 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-90215b08-6c02-423b-8d62-1c281e3b0001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:09.192239 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 437/893] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:09 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:09.218263 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8056b98-96c9-4330-9c1c-85d38f7090a3 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:09.231442 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8056b98-96c9-4330-9c1c-85d38f7090a3 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:09.236188 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba769b-732c-4ec1-a37b-d94f29ff3e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:09.236866 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba769b-732c-4ec1-a37b-d94f29ff3e16 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:09.237186 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba769b-732c-4ec1-a37b-d94f29ff3e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:09.237470 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba769b-732c-4ec1-a37b-d94f29ff3e16 admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:09.238248 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba769b-732c-4ec1-a37b-d94f29ff3e16 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:09.239893 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba769b-732c-4ec1-a37b-d94f29ff3e16 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:09.318799 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 457/894] 10.222.0.30 () {60 vars in 1162 bytes} [Wed Jan 5 14:40:09 2022] POST /identity/v3/services => generated 251 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:40:10.243509 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544382a-1ba7-4c51-a056-7caac478bf02 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:10.244237 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544382a-1ba7-4c51-a056-7caac478bf02 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:10.244237 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544382a-1ba7-4c51-a056-7caac478bf02 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:10.246144 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 438/895] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:10.251771 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59066cb8-dd4f-4db7-8c35-3607b8f81e2f None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:10.252646 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59066cb8-dd4f-4db7-8c35-3607b8f81e2f None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:10.253195 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59066cb8-dd4f-4db7-8c35-3607b8f81e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:10.273436 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-59066cb8-dd4f-4db7-8c35-3607b8f81e2f None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:10.275101 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-59066cb8-dd4f-4db7-8c35-3607b8f81e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:10.293805 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 458/896] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:10 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:10.318154 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544382a-1ba7-4c51-a056-7caac478bf02 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:10.337315 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544382a-1ba7-4c51-a056-7caac478bf02 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:10.342115 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3cf59-a908-4b65-8f64-73b6cb1c4f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:10.343140 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3cf59-a908-4b65-8f64-73b6cb1c4f81 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:10.343627 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3cf59-a908-4b65-8f64-73b6cb1c4f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:10.344106 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3cf59-a908-4b65-8f64-73b6cb1c4f81 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:10.355995 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c3cf59-a908-4b65-8f64-73b6cb1c4f81 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:40:10.363967 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-43c3cf59-a908-4b65-8f64-73b6cb1c4f81 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 05 14:40:10.365712 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 439/897] 10.222.0.30 () {56 vars in 1141 bytes} [Wed Jan 5 14:40:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:10.372233 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59066cb8-dd4f-4db7-8c35-3607b8f81e2f None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:10.381903 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59066cb8-dd4f-4db7-8c35-3607b8f81e2f None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:10.386869 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebca9f-d00b-4d51-81c7-343b5ffb64ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:10.387765 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebca9f-d00b-4d51-81c7-343b5ffb64ca admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:10.388250 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebca9f-d00b-4d51-81c7-343b5ffb64ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:10.388726 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebca9f-d00b-4d51-81c7-343b5ffb64ca admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:10.389714 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ebca9f-d00b-4d51-81c7-343b5ffb64ca admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:10.390265 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ebca9f-d00b-4d51-81c7-343b5ffb64ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:10.392034 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ebca9f-d00b-4d51-81c7-343b5ffb64ca admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:10.401031 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 459/898] 10.222.0.30 () {56 vars in 1136 bytes} [Wed Jan 5 14:40:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:10.406764 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3cf59-a908-4b65-8f64-73b6cb1c4f81 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:10.417548 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3cf59-a908-4b65-8f64-73b6cb1c4f81 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:10.422493 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4639128-9068-4c63-aaa2-b1774ff53b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:10.423581 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4639128-9068-4c63-aaa2-b1774ff53b7e admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:10.424068 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4639128-9068-4c63-aaa2-b1774ff53b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:10.424564 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4639128-9068-4c63-aaa2-b1774ff53b7e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:10.436989 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4639128-9068-4c63-aaa2-b1774ff53b7e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:10.440518 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4639128-9068-4c63-aaa2-b1774ff53b7e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:10.468168 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-e4639128-9068-4c63-aaa2-b1774ff53b7e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:40:10.470099 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 440/899] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:10.478120 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebca9f-d00b-4d51-81c7-343b5ffb64ca admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:10.488765 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5714b6e-6ff2-442d-ad02-440bea11489f None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:10.489497 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5714b6e-6ff2-442d-ad02-440bea11489f None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:10.490281 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5714b6e-6ff2-442d-ad02-440bea11489f None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:10.490991 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebca9f-d00b-4d51-81c7-343b5ffb64ca admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:10.494908 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 441/900] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:10.501977 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c068d1-b6a5-46a1-87ea-6ed4563fdd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:10.502632 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c068d1-b6a5-46a1-87ea-6ed4563fdd17 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:10.502900 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c068d1-b6a5-46a1-87ea-6ed4563fdd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:10.503172 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c068d1-b6a5-46a1-87ea-6ed4563fdd17 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:10.503913 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c068d1-b6a5-46a1-87ea-6ed4563fdd17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:10.504217 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c068d1-b6a5-46a1-87ea-6ed4563fdd17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:10.504411 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d65ac-aef7-4309-9e6f-8b10f3fbbd72 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:10.504889 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d65ac-aef7-4309-9e6f-8b10f3fbbd72 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:10.505429 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d65ac-aef7-4309-9e6f-8b10f3fbbd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:10.505860 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c068d1-b6a5-46a1-87ea-6ed4563fdd17 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:10.520377 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 460/901] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:10.526558 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-827d65ac-aef7-4309-9e6f-8b10f3fbbd72 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:10.526749 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c068d1-b6a5-46a1-87ea-6ed4563fdd17 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:10.527786 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-827d65ac-aef7-4309-9e6f-8b10f3fbbd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:10.536126 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 442/902] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:10 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:10.539388 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c068d1-b6a5-46a1-87ea-6ed4563fdd17 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:10.548769 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750d0c3-176d-49bd-bf84-17bc1efa3950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:10.549450 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750d0c3-176d-49bd-bf84-17bc1efa3950 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:10.549667 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750d0c3-176d-49bd-bf84-17bc1efa3950 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:10.549951 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750d0c3-176d-49bd-bf84-17bc1efa3950 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:10.558602 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750d0c3-176d-49bd-bf84-17bc1efa3950 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:10.560703 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750d0c3-176d-49bd-bf84-17bc1efa3950 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:10.562250 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d65ac-aef7-4309-9e6f-8b10f3fbbd72 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:10.571689 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d65ac-aef7-4309-9e6f-8b10f3fbbd72 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:10.576357 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd586c2-e975-4fad-9712-b92785f5af04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:10.577161 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-e750d0c3-176d-49bd-bf84-17bc1efa3950 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 05 14:40:10.577346 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd586c2-e975-4fad-9712-b92785f5af04 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:10.577601 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd586c2-e975-4fad-9712-b92785f5af04 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:10.577879 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd586c2-e975-4fad-9712-b92785f5af04 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:10.578605 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd586c2-e975-4fad-9712-b92785f5af04 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:10.580283 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd586c2-e975-4fad-9712-b92785f5af04 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:10.581158 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 461/903] 10.222.0.30 () {56 vars in 1138 bytes} [Wed Jan 5 14:40:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:10.585334 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750d0c3-176d-49bd-bf84-17bc1efa3950 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:10.595227 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750d0c3-176d-49bd-bf84-17bc1efa3950 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:10.596331 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-1fd586c2-e975-4fad-9712-b92785f5af04 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 05 14:40:10.598275 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 443/904] 10.222.0.30 () {56 vars in 1153 bytes} [Wed Jan 5 14:40:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:40:10.600093 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad76c63-dcc7-42c4-9c2d-e664106fb484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:10.600739 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad76c63-dcc7-42c4-9c2d-e664106fb484 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:10.601021 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad76c63-dcc7-42c4-9c2d-e664106fb484 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:10.601328 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad76c63-dcc7-42c4-9c2d-e664106fb484 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:10.602721 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad76c63-dcc7-42c4-9c2d-e664106fb484 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:10.603037 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad76c63-dcc7-42c4-9c2d-e664106fb484 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:10.604875 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad76c63-dcc7-42c4-9c2d-e664106fb484 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:10.605308 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd586c2-e975-4fad-9712-b92785f5af04 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:10.615209 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd586c2-e975-4fad-9712-b92785f5af04 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:10.620094 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a08566-b84d-468c-9e55-ba58772c8e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:10.620874 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a08566-b84d-468c-9e55-ba58772c8e6d admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:10.621277 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a08566-b84d-468c-9e55-ba58772c8e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:10.621650 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a08566-b84d-468c-9e55-ba58772c8e6d admin admin] PATH_INFO: `/v3/services` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:10.622515 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a08566-b84d-468c-9e55-ba58772c8e6d admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:10.623023 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a08566-b84d-468c-9e55-ba58772c8e6d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:10.623384 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 462/905] 10.222.0.30 () {56 vars in 1170 bytes} [Wed Jan 5 14:40:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:10.626467 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a08566-b84d-468c-9e55-ba58772c8e6d admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:10.629532 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad76c63-dcc7-42c4-9c2d-e664106fb484 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:10.632215 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 444/906] 10.222.0.30 () {56 vars in 1147 bytes} [Wed Jan 5 14:40:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:10.640893 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad76c63-dcc7-42c4-9c2d-e664106fb484 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:10.642210 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a08566-b84d-468c-9e55-ba58772c8e6d admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:10.645826 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab385368-0cd9-426b-ab5c-49d69169fb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:10.646697 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab385368-0cd9-426b-ab5c-49d69169fb25 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:10.646978 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab385368-0cd9-426b-ab5c-49d69169fb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:10.647250 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab385368-0cd9-426b-ab5c-49d69169fb25 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:10.654213 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a08566-b84d-468c-9e55-ba58772c8e6d admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:10.660467 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab385368-0cd9-426b-ab5c-49d69169fb25 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:10.661259 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5faf85e-a3e7-4d41-8d9a-bfd82a7d3265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:10.662143 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faf85e-a3e7-4d41-8d9a-bfd82a7d3265 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:10.662514 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab385368-0cd9-426b-ab5c-49d69169fb25 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:10.662826 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faf85e-a3e7-4d41-8d9a-bfd82a7d3265 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:10.663289 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faf85e-a3e7-4d41-8d9a-bfd82a7d3265 admin admin] PATH_INFO: `/v3/services` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:10.664193 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5faf85e-a3e7-4d41-8d9a-bfd82a7d3265 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:10.664881 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5faf85e-a3e7-4d41-8d9a-bfd82a7d3265 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:10.667911 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5faf85e-a3e7-4d41-8d9a-bfd82a7d3265 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:10.681158 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 445/907] 10.222.0.30 () {56 vars in 1147 bytes} [Wed Jan 5 14:40:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:40:10.682984 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5faf85e-a3e7-4d41-8d9a-bfd82a7d3265 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:10.690606 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-ab385368-0cd9-426b-ab5c-49d69169fb25 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:40:10.692928 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5faf85e-a3e7-4d41-8d9a-bfd82a7d3265 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:10.697204 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 463/908] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:40:10.699103 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab385368-0cd9-426b-ab5c-49d69169fb25 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:10.702062 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324d5f8-01ca-404b-8b30-9ca834be8c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:10.702995 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324d5f8-01ca-404b-8b30-9ca834be8c31 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:10.703472 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324d5f8-01ca-404b-8b30-9ca834be8c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:10.703958 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324d5f8-01ca-404b-8b30-9ca834be8c31 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:10.705201 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324d5f8-01ca-404b-8b30-9ca834be8c31 admin admin] RBAC: Adding query filter params (interface=public, service_id=e2738fa85e184613a554175041a09431, region_id=RegionOne) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:10.706256 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324d5f8-01ca-404b-8b30-9ca834be8c31 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:10.708348 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324d5f8-01ca-404b-8b30-9ca834be8c31 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:10.709236 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab385368-0cd9-426b-ab5c-49d69169fb25 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:10.718976 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031eed9f-a281-48e2-84e4-7c4dd434e98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:10.718976 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031eed9f-a281-48e2-84e4-7c4dd434e98d admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:10.718976 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031eed9f-a281-48e2-84e4-7c4dd434e98d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:10.718976 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031eed9f-a281-48e2-84e4-7c4dd434e98d admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:10.719326 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031eed9f-a281-48e2-84e4-7c4dd434e98d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:10.719326 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031eed9f-a281-48e2-84e4-7c4dd434e98d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:10.719672 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 446/909] 10.222.0.30 () {56 vars in 1272 bytes} [Wed Jan 5 14:40:10 2022] GET /identity/v3/endpoints?service_id=e2738fa85e184613a554175041a09431&interface=public®ion_id=RegionOne => generated 194 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:40:10.719769 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031eed9f-a281-48e2-84e4-7c4dd434e98d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:10.720798 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324d5f8-01ca-404b-8b30-9ca834be8c31 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:10.732788 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324d5f8-01ca-404b-8b30-9ca834be8c31 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:10.737155 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 464/910] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:10.738627 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031eed9f-a281-48e2-84e4-7c4dd434e98d admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:10.747114 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415989b-d762-4565-8007-6e943a89eca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:10.747794 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415989b-d762-4565-8007-6e943a89eca9 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:10.748068 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415989b-d762-4565-8007-6e943a89eca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:10.748417 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415989b-d762-4565-8007-6e943a89eca9 admin admin] PATH_INFO: `/v3/services` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:10.749169 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415989b-d762-4565-8007-6e943a89eca9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:10.750744 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031eed9f-a281-48e2-84e4-7c4dd434e98d admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:10.750863 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415989b-d762-4565-8007-6e943a89eca9 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:10.756175 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c88657-ca55-4a21-b169-c276d8c89031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:10.757277 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c88657-ca55-4a21-b169-c276d8c89031 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:10.757578 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 447/911] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jan 5 14:40:10 2022] GET /identity/v3/services => generated 1268 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:40:10.757957 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c88657-ca55-4a21-b169-c276d8c89031 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:10.759018 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c88657-ca55-4a21-b169-c276d8c89031 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:10.768308 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c88657-ca55-4a21-b169-c276d8c89031 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:10.771054 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c88657-ca55-4a21-b169-c276d8c89031 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:10.787773 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-57c88657-ca55-4a21-b169-c276d8c89031 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:40:10.789430 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 465/912] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:40:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:10.798366 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415989b-d762-4565-8007-6e943a89eca9 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:10.809639 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415989b-d762-4565-8007-6e943a89eca9 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:10.815671 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c853ff6-3418-4204-90ea-8bed096e3260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:10.816350 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c853ff6-3418-4204-90ea-8bed096e3260 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:10.816688 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c853ff6-3418-4204-90ea-8bed096e3260 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:10.816973 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c853ff6-3418-4204-90ea-8bed096e3260 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:10.817859 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c853ff6-3418-4204-90ea-8bed096e3260 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:10.818178 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c853ff6-3418-4204-90ea-8bed096e3260 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:10.820216 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c853ff6-3418-4204-90ea-8bed096e3260 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:10.840869 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 448/913] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:40:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:10.842294 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c88657-ca55-4a21-b169-c276d8c89031 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:10.855113 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c88657-ca55-4a21-b169-c276d8c89031 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:10.860132 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51f2d1-7d89-494a-8adc-3c77d18d6153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:10.861316 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51f2d1-7d89-494a-8adc-3c77d18d6153 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:10.861704 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51f2d1-7d89-494a-8adc-3c77d18d6153 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:10.862050 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51f2d1-7d89-494a-8adc-3c77d18d6153 admin admin] PATH_INFO: `/v3/projects/fbf90e947f3a4fcdb6f42646a4bf34a1/users/29314b0be6534c79b36f31402d51d17b/roles/401d03aa1ee442828aa97481f13b473c` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:10.864758 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51f2d1-7d89-494a-8adc-3c77d18d6153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf90e947f3a4fcdb6f42646a4bf34a1, user_id=29314b0be6534c79b36f31402d51d17b, role_id=401d03aa1ee442828aa97481f13b473c)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:10.867474 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51f2d1-7d89-494a-8adc-3c77d18d6153 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:10.944483 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 466/914] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Jan 5 14:40:10 2022] PUT /identity/v3/projects/fbf90e947f3a4fcdb6f42646a4bf34a1/users/29314b0be6534c79b36f31402d51d17b/roles/401d03aa1ee442828aa97481f13b473c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:40:11.633581 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4edc4-7e57-4f49-9374-a01d07ac6561 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:11.634115 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4edc4-7e57-4f49-9374-a01d07ac6561 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:11.634115 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4edc4-7e57-4f49-9374-a01d07ac6561 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:11.636308 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 449/915] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:11.641437 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276f7d0-389a-4255-92be-9cb39a945df3 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:11.641831 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276f7d0-389a-4255-92be-9cb39a945df3 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:11.642017 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276f7d0-389a-4255-92be-9cb39a945df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:11.662335 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-4276f7d0-389a-4255-92be-9cb39a945df3 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:11.663855 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-4276f7d0-389a-4255-92be-9cb39a945df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:11.724030 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 467/916] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:11 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:11.747593 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4edc4-7e57-4f49-9374-a01d07ac6561 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:11.760671 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4edc4-7e57-4f49-9374-a01d07ac6561 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:11.766945 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e52c2d-81ed-4443-9da8-02ecb7d08272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:11.767662 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e52c2d-81ed-4443-9da8-02ecb7d08272 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:11.767941 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e52c2d-81ed-4443-9da8-02ecb7d08272 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:11.768212 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e52c2d-81ed-4443-9da8-02ecb7d08272 admin admin] PATH_INFO: `/v3/services` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:11.768952 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e52c2d-81ed-4443-9da8-02ecb7d08272 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:11.770575 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e52c2d-81ed-4443-9da8-02ecb7d08272 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:11.860982 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 450/917] 10.222.0.30 () {60 vars in 1162 bytes} [Wed Jan 5 14:40:11 2022] POST /identity/v3/services => generated 241 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:40:11.902466 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704cee7-f4c8-4456-a4e7-57c2e96b26e5 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:11.902789 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704cee7-f4c8-4456-a4e7-57c2e96b26e5 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:11.903041 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704cee7-f4c8-4456-a4e7-57c2e96b26e5 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:11.905281 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 468/918] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:11.911161 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccb653-c72d-4d37-bcbe-424a307153c7 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:11.911454 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccb653-c72d-4d37-bcbe-424a307153c7 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:11.911739 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccb653-c72d-4d37-bcbe-424a307153c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:11.931055 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-46ccb653-c72d-4d37-bcbe-424a307153c7 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:11.932287 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-46ccb653-c72d-4d37-bcbe-424a307153c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:11.950619 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 451/919] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:11 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:40:11.976663 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704cee7-f4c8-4456-a4e7-57c2e96b26e5 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:11.989715 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704cee7-f4c8-4456-a4e7-57c2e96b26e5 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:11.994513 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf38d98-6760-45d5-826c-6194f39e9595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:11.995339 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf38d98-6760-45d5-826c-6194f39e9595 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:11.995619 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf38d98-6760-45d5-826c-6194f39e9595 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:11.995898 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf38d98-6760-45d5-826c-6194f39e9595 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:11.996582 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf38d98-6760-45d5-826c-6194f39e9595 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:11.998296 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf38d98-6760-45d5-826c-6194f39e9595 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:12.011716 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-3cf38d98-6760-45d5-826c-6194f39e9595 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 05 14:40:12.013260 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 469/920] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Jan 5 14:40:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:12.019705 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ccb653-c72d-4d37-bcbe-424a307153c7 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:12.029365 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ccb653-c72d-4d37-bcbe-424a307153c7 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:12.034143 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1443e7-f384-4c08-bc14-0068cc0d15b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:12.034827 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1443e7-f384-4c08-bc14-0068cc0d15b9 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:12.035115 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1443e7-f384-4c08-bc14-0068cc0d15b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:12.035400 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1443e7-f384-4c08-bc14-0068cc0d15b9 admin admin] PATH_INFO: `/v3/services` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:12.036139 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1443e7-f384-4c08-bc14-0068cc0d15b9 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:12.036445 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1443e7-f384-4c08-bc14-0068cc0d15b9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:12.038134 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1443e7-f384-4c08-bc14-0068cc0d15b9 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:12.044672 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 452/921] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Jan 5 14:40:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:12.050508 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf38d98-6760-45d5-826c-6194f39e9595 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:12.060959 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf38d98-6760-45d5-826c-6194f39e9595 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:12.065989 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86ce2a-94c1-400e-99d2-56a7258b2ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:12.066724 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86ce2a-94c1-400e-99d2-56a7258b2ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:12.067008 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86ce2a-94c1-400e-99d2-56a7258b2ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:12.067290 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86ce2a-94c1-400e-99d2-56a7258b2ba8 admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:12.068082 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86ce2a-94c1-400e-99d2-56a7258b2ba8 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:12.068393 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86ce2a-94c1-400e-99d2-56a7258b2ba8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:12.070097 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86ce2a-94c1-400e-99d2-56a7258b2ba8 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:12.076201 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 470/922] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Jan 5 14:40:12 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:12.082156 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1443e7-f384-4c08-bc14-0068cc0d15b9 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:12.093156 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1443e7-f384-4c08-bc14-0068cc0d15b9 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:12.098675 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f089ea1-142c-403f-81ad-7007220c02cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:12.099385 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f089ea1-142c-403f-81ad-7007220c02cb admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:12.099673 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f089ea1-142c-403f-81ad-7007220c02cb admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:12.099951 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f089ea1-142c-403f-81ad-7007220c02cb admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:12.100819 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f089ea1-142c-403f-81ad-7007220c02cb admin admin] RBAC: Adding query filter params (interface=public, service_id=f3d69a362e7843a8b6c7481c539f7b28, region_id=RegionOne) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:12.101173 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f089ea1-142c-403f-81ad-7007220c02cb admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:12.103033 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f089ea1-142c-403f-81ad-7007220c02cb admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:12.109091 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 453/923] 10.222.0.30 () {56 vars in 1272 bytes} [Wed Jan 5 14:40:12 2022] GET /identity/v3/endpoints?service_id=f3d69a362e7843a8b6c7481c539f7b28&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:12.114491 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86ce2a-94c1-400e-99d2-56a7258b2ba8 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:12.125154 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86ce2a-94c1-400e-99d2-56a7258b2ba8 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:12.130868 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3330ecd-8242-47e9-bb39-160c1e3c830a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:12.131531 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3330ecd-8242-47e9-bb39-160c1e3c830a admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:12.131817 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3330ecd-8242-47e9-bb39-160c1e3c830a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:12.132143 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3330ecd-8242-47e9-bb39-160c1e3c830a admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:12.132835 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3330ecd-8242-47e9-bb39-160c1e3c830a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:12.135257 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3330ecd-8242-47e9-bb39-160c1e3c830a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:12.142373 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 471/924] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jan 5 14:40:12 2022] GET /identity/v3/services => generated 1497 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:40:13.265347 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4425b-76ff-4aba-970a-2af5e98de015 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:13.266070 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4425b-76ff-4aba-970a-2af5e98de015 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:13.266070 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4425b-76ff-4aba-970a-2af5e98de015 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:13.267763 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 454/925] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:13.273901 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85425b8-5889-43d6-a916-0b84c4ed66ef None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:13.273901 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85425b8-5889-43d6-a916-0b84c4ed66ef None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:13.273901 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85425b8-5889-43d6-a916-0b84c4ed66ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:13.294304 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-f85425b8-5889-43d6-a916-0b84c4ed66ef None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:13.295890 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-f85425b8-5889-43d6-a916-0b84c4ed66ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:13.304256 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 472/926] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:13 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:40:13.329537 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4425b-76ff-4aba-970a-2af5e98de015 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:13.342201 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4425b-76ff-4aba-970a-2af5e98de015 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:13.346906 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d59220-6062-456c-aafa-f17c86abee6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:13.347926 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d59220-6062-456c-aafa-f17c86abee6f admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:13.348409 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d59220-6062-456c-aafa-f17c86abee6f admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:13.348880 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d59220-6062-456c-aafa-f17c86abee6f admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:13.349760 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d59220-6062-456c-aafa-f17c86abee6f admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:13.351551 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d59220-6062-456c-aafa-f17c86abee6f admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:13.364009 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-16d59220-6062-456c-aafa-f17c86abee6f admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 05 14:40:13.365770 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 455/927] 10.222.0.30 () {56 vars in 1153 bytes} [Wed Jan 5 14:40:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:13.371857 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85425b8-5889-43d6-a916-0b84c4ed66ef None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:13.381402 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85425b8-5889-43d6-a916-0b84c4ed66ef None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:13.386807 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217c7c4-8e13-4718-af61-1c59fd4c860e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:13.387698 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217c7c4-8e13-4718-af61-1c59fd4c860e admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:13.388188 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217c7c4-8e13-4718-af61-1c59fd4c860e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:13.388658 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217c7c4-8e13-4718-af61-1c59fd4c860e admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:13.389623 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217c7c4-8e13-4718-af61-1c59fd4c860e admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:13.390156 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217c7c4-8e13-4718-af61-1c59fd4c860e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:13.391941 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217c7c4-8e13-4718-af61-1c59fd4c860e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:13.397206 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 473/928] 10.222.0.30 () {56 vars in 1147 bytes} [Wed Jan 5 14:40:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:13.403010 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d59220-6062-456c-aafa-f17c86abee6f admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:13.412773 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d59220-6062-456c-aafa-f17c86abee6f admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:13.418073 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ab98c-d4ee-4bc6-9972-2e293b080956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:13.418936 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ab98c-d4ee-4bc6-9972-2e293b080956 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:13.419441 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ab98c-d4ee-4bc6-9972-2e293b080956 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:13.419931 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ab98c-d4ee-4bc6-9972-2e293b080956 admin admin] PATH_INFO: `/v3/services` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:13.420838 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ab98c-d4ee-4bc6-9972-2e293b080956 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:13.421384 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ab98c-d4ee-4bc6-9972-2e293b080956 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:13.423165 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ab98c-d4ee-4bc6-9972-2e293b080956 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:13.428646 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 456/929] 10.222.0.30 () {56 vars in 1147 bytes} [Wed Jan 5 14:40:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:40:13.434358 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217c7c4-8e13-4718-af61-1c59fd4c860e admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:13.444175 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217c7c4-8e13-4718-af61-1c59fd4c860e admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:13.449603 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d93dc-462b-45f0-8845-8dd37ab502fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:13.450507 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d93dc-462b-45f0-8845-8dd37ab502fd admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:13.451010 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d93dc-462b-45f0-8845-8dd37ab502fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:13.451486 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d93dc-462b-45f0-8845-8dd37ab502fd admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:13.452444 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d93dc-462b-45f0-8845-8dd37ab502fd admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:13.454288 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d93dc-462b-45f0-8845-8dd37ab502fd admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:13.522364 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c69dd-ac8c-4908-aaac-9f3926992d6d None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:13.522646 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c69dd-ac8c-4908-aaac-9f3926992d6d None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:13.522917 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c69dd-ac8c-4908-aaac-9f3926992d6d None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:13.524786 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 457/930] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 14:40:13.529909 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cccaa-bfc1-4918-a853-6bf426d5e4a6 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:13.530231 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cccaa-bfc1-4918-a853-6bf426d5e4a6 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:13.530589 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cccaa-bfc1-4918-a853-6bf426d5e4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:13.549195 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-6f1cccaa-bfc1-4918-a853-6bf426d5e4a6 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:13.550360 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-6f1cccaa-bfc1-4918-a853-6bf426d5e4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:13.558836 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 458/931] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:13 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:40:13.574599 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 474/932] 10.222.0.30 () {60 vars in 1165 bytes} [Wed Jan 5 14:40:13 2022] POST /identity/v3/endpoints => generated 347 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 14:40:13.584170 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1cccaa-bfc1-4918-a853-6bf426d5e4a6 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:13.594456 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1cccaa-bfc1-4918-a853-6bf426d5e4a6 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:13.610825 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1102cd-e5a3-4f1e-8712-d755f2f6af23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:13.612074 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1102cd-e5a3-4f1e-8712-d755f2f6af23 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:13.612575 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1102cd-e5a3-4f1e-8712-d755f2f6af23 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:13.613054 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1102cd-e5a3-4f1e-8712-d755f2f6af23 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:13.625861 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1102cd-e5a3-4f1e-8712-d755f2f6af23 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:40:13.635035 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-0c1102cd-e5a3-4f1e-8712-d755f2f6af23 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 05 14:40:13.637147 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 459/933] 10.222.0.30 () {56 vars in 1141 bytes} [Wed Jan 5 14:40:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:13.643084 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d93dc-462b-45f0-8845-8dd37ab502fd admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:13.655626 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d93dc-462b-45f0-8845-8dd37ab502fd admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:13.660632 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125281cb-01fd-479a-835d-f6d01f92df1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:13.661700 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125281cb-01fd-479a-835d-f6d01f92df1a admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:13.662246 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125281cb-01fd-479a-835d-f6d01f92df1a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:13.662716 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125281cb-01fd-479a-835d-f6d01f92df1a admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:13.663737 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125281cb-01fd-479a-835d-f6d01f92df1a admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:13.664241 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125281cb-01fd-479a-835d-f6d01f92df1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:13.666219 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125281cb-01fd-479a-835d-f6d01f92df1a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:13.676102 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 475/934] 10.222.0.30 () {56 vars in 1136 bytes} [Wed Jan 5 14:40:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:13.682829 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1102cd-e5a3-4f1e-8712-d755f2f6af23 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:13.694241 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1102cd-e5a3-4f1e-8712-d755f2f6af23 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:13.699593 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faded8b4-b845-4db1-83f3-5ac2b551f946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:13.700716 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faded8b4-b845-4db1-83f3-5ac2b551f946 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:13.701292 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faded8b4-b845-4db1-83f3-5ac2b551f946 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:13.701763 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faded8b4-b845-4db1-83f3-5ac2b551f946 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:13.715003 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faded8b4-b845-4db1-83f3-5ac2b551f946 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:13.717440 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faded8b4-b845-4db1-83f3-5ac2b551f946 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:13.738140 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-faded8b4-b845-4db1-83f3-5ac2b551f946 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:40:13.739787 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 460/935] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:13.748001 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125281cb-01fd-479a-835d-f6d01f92df1a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:13.762578 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125281cb-01fd-479a-835d-f6d01f92df1a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:13.768834 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb3ecd-d97a-4794-8099-62a2ab4088d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:13.770068 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb3ecd-d97a-4794-8099-62a2ab4088d8 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:13.770551 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb3ecd-d97a-4794-8099-62a2ab4088d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:13.771052 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb3ecd-d97a-4794-8099-62a2ab4088d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:13.772116 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb3ecd-d97a-4794-8099-62a2ab4088d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:13.772715 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb3ecd-d97a-4794-8099-62a2ab4088d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:13.775255 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb3ecd-d97a-4794-8099-62a2ab4088d8 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:13.791846 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 476/936] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:13.797966 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faded8b4-b845-4db1-83f3-5ac2b551f946 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:13.808965 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faded8b4-b845-4db1-83f3-5ac2b551f946 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:13.814387 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912e8c7-609a-468c-b3e2-ac04d6059879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:13.815558 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912e8c7-609a-468c-b3e2-ac04d6059879 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:13.816078 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912e8c7-609a-468c-b3e2-ac04d6059879 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:13.816583 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912e8c7-609a-468c-b3e2-ac04d6059879 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:13.825010 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7912e8c7-609a-468c-b3e2-ac04d6059879 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:13.827382 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7912e8c7-609a-468c-b3e2-ac04d6059879 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:13.844783 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-7912e8c7-609a-468c-b3e2-ac04d6059879 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 05 14:40:13.846298 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 461/937] 10.222.0.30 () {56 vars in 1138 bytes} [Wed Jan 5 14:40:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:13.852634 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb3ecd-d97a-4794-8099-62a2ab4088d8 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:13.862452 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb3ecd-d97a-4794-8099-62a2ab4088d8 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:13.866974 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2b3ba-bc53-415a-b009-198ed01f4a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:13.867663 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2b3ba-bc53-415a-b009-198ed01f4a77 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:13.867944 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2b3ba-bc53-415a-b009-198ed01f4a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:13.868214 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2b3ba-bc53-415a-b009-198ed01f4a77 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:13.869116 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2b3ba-bc53-415a-b009-198ed01f4a77 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:13.869432 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2b3ba-bc53-415a-b009-198ed01f4a77 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:13.871335 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2b3ba-bc53-415a-b009-198ed01f4a77 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:13.889348 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 477/938] 10.222.0.30 () {56 vars in 1170 bytes} [Wed Jan 5 14:40:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:40:13.894921 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912e8c7-609a-468c-b3e2-ac04d6059879 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:13.905652 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912e8c7-609a-468c-b3e2-ac04d6059879 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:13.910526 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba3777-7a77-418f-88b8-1ff910c227fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:13.911442 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba3777-7a77-418f-88b8-1ff910c227fb admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:13.911947 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba3777-7a77-418f-88b8-1ff910c227fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:13.912472 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba3777-7a77-418f-88b8-1ff910c227fb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:13.921235 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba3777-7a77-418f-88b8-1ff910c227fb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:13.923321 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba3777-7a77-418f-88b8-1ff910c227fb admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:13.933321 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 462/939] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:40:13 2022] GET /identity/v3/auth/tokens => generated 1952 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:40:13.939286 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2b3ba-bc53-415a-b009-198ed01f4a77 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:13.950417 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2b3ba-bc53-415a-b009-198ed01f4a77 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:13.955664 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff488e4-bb10-4ef7-a70d-0fdb780fab55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:13.956743 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff488e4-bb10-4ef7-a70d-0fdb780fab55 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:13.957305 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff488e4-bb10-4ef7-a70d-0fdb780fab55 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:13.957789 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff488e4-bb10-4ef7-a70d-0fdb780fab55 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:13.968854 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff488e4-bb10-4ef7-a70d-0fdb780fab55 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:13.971107 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff488e4-bb10-4ef7-a70d-0fdb780fab55 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:13.989681 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-4ff488e4-bb10-4ef7-a70d-0fdb780fab55 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:40:13.991684 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 478/940] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:13.998125 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba3777-7a77-418f-88b8-1ff910c227fb admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:14.009598 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba3777-7a77-418f-88b8-1ff910c227fb admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:14.014652 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e3365-a2a3-41e2-ace6-19a710673c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:14.015322 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e3365-a2a3-41e2-ace6-19a710673c4e admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:14.015608 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e3365-a2a3-41e2-ace6-19a710673c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:14.015910 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e3365-a2a3-41e2-ace6-19a710673c4e admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:14.016626 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e3365-a2a3-41e2-ace6-19a710673c4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:14.016941 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e3365-a2a3-41e2-ace6-19a710673c4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:14.018749 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e3365-a2a3-41e2-ace6-19a710673c4e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:14.032581 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 463/941] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:14.038139 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff488e4-bb10-4ef7-a70d-0fdb780fab55 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:14.048750 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff488e4-bb10-4ef7-a70d-0fdb780fab55 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:14.053597 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493991d-21aa-483a-a73d-1ab676bff8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:14.054686 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493991d-21aa-483a-a73d-1ab676bff8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:14.055310 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493991d-21aa-483a-a73d-1ab676bff8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:14.055782 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493991d-21aa-483a-a73d-1ab676bff8e3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:14.063074 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493991d-21aa-483a-a73d-1ab676bff8e3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:14.065330 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493991d-21aa-483a-a73d-1ab676bff8e3 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:14.079388 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-3493991d-21aa-483a-a73d-1ab676bff8e3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:40:14.081147 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 479/942] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:40:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:40:14.090306 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e3365-a2a3-41e2-ace6-19a710673c4e admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:14.098468 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e3365-a2a3-41e2-ace6-19a710673c4e admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:14.103872 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52341d-4071-4a0c-8fe3-23d2f9da6e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:14.104522 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52341d-4071-4a0c-8fe3-23d2f9da6e93 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:14.104860 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52341d-4071-4a0c-8fe3-23d2f9da6e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:14.105177 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52341d-4071-4a0c-8fe3-23d2f9da6e93 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:14.106029 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52341d-4071-4a0c-8fe3-23d2f9da6e93 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:14.106346 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52341d-4071-4a0c-8fe3-23d2f9da6e93 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:14.108271 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52341d-4071-4a0c-8fe3-23d2f9da6e93 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:14.126824 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 464/943] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:40:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:14.133002 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493991d-21aa-483a-a73d-1ab676bff8e3 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:14.162817 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493991d-21aa-483a-a73d-1ab676bff8e3 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:14.175918 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc1875-5610-4a2c-a2c6-c6421cb33ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:14.176737 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc1875-5610-4a2c-a2c6-c6421cb33ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:14.177023 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc1875-5610-4a2c-a2c6-c6421cb33ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:14.177327 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc1875-5610-4a2c-a2c6-c6421cb33ba4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:14.178326 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc1875-5610-4a2c-a2c6-c6421cb33ba4 admin admin] RBAC: Adding query filter params (role.id=401d03aa1ee442828aa97481f13b473c, scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1, user.id=29314b0be6534c79b36f31402d51d17b) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:14.178645 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc1875-5610-4a2c-a2c6-c6421cb33ba4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:14.180809 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc1875-5610-4a2c-a2c6-c6421cb33ba4 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:14.187860 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 480/944] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:40:14 2022] GET /identity/v3/role_assignments?user.id=29314b0be6534c79b36f31402d51d17b&scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1&role.id=401d03aa1ee442828aa97481f13b473c => generated 608 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:14.496091 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79458abd-f173-4515-a1f5-04e4ac052689 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:14.496622 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79458abd-f173-4515-a1f5-04e4ac052689 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:14.496622 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79458abd-f173-4515-a1f5-04e4ac052689 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:14.498717 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 465/945] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:14.504237 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409ab0e-fd81-4479-820f-2205140a7e73 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:14.504646 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409ab0e-fd81-4479-820f-2205140a7e73 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:14.504786 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409ab0e-fd81-4479-820f-2205140a7e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:14.522572 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-a409ab0e-fd81-4479-820f-2205140a7e73 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:14.524467 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-a409ab0e-fd81-4479-820f-2205140a7e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:14.536994 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 481/946] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:14 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:14.558074 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79458abd-f173-4515-a1f5-04e4ac052689 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:14.571074 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79458abd-f173-4515-a1f5-04e4ac052689 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:14.575851 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1bf3f-46f6-433c-9ef1-397c4de4d7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:14.576752 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1bf3f-46f6-433c-9ef1-397c4de4d7ac admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:14.577040 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1bf3f-46f6-433c-9ef1-397c4de4d7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:14.577360 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1bf3f-46f6-433c-9ef1-397c4de4d7ac admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:14.578072 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1bf3f-46f6-433c-9ef1-397c4de4d7ac admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:14.579732 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1bf3f-46f6-433c-9ef1-397c4de4d7ac admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:14.592296 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-90d1bf3f-46f6-433c-9ef1-397c4de4d7ac admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 05 14:40:14.598634 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 466/947] 10.222.0.30 () {56 vars in 1147 bytes} [Wed Jan 5 14:40:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:14.599964 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409ab0e-fd81-4479-820f-2205140a7e73 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:14.609169 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409ab0e-fd81-4479-820f-2205140a7e73 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:14.613876 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6a079-c3e0-4a7f-80bd-29c67c1cd520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:14.614596 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6a079-c3e0-4a7f-80bd-29c67c1cd520 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:14.614879 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6a079-c3e0-4a7f-80bd-29c67c1cd520 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:14.615151 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6a079-c3e0-4a7f-80bd-29c67c1cd520 admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:14.615927 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c6a079-c3e0-4a7f-80bd-29c67c1cd520 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:14.616229 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c6a079-c3e0-4a7f-80bd-29c67c1cd520 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:14.618489 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c6a079-c3e0-4a7f-80bd-29c67c1cd520 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:14.625244 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaad937-545e-434f-81d4-c29d810ca214 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:14.625574 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaad937-545e-434f-81d4-c29d810ca214 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:14.625862 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaad937-545e-434f-81d4-c29d810ca214 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:14.628063 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 467/948] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 14:40:14.628234 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 482/949] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Jan 5 14:40:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:14.632950 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058c0d8-814d-467d-87f1-fecd46960197 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:14.633835 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058c0d8-814d-467d-87f1-fecd46960197 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:14.634127 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058c0d8-814d-467d-87f1-fecd46960197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:14.636747 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6a079-c3e0-4a7f-80bd-29c67c1cd520 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:14.648168 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6a079-c3e0-4a7f-80bd-29c67c1cd520 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:14.652958 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96610fb-2c97-4aaa-8260-a14a0d66fe11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:14.653748 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96610fb-2c97-4aaa-8260-a14a0d66fe11 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:14.654028 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96610fb-2c97-4aaa-8260-a14a0d66fe11 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:14.654213 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-c058c0d8-814d-467d-87f1-fecd46960197 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:14.654367 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96610fb-2c97-4aaa-8260-a14a0d66fe11 admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:14.655005 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96610fb-2c97-4aaa-8260-a14a0d66fe11 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:14.655304 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96610fb-2c97-4aaa-8260-a14a0d66fe11 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:14.655468 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-c058c0d8-814d-467d-87f1-fecd46960197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:14.657010 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96610fb-2c97-4aaa-8260-a14a0d66fe11 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:14.662545 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 483/950] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Jan 5 14:40:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:14.664065 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 468/951] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:14 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:14.670261 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96610fb-2c97-4aaa-8260-a14a0d66fe11 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:14.680325 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96610fb-2c97-4aaa-8260-a14a0d66fe11 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:14.684987 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407fdbf-3336-4f84-914b-5a4aabc22c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:14.685753 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407fdbf-3336-4f84-914b-5a4aabc22c50 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:14.686031 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407fdbf-3336-4f84-914b-5a4aabc22c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:14.686306 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407fdbf-3336-4f84-914b-5a4aabc22c50 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:14.687199 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407fdbf-3336-4f84-914b-5a4aabc22c50 admin admin] RBAC: Adding query filter params (interface=public, service_id=eab09472de704c09aa07b91c21a8d048, region_id=RegionOne) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:14.687509 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407fdbf-3336-4f84-914b-5a4aabc22c50 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:14.689182 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407fdbf-3336-4f84-914b-5a4aabc22c50 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:14.692276 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058c0d8-814d-467d-87f1-fecd46960197 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:14.695049 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 484/952] 10.222.0.30 () {56 vars in 1272 bytes} [Wed Jan 5 14:40:14 2022] GET /identity/v3/endpoints?service_id=eab09472de704c09aa07b91c21a8d048&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:14.700990 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407fdbf-3336-4f84-914b-5a4aabc22c50 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:14.702764 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058c0d8-814d-467d-87f1-fecd46960197 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:14.707499 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8dfef-1c34-4a59-b5ad-7464e32d889d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:14.708406 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8dfef-1c34-4a59-b5ad-7464e32d889d admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:14.708792 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8dfef-1c34-4a59-b5ad-7464e32d889d admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:14.709204 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8dfef-1c34-4a59-b5ad-7464e32d889d admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:14.709977 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8dfef-1c34-4a59-b5ad-7464e32d889d admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:14.711502 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407fdbf-3336-4f84-914b-5a4aabc22c50 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:14.711858 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8dfef-1c34-4a59-b5ad-7464e32d889d admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:14.716450 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ba405-23fe-43e8-ba28-678b2157fe37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:14.717181 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ba405-23fe-43e8-ba28-678b2157fe37 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:14.717510 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ba405-23fe-43e8-ba28-678b2157fe37 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:14.717784 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ba405-23fe-43e8-ba28-678b2157fe37 admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:14.718466 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ba405-23fe-43e8-ba28-678b2157fe37 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:14.720128 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ba405-23fe-43e8-ba28-678b2157fe37 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:14.724638 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-b4d8dfef-1c34-4a59-b5ad-7464e32d889d admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 05 14:40:14.726542 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 485/954] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jan 5 14:40:14 2022] GET /identity/v3/services => generated 1497 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:40:14.733294 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 469/954] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Jan 5 14:40:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:40:14.737814 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ba405-23fe-43e8-ba28-678b2157fe37 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:14.751143 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ba405-23fe-43e8-ba28-678b2157fe37 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:14.756125 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a33aa6-ba14-4702-8538-c06523c98cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:14.756805 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a33aa6-ba14-4702-8538-c06523c98cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:14.757105 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a33aa6-ba14-4702-8538-c06523c98cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:14.757385 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a33aa6-ba14-4702-8538-c06523c98cd7 admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:14.758139 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a33aa6-ba14-4702-8538-c06523c98cd7 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:14.759013 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a33aa6-ba14-4702-8538-c06523c98cd7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:14.760719 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a33aa6-ba14-4702-8538-c06523c98cd7 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:14.766910 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 486/955] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Jan 5 14:40:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:14.772942 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8dfef-1c34-4a59-b5ad-7464e32d889d admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:14.784335 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8dfef-1c34-4a59-b5ad-7464e32d889d admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:14.789589 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58282be9-661e-4d79-a808-3871f449e44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:14.790537 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58282be9-661e-4d79-a808-3871f449e44b admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:14.791005 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58282be9-661e-4d79-a808-3871f449e44b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:14.791462 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58282be9-661e-4d79-a808-3871f449e44b admin admin] PATH_INFO: `/v3/services` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:14.792367 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58282be9-661e-4d79-a808-3871f449e44b admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:14.792881 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58282be9-661e-4d79-a808-3871f449e44b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:14.794706 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58282be9-661e-4d79-a808-3871f449e44b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:14.805201 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 470/956] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Jan 5 14:40:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:14.807297 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a33aa6-ba14-4702-8538-c06523c98cd7 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:14.817948 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a33aa6-ba14-4702-8538-c06523c98cd7 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:14.823715 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0b485-2220-4758-afd7-7d372a0dc461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:14.824830 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0b485-2220-4758-afd7-7d372a0dc461 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:14.825345 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0b485-2220-4758-afd7-7d372a0dc461 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:14.825961 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0b485-2220-4758-afd7-7d372a0dc461 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:14.826952 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0b485-2220-4758-afd7-7d372a0dc461 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:14.828873 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0b485-2220-4758-afd7-7d372a0dc461 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:14.929381 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 487/957] 10.222.0.30 () {60 vars in 1165 bytes} [Wed Jan 5 14:40:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:40:16.035819 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a4f01-0b8f-4b70-8eaa-a12629b02baa None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:16.036832 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a4f01-0b8f-4b70-8eaa-a12629b02baa None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:16.037440 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a4f01-0b8f-4b70-8eaa-a12629b02baa None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:16.039802 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 471/958] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:16.046278 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfc4c4-f6b9-4110-a69a-5d5d530f88e9 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:16.046723 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfc4c4-f6b9-4110-a69a-5d5d530f88e9 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:16.046907 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfc4c4-f6b9-4110-a69a-5d5d530f88e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:16.064933 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-c9bfc4c4-f6b9-4110-a69a-5d5d530f88e9 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:16.066129 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-c9bfc4c4-f6b9-4110-a69a-5d5d530f88e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:16.082762 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 488/959] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:16 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:40:16.106020 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a4f01-0b8f-4b70-8eaa-a12629b02baa None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:16.118183 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a4f01-0b8f-4b70-8eaa-a12629b02baa None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:16.122565 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d3726-ac82-4536-9c4b-7b87632bc8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:16.123357 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d3726-ac82-4536-9c4b-7b87632bc8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:16.123634 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d3726-ac82-4536-9c4b-7b87632bc8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:16.123903 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d3726-ac82-4536-9c4b-7b87632bc8a8 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:16.124564 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d3726-ac82-4536-9c4b-7b87632bc8a8 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:16.126290 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d3726-ac82-4536-9c4b-7b87632bc8a8 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:16.138583 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-706d3726-ac82-4536-9c4b-7b87632bc8a8 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 05 14:40:16.140142 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 472/960] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:40:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:16.146131 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bfc4c4-f6b9-4110-a69a-5d5d530f88e9 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:16.155567 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bfc4c4-f6b9-4110-a69a-5d5d530f88e9 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:16.160129 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06839390-d7c6-457e-87dc-5d5bf99ea026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:16.160779 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06839390-d7c6-457e-87dc-5d5bf99ea026 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:16.161058 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06839390-d7c6-457e-87dc-5d5bf99ea026 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:16.161355 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06839390-d7c6-457e-87dc-5d5bf99ea026 admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:16.162064 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06839390-d7c6-457e-87dc-5d5bf99ea026 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:16.162365 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06839390-d7c6-457e-87dc-5d5bf99ea026 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:16.163966 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06839390-d7c6-457e-87dc-5d5bf99ea026 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:16.169224 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 489/961] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Jan 5 14:40:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:16.178629 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d3726-ac82-4536-9c4b-7b87632bc8a8 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:16.188950 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d3726-ac82-4536-9c4b-7b87632bc8a8 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:16.193799 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d0636-20b6-49b9-ae03-dde5f36d4c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:16.194504 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d0636-20b6-49b9-ae03-dde5f36d4c2e admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:16.194849 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d0636-20b6-49b9-ae03-dde5f36d4c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:16.195187 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d0636-20b6-49b9-ae03-dde5f36d4c2e admin admin] PATH_INFO: `/v3/services` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:16.196599 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d0636-20b6-49b9-ae03-dde5f36d4c2e admin admin] RBAC: Adding query filter params (type=compute) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:16.196972 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d0636-20b6-49b9-ae03-dde5f36d4c2e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:16.198652 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d0636-20b6-49b9-ae03-dde5f36d4c2e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:16.203698 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 473/962] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Jan 5 14:40:16 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:16.681529 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217a3d5-600f-4348-a81e-bc70afd3bd5a None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:16.681815 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217a3d5-600f-4348-a81e-bc70afd3bd5a None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:16.682101 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217a3d5-600f-4348-a81e-bc70afd3bd5a None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:16.684154 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 490/963] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:16.690730 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146d39b-b58b-405d-ae97-d32b46930031 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:16.691024 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146d39b-b58b-405d-ae97-d32b46930031 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:16.691303 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146d39b-b58b-405d-ae97-d32b46930031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:16.708467 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-9146d39b-b58b-405d-ae97-d32b46930031 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:16.709692 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-9146d39b-b58b-405d-ae97-d32b46930031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:16.718253 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 474/964] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:16 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:16.740781 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b217a3d5-600f-4348-a81e-bc70afd3bd5a None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:16.754491 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b217a3d5-600f-4348-a81e-bc70afd3bd5a None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:16.759748 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea618207-d64f-40b0-8b32-8b21f37ebf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:16.760631 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea618207-d64f-40b0-8b32-8b21f37ebf98 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:16.760855 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea618207-d64f-40b0-8b32-8b21f37ebf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:16.761162 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea618207-d64f-40b0-8b32-8b21f37ebf98 admin admin] PATH_INFO: `/v3/services/image` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:16.761846 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea618207-d64f-40b0-8b32-8b21f37ebf98 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:16.763500 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea618207-d64f-40b0-8b32-8b21f37ebf98 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:16.775747 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-ea618207-d64f-40b0-8b32-8b21f37ebf98 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 05 14:40:16.777298 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 491/965] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Jan 5 14:40:16 2022] GET /identity/v3/services/image => generated 86 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:16.783205 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146d39b-b58b-405d-ae97-d32b46930031 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:16.792671 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146d39b-b58b-405d-ae97-d32b46930031 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:16.797555 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269b095-2e32-4ff6-8a42-23ece04fbba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:16.798410 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269b095-2e32-4ff6-8a42-23ece04fbba5 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:16.798869 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269b095-2e32-4ff6-8a42-23ece04fbba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:16.799321 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269b095-2e32-4ff6-8a42-23ece04fbba5 admin admin] PATH_INFO: `/v3/services` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:16.800242 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269b095-2e32-4ff6-8a42-23ece04fbba5 admin admin] RBAC: Adding query filter params (name=image) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:16.800726 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269b095-2e32-4ff6-8a42-23ece04fbba5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:16.802522 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269b095-2e32-4ff6-8a42-23ece04fbba5 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:16.808503 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 475/966] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:16.813754 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea618207-d64f-40b0-8b32-8b21f37ebf98 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:16.823442 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea618207-d64f-40b0-8b32-8b21f37ebf98 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:16.828022 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c72676-8869-4bb8-b90c-704d8665751e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:16.828673 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c72676-8869-4bb8-b90c-704d8665751e admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:16.828954 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c72676-8869-4bb8-b90c-704d8665751e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:16.829267 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c72676-8869-4bb8-b90c-704d8665751e admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:16.829992 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c72676-8869-4bb8-b90c-704d8665751e admin admin] RBAC: Adding query filter params (type=image) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:16.830293 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c72676-8869-4bb8-b90c-704d8665751e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:16.831901 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c72676-8869-4bb8-b90c-704d8665751e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:16.837331 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 492/967] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:16 2022] GET /identity/v3/services?type=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:17.206296 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315c463-fa4b-495b-832a-62711979646e None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:17.206865 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315c463-fa4b-495b-832a-62711979646e None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:17.206865 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315c463-fa4b-495b-832a-62711979646e None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:17.208828 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 476/968] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:17.215640 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8c18f-05f4-4e90-a397-6671cbb7c63c None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:17.216147 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8c18f-05f4-4e90-a397-6671cbb7c63c None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:17.216652 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8c18f-05f4-4e90-a397-6671cbb7c63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:17.239244 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-4cc8c18f-05f4-4e90-a397-6671cbb7c63c None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:17.240414 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-4cc8c18f-05f4-4e90-a397-6671cbb7c63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:17.249088 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 493/969] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:17 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:40:17.273509 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315c463-fa4b-495b-832a-62711979646e None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:17.285757 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315c463-fa4b-495b-832a-62711979646e None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:17.290738 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5cddd-c4bb-47b8-b629-286ad2741f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:17.291592 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5cddd-c4bb-47b8-b629-286ad2741f35 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:17.291869 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5cddd-c4bb-47b8-b629-286ad2741f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:17.292142 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5cddd-c4bb-47b8-b629-286ad2741f35 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:17.292794 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa5cddd-c4bb-47b8-b629-286ad2741f35 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:17.294416 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa5cddd-c4bb-47b8-b629-286ad2741f35 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:17.306797 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-baa5cddd-c4bb-47b8-b629-286ad2741f35 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 05 14:40:17.308258 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 477/970] 10.222.0.30 () {56 vars in 1147 bytes} [Wed Jan 5 14:40:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:17.314157 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8c18f-05f4-4e90-a397-6671cbb7c63c None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:17.323219 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8c18f-05f4-4e90-a397-6671cbb7c63c None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:17.327926 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef03ee-3fc5-4c20-bf1d-cff5cdaaaabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:17.328580 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef03ee-3fc5-4c20-bf1d-cff5cdaaaabe admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:17.328861 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef03ee-3fc5-4c20-bf1d-cff5cdaaaabe admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:17.329164 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef03ee-3fc5-4c20-bf1d-cff5cdaaaabe admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:17.329885 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef03ee-3fc5-4c20-bf1d-cff5cdaaaabe admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:17.330188 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef03ee-3fc5-4c20-bf1d-cff5cdaaaabe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:17.331775 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef03ee-3fc5-4c20-bf1d-cff5cdaaaabe admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:17.337437 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 494/971] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Jan 5 14:40:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:40:17.342967 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5cddd-c4bb-47b8-b629-286ad2741f35 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:17.353095 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5cddd-c4bb-47b8-b629-286ad2741f35 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:17.358206 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a18d2-b2e8-4d13-8a44-b2ec0188d5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:17.359234 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a18d2-b2e8-4d13-8a44-b2ec0188d5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:17.359715 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a18d2-b2e8-4d13-8a44-b2ec0188d5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:17.360191 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a18d2-b2e8-4d13-8a44-b2ec0188d5a7 admin admin] PATH_INFO: `/v3/services` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:17.361193 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a18d2-b2e8-4d13-8a44-b2ec0188d5a7 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:17.361725 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a18d2-b2e8-4d13-8a44-b2ec0188d5a7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:17.363581 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a18d2-b2e8-4d13-8a44-b2ec0188d5a7 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:17.370274 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 478/972] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Jan 5 14:40:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:17.376114 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef03ee-3fc5-4c20-bf1d-cff5cdaaaabe admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:17.386372 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef03ee-3fc5-4c20-bf1d-cff5cdaaaabe admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:17.391199 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a28c7-05e0-4eeb-80ce-8453f9e883d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:17.392081 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a28c7-05e0-4eeb-80ce-8453f9e883d7 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:17.392558 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a28c7-05e0-4eeb-80ce-8453f9e883d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:17.393025 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a28c7-05e0-4eeb-80ce-8453f9e883d7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:17.394096 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a28c7-05e0-4eeb-80ce-8453f9e883d7 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:17.395861 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a28c7-05e0-4eeb-80ce-8453f9e883d7 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:17.469964 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 495/973] 10.222.0.30 () {60 vars in 1165 bytes} [Wed Jan 5 14:40:17 2022] POST /identity/v3/endpoints => generated 349 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:40:17.502439 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e44ba7-6072-482a-82fa-82ff5283b6e9 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:17.503140 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e44ba7-6072-482a-82fa-82ff5283b6e9 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:17.503630 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e44ba7-6072-482a-82fa-82ff5283b6e9 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:17.513051 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 479/974] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:17 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:17.518785 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b7ca8-a1fa-445b-a1dd-8d300c4f3709 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:17.519077 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b7ca8-a1fa-445b-a1dd-8d300c4f3709 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:17.519362 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b7ca8-a1fa-445b-a1dd-8d300c4f3709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:17.538503 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-944b7ca8-a1fa-445b-a1dd-8d300c4f3709 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:17.539816 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-944b7ca8-a1fa-445b-a1dd-8d300c4f3709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:17.564159 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 496/975] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:17 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:17.585491 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e44ba7-6072-482a-82fa-82ff5283b6e9 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:17.598979 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e44ba7-6072-482a-82fa-82ff5283b6e9 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:17.604048 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb600e-1aae-44ff-bda5-45bb1a7d2cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:17.605001 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb600e-1aae-44ff-bda5-45bb1a7d2cdc admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:17.605594 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb600e-1aae-44ff-bda5-45bb1a7d2cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:17.606064 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb600e-1aae-44ff-bda5-45bb1a7d2cdc admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:17.607001 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb600e-1aae-44ff-bda5-45bb1a7d2cdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:17.609186 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb600e-1aae-44ff-bda5-45bb1a7d2cdc admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:17.610878 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.common [None req-5fbb600e-1aae-44ff-bda5-45bb1a7d2cdc admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jan 05 14:40:17.670250 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.sql.core [None req-5fbb600e-1aae-44ff-bda5-45bb1a7d2cdc admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jan 05 14:40:17.670250 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jan 05 14:40:17.670250 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [parameters: {'id': '1286c8d5707146b5a00bea299029e466', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jan 05 14:40:17.670250 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=90996) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 05 14:40:17.688355 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-5fbb600e-1aae-44ff-bda5-45bb1a7d2cdc admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1286c8d5707146b5a00bea299029e466.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1286c8d5707146b5a00bea299029e466. Jan 05 14:40:17.693740 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 480/976] 10.222.0.30 () {60 vars in 1161 bytes} [Wed Jan 5 14:40:17 2022] POST /identity/v3/projects => generated 262 bytes in 105 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:17.697349 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b7ca8-a1fa-445b-a1dd-8d300c4f3709 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:17.707834 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b7ca8-a1fa-445b-a1dd-8d300c4f3709 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:17.712939 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d61c3-36bd-4aaa-b3ab-2c81e061f22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:17.714057 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d61c3-36bd-4aaa-b3ab-2c81e061f22b admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:17.714518 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d61c3-36bd-4aaa-b3ab-2c81e061f22b admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:17.715020 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d61c3-36bd-4aaa-b3ab-2c81e061f22b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:17.723033 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d61c3-36bd-4aaa-b3ab-2c81e061f22b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:17.724929 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d61c3-36bd-4aaa-b3ab-2c81e061f22b admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:17.739103 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-324d61c3-36bd-4aaa-b3ab-2c81e061f22b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:40:17.740463 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 497/977] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:40:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:17.746321 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb600e-1aae-44ff-bda5-45bb1a7d2cdc admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:17.756892 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb600e-1aae-44ff-bda5-45bb1a7d2cdc admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:17.762202 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcf1ca-57d0-4e0f-926f-c0e5f33914fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:17.762855 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcf1ca-57d0-4e0f-926f-c0e5f33914fd admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:17.763144 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcf1ca-57d0-4e0f-926f-c0e5f33914fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:17.763425 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcf1ca-57d0-4e0f-926f-c0e5f33914fd admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:17.764245 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dcf1ca-57d0-4e0f-926f-c0e5f33914fd admin admin] RBAC: Adding query filter params (name=service) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:17.764598 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dcf1ca-57d0-4e0f-926f-c0e5f33914fd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:17.766886 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dcf1ca-57d0-4e0f-926f-c0e5f33914fd admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:17.790810 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 481/978] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Jan 5 14:40:17 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:18.637816 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694e8c8-2cfb-40ca-bbdf-fd721d9a6020 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:18.638835 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694e8c8-2cfb-40ca-bbdf-fd721d9a6020 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:18.639318 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694e8c8-2cfb-40ca-bbdf-fd721d9a6020 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:18.641622 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 498/979] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:18.646654 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb84d49-32ab-4207-a8ba-9f8233441dcd None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:18.647056 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb84d49-32ab-4207-a8ba-9f8233441dcd None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:18.647240 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb84d49-32ab-4207-a8ba-9f8233441dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:18.666087 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-2cb84d49-32ab-4207-a8ba-9f8233441dcd None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:18.667591 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-2cb84d49-32ab-4207-a8ba-9f8233441dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:18.675810 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 482/980] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:18 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:18.702096 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694e8c8-2cfb-40ca-bbdf-fd721d9a6020 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:18.715048 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694e8c8-2cfb-40ca-bbdf-fd721d9a6020 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:18.719546 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fe07a-9d7d-4b56-a8f6-73ef26ec0d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:18.720188 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fe07a-9d7d-4b56-a8f6-73ef26ec0d39 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:18.720468 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fe07a-9d7d-4b56-a8f6-73ef26ec0d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:18.720738 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fe07a-9d7d-4b56-a8f6-73ef26ec0d39 admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:18.721495 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fe07a-9d7d-4b56-a8f6-73ef26ec0d39 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:18.723077 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fe07a-9d7d-4b56-a8f6-73ef26ec0d39 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:18.808255 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 499/981] 10.222.0.30 () {60 vars in 1162 bytes} [Wed Jan 5 14:40:18 2022] POST /identity/v3/services => generated 242 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:40:19.337092 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7159ee2-09dd-4ce0-9476-8e302c7091fd None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:19.337475 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7159ee2-09dd-4ce0-9476-8e302c7091fd None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:19.337672 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7159ee2-09dd-4ce0-9476-8e302c7091fd None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:19.339550 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 483/982] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:19.344836 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cca2c8-7344-4952-93fb-c3afa948260d None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:19.345380 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cca2c8-7344-4952-93fb-c3afa948260d None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:19.345873 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cca2c8-7344-4952-93fb-c3afa948260d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:19.364392 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-35cca2c8-7344-4952-93fb-c3afa948260d None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:19.365639 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-35cca2c8-7344-4952-93fb-c3afa948260d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:19.383620 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 500/983] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:19 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:40:19.407699 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7159ee2-09dd-4ce0-9476-8e302c7091fd None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:19.420737 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7159ee2-09dd-4ce0-9476-8e302c7091fd None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:19.425499 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e14813-83bb-419d-b8b3-b72238bfe2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:19.426396 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e14813-83bb-419d-b8b3-b72238bfe2e7 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:19.426887 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e14813-83bb-419d-b8b3-b72238bfe2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:19.427356 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e14813-83bb-419d-b8b3-b72238bfe2e7 admin admin] PATH_INFO: `/v3/services` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:19.428293 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e14813-83bb-419d-b8b3-b72238bfe2e7 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:19.430798 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e14813-83bb-419d-b8b3-b72238bfe2e7 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:19.550738 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 484/984] 10.222.0.30 () {60 vars in 1162 bytes} [Wed Jan 5 14:40:19 2022] POST /identity/v3/services => generated 242 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:40:19.988356 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a18425-15b3-4fb9-a1e8-f63b89fa7d8a None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:19.988894 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a18425-15b3-4fb9-a1e8-f63b89fa7d8a None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:19.988894 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a18425-15b3-4fb9-a1e8-f63b89fa7d8a None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:19.991487 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 501/985] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:19.997763 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9244c-ead7-4bae-89b7-6fd5b7ae6948 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:19.998282 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9244c-ead7-4bae-89b7-6fd5b7ae6948 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:19.998449 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9244c-ead7-4bae-89b7-6fd5b7ae6948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:20.017681 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-65f9244c-ead7-4bae-89b7-6fd5b7ae6948 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:20.018865 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-65f9244c-ead7-4bae-89b7-6fd5b7ae6948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:20.036348 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 485/986] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:19 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:20.061499 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a18425-15b3-4fb9-a1e8-f63b89fa7d8a None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:20.074424 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a18425-15b3-4fb9-a1e8-f63b89fa7d8a None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:20.078882 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4867b96-8b37-4366-a211-b9d18a3a46e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:20.079670 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4867b96-8b37-4366-a211-b9d18a3a46e8 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:20.079946 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4867b96-8b37-4366-a211-b9d18a3a46e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:20.080213 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4867b96-8b37-4366-a211-b9d18a3a46e8 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:20.080870 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4867b96-8b37-4366-a211-b9d18a3a46e8 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:20.082485 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4867b96-8b37-4366-a211-b9d18a3a46e8 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:20.094193 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-b4867b96-8b37-4366-a211-b9d18a3a46e8 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 05 14:40:20.095623 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 502/987] 10.222.0.30 () {56 vars in 1147 bytes} [Wed Jan 5 14:40:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:20.101470 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9244c-ead7-4bae-89b7-6fd5b7ae6948 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:20.110885 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9244c-ead7-4bae-89b7-6fd5b7ae6948 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:20.115446 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4dad0-4250-46f7-8cc5-f90de6fee439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:20.116086 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4dad0-4250-46f7-8cc5-f90de6fee439 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:20.116362 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4dad0-4250-46f7-8cc5-f90de6fee439 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:20.116631 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4dad0-4250-46f7-8cc5-f90de6fee439 admin admin] PATH_INFO: `/v3/services` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:20.117426 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4dad0-4250-46f7-8cc5-f90de6fee439 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:20.117775 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4dad0-4250-46f7-8cc5-f90de6fee439 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:20.119428 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4dad0-4250-46f7-8cc5-f90de6fee439 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:20.124681 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 486/988] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Jan 5 14:40:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:20.130417 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4867b96-8b37-4366-a211-b9d18a3a46e8 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:20.140827 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4867b96-8b37-4366-a211-b9d18a3a46e8 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:20.145621 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da9e21-611e-40f9-9a49-be611b25f798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:20.146313 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da9e21-611e-40f9-9a49-be611b25f798 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:20.146594 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da9e21-611e-40f9-9a49-be611b25f798 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:20.146867 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da9e21-611e-40f9-9a49-be611b25f798 admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:20.147629 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da9e21-611e-40f9-9a49-be611b25f798 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:20.147933 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da9e21-611e-40f9-9a49-be611b25f798 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:20.149652 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da9e21-611e-40f9-9a49-be611b25f798 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:20.155044 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 503/989] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Jan 5 14:40:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:20.160664 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4dad0-4250-46f7-8cc5-f90de6fee439 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:20.170696 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4dad0-4250-46f7-8cc5-f90de6fee439 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:20.175295 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66460b64-54eb-42c7-a78d-461add1482bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:20.175924 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66460b64-54eb-42c7-a78d-461add1482bb admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:20.176203 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66460b64-54eb-42c7-a78d-461add1482bb admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:20.176475 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66460b64-54eb-42c7-a78d-461add1482bb admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:20.177291 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66460b64-54eb-42c7-a78d-461add1482bb admin admin] RBAC: Adding query filter params (interface=admin, service_id=eab09472de704c09aa07b91c21a8d048, region_id=RegionOne) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:20.177598 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66460b64-54eb-42c7-a78d-461add1482bb admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:20.179180 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66460b64-54eb-42c7-a78d-461add1482bb admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:20.184444 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 487/990] 10.222.0.30 () {56 vars in 1270 bytes} [Wed Jan 5 14:40:20 2022] GET /identity/v3/endpoints?service_id=eab09472de704c09aa07b91c21a8d048&interface=admin®ion_id=RegionOne => generated 193 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:20.189867 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da9e21-611e-40f9-9a49-be611b25f798 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:20.200340 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da9e21-611e-40f9-9a49-be611b25f798 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:20.204944 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077a846-ae3a-481c-90e4-938a60628269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:20.205690 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077a846-ae3a-481c-90e4-938a60628269 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:20.205967 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077a846-ae3a-481c-90e4-938a60628269 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:20.206237 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077a846-ae3a-481c-90e4-938a60628269 admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:20.206920 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077a846-ae3a-481c-90e4-938a60628269 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:20.208519 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077a846-ae3a-481c-90e4-938a60628269 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:20.215957 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 504/991] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jan 5 14:40:20 2022] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:40:20.316336 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed983ac-18de-411b-bd1a-3f9826808008 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:20.316639 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed983ac-18de-411b-bd1a-3f9826808008 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:20.316800 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed983ac-18de-411b-bd1a-3f9826808008 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:20.318988 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 488/992] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:20.324573 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6ee69-3f32-44d3-b7ee-fe5d03a0742e None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:20.324858 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6ee69-3f32-44d3-b7ee-fe5d03a0742e None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:20.325171 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6ee69-3f32-44d3-b7ee-fe5d03a0742e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:20.344782 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-9de6ee69-3f32-44d3-b7ee-fe5d03a0742e None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:20.346037 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-9de6ee69-3f32-44d3-b7ee-fe5d03a0742e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:20.357445 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 505/993] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:20 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:20.385373 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed983ac-18de-411b-bd1a-3f9826808008 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:20.398459 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed983ac-18de-411b-bd1a-3f9826808008 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:20.403848 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27817f3-e076-49bc-9403-4f88529704ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:20.404624 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27817f3-e076-49bc-9403-4f88529704ac admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:20.404915 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27817f3-e076-49bc-9403-4f88529704ac admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:20.405233 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27817f3-e076-49bc-9403-4f88529704ac admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:20.406024 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27817f3-e076-49bc-9403-4f88529704ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:20.407974 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27817f3-e076-49bc-9403-4f88529704ac admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:20.457401 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.sql.core [None req-b27817f3-e076-49bc-9403-4f88529704ac admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jan 05 14:40:20.457401 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jan 05 14:40:20.457401 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [parameters: {'user_id': '0c2f3006f3ab4f72805fa5ef321a71cb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jan 05 14:40:20.457401 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=90996) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 05 14:40:20.463194 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-b27817f3-e076-49bc-9403-4f88529704ac admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jan 05 14:40:20.464860 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 489/994] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 14:40:20 2022] POST /identity/v3/users => generated 160 bytes in 80 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:20.471812 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6ee69-3f32-44d3-b7ee-fe5d03a0742e None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:20.481942 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6ee69-3f32-44d3-b7ee-fe5d03a0742e None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:20.486615 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88aeac0-3e8f-41b1-9a3c-ed9420488dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:20.487469 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88aeac0-3e8f-41b1-9a3c-ed9420488dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:20.488942 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88aeac0-3e8f-41b1-9a3c-ed9420488dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:20.488942 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88aeac0-3e8f-41b1-9a3c-ed9420488dd7 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:20.502582 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88aeac0-3e8f-41b1-9a3c-ed9420488dd7 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:20.504605 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88aeac0-3e8f-41b1-9a3c-ed9420488dd7 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:20.525538 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-f88aeac0-3e8f-41b1-9a3c-ed9420488dd7 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 05 14:40:20.527054 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 506/995] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:40:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:20.534575 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27817f3-e076-49bc-9403-4f88529704ac admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:20.546654 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27817f3-e076-49bc-9403-4f88529704ac admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:20.551540 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be842f1b-598d-4970-b21c-03ef38304b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:20.552414 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be842f1b-598d-4970-b21c-03ef38304b64 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:20.552923 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be842f1b-598d-4970-b21c-03ef38304b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:20.553471 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be842f1b-598d-4970-b21c-03ef38304b64 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:20.554482 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be842f1b-598d-4970-b21c-03ef38304b64 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:20.555029 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be842f1b-598d-4970-b21c-03ef38304b64 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:20.557397 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be842f1b-598d-4970-b21c-03ef38304b64 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:20.596506 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 490/996] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jan 5 14:40:20 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:21.290008 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33fdfd-efb4-4082-8948-b7ce179d75c3 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:21.290524 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33fdfd-efb4-4082-8948-b7ce179d75c3 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:21.290599 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33fdfd-efb4-4082-8948-b7ce179d75c3 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:21.292349 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 507/997] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:21.297892 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89ab09-d371-4848-a486-c797b1710e6e None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:21.298741 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89ab09-d371-4848-a486-c797b1710e6e None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:21.298741 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89ab09-d371-4848-a486-c797b1710e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:21.318852 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-3d89ab09-d371-4848-a486-c797b1710e6e None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:21.320408 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-3d89ab09-d371-4848-a486-c797b1710e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:21.328939 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 491/998] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:21 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:21.352807 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33fdfd-efb4-4082-8948-b7ce179d75c3 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:21.364843 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33fdfd-efb4-4082-8948-b7ce179d75c3 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:21.369863 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cb669-dc61-4f34-930f-9b5762d56a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:21.370676 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cb669-dc61-4f34-930f-9b5762d56a4a admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:21.370957 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cb669-dc61-4f34-930f-9b5762d56a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:21.371229 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cb669-dc61-4f34-930f-9b5762d56a4a admin admin] PATH_INFO: `/v3/services/compute` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:21.371900 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942cb669-dc61-4f34-930f-9b5762d56a4a admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:21.373585 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942cb669-dc61-4f34-930f-9b5762d56a4a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:21.386320 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-942cb669-dc61-4f34-930f-9b5762d56a4a admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 05 14:40:21.387697 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 508/999] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:40:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:21.393452 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89ab09-d371-4848-a486-c797b1710e6e None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:21.402469 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89ab09-d371-4848-a486-c797b1710e6e None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:21.406886 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115256aa-45f7-4737-82e4-1a5f48cf2838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:21.407533 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115256aa-45f7-4737-82e4-1a5f48cf2838 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:21.407813 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115256aa-45f7-4737-82e4-1a5f48cf2838 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:21.408082 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115256aa-45f7-4737-82e4-1a5f48cf2838 admin admin] PATH_INFO: `/v3/services` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:21.408789 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115256aa-45f7-4737-82e4-1a5f48cf2838 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:21.409111 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115256aa-45f7-4737-82e4-1a5f48cf2838 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:21.410763 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115256aa-45f7-4737-82e4-1a5f48cf2838 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:21.416243 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 492/1000] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Jan 5 14:40:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:21.421484 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cb669-dc61-4f34-930f-9b5762d56a4a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:21.431010 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cb669-dc61-4f34-930f-9b5762d56a4a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:21.435427 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755c2c5-d129-4af6-b8f3-652d5ce7cd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:21.436065 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755c2c5-d129-4af6-b8f3-652d5ce7cd20 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:21.436346 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755c2c5-d129-4af6-b8f3-652d5ce7cd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:21.436618 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755c2c5-d129-4af6-b8f3-652d5ce7cd20 admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:21.437356 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755c2c5-d129-4af6-b8f3-652d5ce7cd20 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:21.437661 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755c2c5-d129-4af6-b8f3-652d5ce7cd20 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:21.439251 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755c2c5-d129-4af6-b8f3-652d5ce7cd20 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:21.444184 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 509/1001] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Jan 5 14:40:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:21.450619 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115256aa-45f7-4737-82e4-1a5f48cf2838 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:21.460335 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115256aa-45f7-4737-82e4-1a5f48cf2838 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:21.468518 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a1327-d019-4df3-bfd0-db8498c266e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:21.469253 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a1327-d019-4df3-bfd0-db8498c266e1 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:21.469544 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a1327-d019-4df3-bfd0-db8498c266e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:21.469823 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a1327-d019-4df3-bfd0-db8498c266e1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:21.470677 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a1327-d019-4df3-bfd0-db8498c266e1 admin admin] RBAC: Adding query filter params (interface=public, service_id=448b6b2b83874f15af6df72992f02b59, region_id=RegionOne) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:21.470988 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a1327-d019-4df3-bfd0-db8498c266e1 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:21.472635 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a1327-d019-4df3-bfd0-db8498c266e1 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:21.482266 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 493/1002] 10.222.0.30 () {56 vars in 1272 bytes} [Wed Jan 5 14:40:21 2022] GET /identity/v3/endpoints?service_id=448b6b2b83874f15af6df72992f02b59&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:21.483462 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755c2c5-d129-4af6-b8f3-652d5ce7cd20 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:21.493048 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755c2c5-d129-4af6-b8f3-652d5ce7cd20 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:21.497656 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d97edf-18ed-4d34-a4e2-8854f974410d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:21.498310 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d97edf-18ed-4d34-a4e2-8854f974410d admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:21.498590 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d97edf-18ed-4d34-a4e2-8854f974410d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:21.498867 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d97edf-18ed-4d34-a4e2-8854f974410d admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:21.499554 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d97edf-18ed-4d34-a4e2-8854f974410d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:21.501163 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d97edf-18ed-4d34-a4e2-8854f974410d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:21.517585 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 510/1003] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jan 5 14:40:21 2022] GET /identity/v3/services => generated 1957 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:40:22.102845 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed569e-68f1-433c-8d4f-6fe56f08ec7e None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:22.103235 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed569e-68f1-433c-8d4f-6fe56f08ec7e None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:22.103431 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed569e-68f1-433c-8d4f-6fe56f08ec7e None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:22.105216 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 494/1004] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 14:40:22.110333 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a201bc5-dedc-4c51-9b6f-5eac975cb3df None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:22.110623 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a201bc5-dedc-4c51-9b6f-5eac975cb3df None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:22.110900 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a201bc5-dedc-4c51-9b6f-5eac975cb3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:22.129007 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-0a201bc5-dedc-4c51-9b6f-5eac975cb3df None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:22.130200 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-0a201bc5-dedc-4c51-9b6f-5eac975cb3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:22.138582 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 511/1005] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:22 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:40:22.162225 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed569e-68f1-433c-8d4f-6fe56f08ec7e None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:22.174750 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed569e-68f1-433c-8d4f-6fe56f08ec7e None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:22.179030 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736dd5b-89b8-4bd3-986c-aa11a0ee700c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:22.180392 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736dd5b-89b8-4bd3-986c-aa11a0ee700c admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:22.180791 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736dd5b-89b8-4bd3-986c-aa11a0ee700c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:22.181205 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736dd5b-89b8-4bd3-986c-aa11a0ee700c admin admin] PATH_INFO: `/v3/services/image` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:22.182157 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736dd5b-89b8-4bd3-986c-aa11a0ee700c admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:22.184180 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736dd5b-89b8-4bd3-986c-aa11a0ee700c admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:22.196508 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-7736dd5b-89b8-4bd3-986c-aa11a0ee700c admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 05 14:40:22.198020 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 495/1006] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Jan 5 14:40:22 2022] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:22.204053 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a201bc5-dedc-4c51-9b6f-5eac975cb3df None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:22.214918 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a201bc5-dedc-4c51-9b6f-5eac975cb3df None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:22.220887 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089742d-4108-403a-8707-37f32b9d6fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:22.221914 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089742d-4108-403a-8707-37f32b9d6fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:22.222308 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089742d-4108-403a-8707-37f32b9d6fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:22.222636 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089742d-4108-403a-8707-37f32b9d6fa8 admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:22.223367 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089742d-4108-403a-8707-37f32b9d6fa8 admin admin] RBAC: Adding query filter params (name=image) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:22.223669 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089742d-4108-403a-8707-37f32b9d6fa8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:22.225302 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089742d-4108-403a-8707-37f32b9d6fa8 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:22.233219 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 512/1007] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:22.236462 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736dd5b-89b8-4bd3-986c-aa11a0ee700c admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:22.246163 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736dd5b-89b8-4bd3-986c-aa11a0ee700c admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:22.250732 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6a501-d72f-424c-8a13-d7fd85cfc595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:22.251714 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6a501-d72f-424c-8a13-d7fd85cfc595 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:22.252067 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6a501-d72f-424c-8a13-d7fd85cfc595 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:22.252414 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6a501-d72f-424c-8a13-d7fd85cfc595 admin admin] PATH_INFO: `/v3/services` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:22.253232 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6a501-d72f-424c-8a13-d7fd85cfc595 admin admin] RBAC: Adding query filter params (type=image) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:22.253540 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6a501-d72f-424c-8a13-d7fd85cfc595 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:22.255161 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6a501-d72f-424c-8a13-d7fd85cfc595 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:22.260731 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 496/1008] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:22.266357 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089742d-4108-403a-8707-37f32b9d6fa8 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:22.278250 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089742d-4108-403a-8707-37f32b9d6fa8 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:22.283860 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a1e63-356d-4bc3-b574-74db26726081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:22.284515 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a1e63-356d-4bc3-b574-74db26726081 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:22.284797 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a1e63-356d-4bc3-b574-74db26726081 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:22.285097 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a1e63-356d-4bc3-b574-74db26726081 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:22.285909 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a1e63-356d-4bc3-b574-74db26726081 admin admin] RBAC: Adding query filter params (interface=public, service_id=62e80f28370f4186b7851bf6b1bf88f0, region_id=RegionOne) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:22.286217 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a1e63-356d-4bc3-b574-74db26726081 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:22.287959 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a1e63-356d-4bc3-b574-74db26726081 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:22.297091 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 513/1009] 10.222.0.30 () {56 vars in 1272 bytes} [Wed Jan 5 14:40:22 2022] GET /identity/v3/endpoints?service_id=62e80f28370f4186b7851bf6b1bf88f0&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:22.299871 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6a501-d72f-424c-8a13-d7fd85cfc595 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:22.309500 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6a501-d72f-424c-8a13-d7fd85cfc595 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:22.314218 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34eef8-cc11-4d02-8ab7-87ee250a5679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:22.314861 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34eef8-cc11-4d02-8ab7-87ee250a5679 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:22.315141 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34eef8-cc11-4d02-8ab7-87ee250a5679 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:22.315416 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34eef8-cc11-4d02-8ab7-87ee250a5679 admin admin] PATH_INFO: `/v3/services` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:22.316097 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34eef8-cc11-4d02-8ab7-87ee250a5679 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:22.317727 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34eef8-cc11-4d02-8ab7-87ee250a5679 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:22.324965 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 497/1010] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jan 5 14:40:22 2022] GET /identity/v3/services => generated 1957 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:40:22.645498 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679349ef-8115-4277-8af9-82784e44c71d None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:22.645863 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679349ef-8115-4277-8af9-82784e44c71d None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:22.646038 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679349ef-8115-4277-8af9-82784e44c71d None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:22.647930 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 514/1011] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:22.653429 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ac941-1d41-48f2-9dd6-d7c623f09daf None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:22.653717 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ac941-1d41-48f2-9dd6-d7c623f09daf None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:22.653999 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ac941-1d41-48f2-9dd6-d7c623f09daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:22.672204 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-854ac941-1d41-48f2-9dd6-d7c623f09daf None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:22.673444 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-854ac941-1d41-48f2-9dd6-d7c623f09daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:22.681838 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 498/1012] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:22 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:22.705658 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679349ef-8115-4277-8af9-82784e44c71d None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:22.718069 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679349ef-8115-4277-8af9-82784e44c71d None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:22.722293 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ebf3e-875f-4a87-8b0b-7d5bdac04541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:22.723081 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ebf3e-875f-4a87-8b0b-7d5bdac04541 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:22.723358 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ebf3e-875f-4a87-8b0b-7d5bdac04541 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:22.723624 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ebf3e-875f-4a87-8b0b-7d5bdac04541 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:22.724272 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ebf3e-875f-4a87-8b0b-7d5bdac04541 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:22.725879 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ebf3e-875f-4a87-8b0b-7d5bdac04541 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:22.737280 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-000ebf3e-875f-4a87-8b0b-7d5bdac04541 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 05 14:40:22.738581 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 515/1013] 10.222.0.30 () {56 vars in 1147 bytes} [Wed Jan 5 14:40:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:22.744797 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ac941-1d41-48f2-9dd6-d7c623f09daf None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:22.754044 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ac941-1d41-48f2-9dd6-d7c623f09daf None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:22.759216 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7cb1b-a874-483a-a357-c6f9a75c01a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:22.759949 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7cb1b-a874-483a-a357-c6f9a75c01a8 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:22.760296 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7cb1b-a874-483a-a357-c6f9a75c01a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:22.760686 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7cb1b-a874-483a-a357-c6f9a75c01a8 admin admin] PATH_INFO: `/v3/services` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:22.761448 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b7cb1b-a874-483a-a357-c6f9a75c01a8 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:22.761813 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b7cb1b-a874-483a-a357-c6f9a75c01a8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:22.763471 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b7cb1b-a874-483a-a357-c6f9a75c01a8 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:22.768301 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 499/1014] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Jan 5 14:40:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:40:22.773909 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ebf3e-875f-4a87-8b0b-7d5bdac04541 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:22.783292 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ebf3e-875f-4a87-8b0b-7d5bdac04541 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:22.787654 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636bff0-c507-4fc6-a28f-f7d8cf6aadda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:22.788293 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636bff0-c507-4fc6-a28f-f7d8cf6aadda admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:22.788571 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636bff0-c507-4fc6-a28f-f7d8cf6aadda admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:22.788842 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636bff0-c507-4fc6-a28f-f7d8cf6aadda admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:22.789600 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636bff0-c507-4fc6-a28f-f7d8cf6aadda admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:22.789906 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636bff0-c507-4fc6-a28f-f7d8cf6aadda admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:22.791476 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636bff0-c507-4fc6-a28f-f7d8cf6aadda admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:22.796340 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 516/1015] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Jan 5 14:40:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:22.801758 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7cb1b-a874-483a-a357-c6f9a75c01a8 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:22.811843 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7cb1b-a874-483a-a357-c6f9a75c01a8 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:22.816392 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9c810-6bb2-4678-8b44-957aba9a7b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:22.817042 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9c810-6bb2-4678-8b44-957aba9a7b57 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:22.817368 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9c810-6bb2-4678-8b44-957aba9a7b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:22.817626 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9c810-6bb2-4678-8b44-957aba9a7b57 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:22.818370 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9c810-6bb2-4678-8b44-957aba9a7b57 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:22.820013 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9c810-6bb2-4678-8b44-957aba9a7b57 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:22.901238 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 500/1016] 10.222.0.30 () {60 vars in 1165 bytes} [Wed Jan 5 14:40:22 2022] POST /identity/v3/endpoints => generated 325 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 14:40:23.971059 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f322af1-14fa-430d-a2ba-695f2a7d809e None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:23.971585 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f322af1-14fa-430d-a2ba-695f2a7d809e None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:23.971585 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f322af1-14fa-430d-a2ba-695f2a7d809e None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:23.973414 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 517/1017] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:23.979614 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cb5ea-97f2-40c0-9820-8f6e7391d7b1 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:23.980042 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cb5ea-97f2-40c0-9820-8f6e7391d7b1 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:23.980377 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cb5ea-97f2-40c0-9820-8f6e7391d7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:23.998607 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-610cb5ea-97f2-40c0-9820-8f6e7391d7b1 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:23.999780 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-610cb5ea-97f2-40c0-9820-8f6e7391d7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:24.018502 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 501/1018] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:23 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:24.043735 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f322af1-14fa-430d-a2ba-695f2a7d809e None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:24.055832 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f322af1-14fa-430d-a2ba-695f2a7d809e None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:24.060297 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4334d84-f854-4873-a275-b1ffcaee029f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:24.061096 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4334d84-f854-4873-a275-b1ffcaee029f admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:24.061547 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4334d84-f854-4873-a275-b1ffcaee029f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:24.061830 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4334d84-f854-4873-a275-b1ffcaee029f admin admin] PATH_INFO: `/v3/services/compute` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:24.062492 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4334d84-f854-4873-a275-b1ffcaee029f admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:24.064080 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4334d84-f854-4873-a275-b1ffcaee029f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:24.075154 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-c4334d84-f854-4873-a275-b1ffcaee029f admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 05 14:40:24.076448 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 518/1019] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:40:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:24.082306 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610cb5ea-97f2-40c0-9820-8f6e7391d7b1 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:24.091811 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610cb5ea-97f2-40c0-9820-8f6e7391d7b1 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:24.096296 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63975f-c421-4365-a0aa-7ffe92aca4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:24.096952 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63975f-c421-4365-a0aa-7ffe92aca4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:24.097265 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63975f-c421-4365-a0aa-7ffe92aca4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:24.097547 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63975f-c421-4365-a0aa-7ffe92aca4c3 admin admin] PATH_INFO: `/v3/services` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:24.098265 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63975f-c421-4365-a0aa-7ffe92aca4c3 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:24.098571 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63975f-c421-4365-a0aa-7ffe92aca4c3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:24.100177 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63975f-c421-4365-a0aa-7ffe92aca4c3 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:24.106058 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 502/1020] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Jan 5 14:40:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:24.111577 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4334d84-f854-4873-a275-b1ffcaee029f admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:24.122359 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4334d84-f854-4873-a275-b1ffcaee029f admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:24.127506 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb471d4-6750-4bc8-ac82-897a23d991b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:24.128387 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb471d4-6750-4bc8-ac82-897a23d991b0 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:24.128926 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb471d4-6750-4bc8-ac82-897a23d991b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:24.129401 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb471d4-6750-4bc8-ac82-897a23d991b0 admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:24.130347 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb471d4-6750-4bc8-ac82-897a23d991b0 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:24.130834 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb471d4-6750-4bc8-ac82-897a23d991b0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:24.132660 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb471d4-6750-4bc8-ac82-897a23d991b0 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:24.138356 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 519/1021] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Jan 5 14:40:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:24.143683 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63975f-c421-4365-a0aa-7ffe92aca4c3 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:24.153879 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63975f-c421-4365-a0aa-7ffe92aca4c3 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:24.158458 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679d9e5-c2d7-42ea-a3e3-f3547a929230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:24.159165 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679d9e5-c2d7-42ea-a3e3-f3547a929230 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:24.159545 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679d9e5-c2d7-42ea-a3e3-f3547a929230 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:24.159898 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679d9e5-c2d7-42ea-a3e3-f3547a929230 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:24.160729 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679d9e5-c2d7-42ea-a3e3-f3547a929230 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:24.162439 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679d9e5-c2d7-42ea-a3e3-f3547a929230 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:24.235223 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 503/1022] 10.222.0.30 () {60 vars in 1165 bytes} [Wed Jan 5 14:40:24 2022] POST /identity/v3/endpoints => generated 334 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:40:24.740240 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52d115-945b-481a-8e68-716c3ec5c54f None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:24.740527 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52d115-945b-481a-8e68-716c3ec5c54f None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:24.740811 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52d115-945b-481a-8e68-716c3ec5c54f None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:24.742812 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 520/1023] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:24.748178 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cab25a-6485-4698-93e6-853824f0f161 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:24.748572 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cab25a-6485-4698-93e6-853824f0f161 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:24.748865 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cab25a-6485-4698-93e6-853824f0f161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:24.767022 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-05cab25a-6485-4698-93e6-853824f0f161 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:24.768131 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-05cab25a-6485-4698-93e6-853824f0f161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:24.785101 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 504/1024] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:24 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:24.809869 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52d115-945b-481a-8e68-716c3ec5c54f None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:24.822935 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52d115-945b-481a-8e68-716c3ec5c54f None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:24.828685 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5692c-82fb-4e27-9f36-02cf7c2eb0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:24.829497 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5692c-82fb-4e27-9f36-02cf7c2eb0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:24.829778 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5692c-82fb-4e27-9f36-02cf7c2eb0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:24.830050 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5692c-82fb-4e27-9f36-02cf7c2eb0e9 admin admin] PATH_INFO: `/v3/services/image` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:24.830708 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5692c-82fb-4e27-9f36-02cf7c2eb0e9 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:24.832286 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5692c-82fb-4e27-9f36-02cf7c2eb0e9 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:24.846585 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-47f5692c-82fb-4e27-9f36-02cf7c2eb0e9 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 05 14:40:24.848765 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 521/1025] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Jan 5 14:40:24 2022] GET /identity/v3/services/image => generated 86 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:24.854803 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cab25a-6485-4698-93e6-853824f0f161 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:24.864396 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cab25a-6485-4698-93e6-853824f0f161 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:24.869347 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d53b4-ca73-42d0-b5c6-dd61d34d5131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:24.870167 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d53b4-ca73-42d0-b5c6-dd61d34d5131 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:24.870514 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d53b4-ca73-42d0-b5c6-dd61d34d5131 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:24.870889 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d53b4-ca73-42d0-b5c6-dd61d34d5131 admin admin] PATH_INFO: `/v3/services` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:24.871720 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d53b4-ca73-42d0-b5c6-dd61d34d5131 admin admin] RBAC: Adding query filter params (name=image) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:24.872096 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d53b4-ca73-42d0-b5c6-dd61d34d5131 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:24.873946 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d53b4-ca73-42d0-b5c6-dd61d34d5131 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:24.885090 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 505/1026] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:24.886435 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5692c-82fb-4e27-9f36-02cf7c2eb0e9 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:24.906410 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5692c-82fb-4e27-9f36-02cf7c2eb0e9 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:24.910843 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12afbc98-1ea9-47b3-a1e1-6fc380713b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:24.911490 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afbc98-1ea9-47b3-a1e1-6fc380713b36 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:24.911768 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afbc98-1ea9-47b3-a1e1-6fc380713b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:24.912040 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afbc98-1ea9-47b3-a1e1-6fc380713b36 admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:24.912749 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12afbc98-1ea9-47b3-a1e1-6fc380713b36 admin admin] RBAC: Adding query filter params (type=image) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:24.913047 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12afbc98-1ea9-47b3-a1e1-6fc380713b36 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:24.915338 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12afbc98-1ea9-47b3-a1e1-6fc380713b36 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:24.920376 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 522/1027] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:24.925799 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d53b4-ca73-42d0-b5c6-dd61d34d5131 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:24.935526 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d53b4-ca73-42d0-b5c6-dd61d34d5131 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:24.939930 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abe5f0-c633-4b26-86bb-cef70cb64c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:24.940561 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abe5f0-c633-4b26-86bb-cef70cb64c08 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:24.940846 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abe5f0-c633-4b26-86bb-cef70cb64c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:24.941135 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abe5f0-c633-4b26-86bb-cef70cb64c08 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:24.941892 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35abe5f0-c633-4b26-86bb-cef70cb64c08 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:24.943494 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35abe5f0-c633-4b26-86bb-cef70cb64c08 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:25.053193 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 506/1028] 10.222.0.30 () {60 vars in 1165 bytes} [Wed Jan 5 14:40:24 2022] POST /identity/v3/endpoints => generated 327 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 14:40:25.310804 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f600180-e564-4c38-a8cc-2f82ead8f71f None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:25.311302 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f600180-e564-4c38-a8cc-2f82ead8f71f None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:25.311302 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f600180-e564-4c38-a8cc-2f82ead8f71f None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:25.313107 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 523/1029] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:25.318321 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ea846-6ae1-4c7c-874a-7aa9c49111ef None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:25.318614 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ea846-6ae1-4c7c-874a-7aa9c49111ef None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:25.318888 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ea846-6ae1-4c7c-874a-7aa9c49111ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:25.336473 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-d65ea846-6ae1-4c7c-874a-7aa9c49111ef None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:25.337668 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-d65ea846-6ae1-4c7c-874a-7aa9c49111ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:25.355239 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 507/1030] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:25 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:40:25.380058 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f600180-e564-4c38-a8cc-2f82ead8f71f None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:25.392407 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f600180-e564-4c38-a8cc-2f82ead8f71f None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:25.396640 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a3503-dab7-49a8-b6e6-238ea5246186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:25.397461 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a3503-dab7-49a8-b6e6-238ea5246186 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:25.397743 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a3503-dab7-49a8-b6e6-238ea5246186 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:25.398013 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a3503-dab7-49a8-b6e6-238ea5246186 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:25.399848 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a3503-dab7-49a8-b6e6-238ea5246186 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:25.401551 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a3503-dab7-49a8-b6e6-238ea5246186 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:25.403264 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 524/1031] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:25.408721 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ea846-6ae1-4c7c-874a-7aa9c49111ef None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:25.417708 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ea846-6ae1-4c7c-874a-7aa9c49111ef None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:25.422129 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36bbc53-e839-4362-9019-f4dde7bb20c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:25.422777 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bbc53-e839-4362-9019-f4dde7bb20c5 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:25.423055 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bbc53-e839-4362-9019-f4dde7bb20c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:25.423327 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bbc53-e839-4362-9019-f4dde7bb20c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:25.424052 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36bbc53-e839-4362-9019-f4dde7bb20c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:25.425974 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36bbc53-e839-4362-9019-f4dde7bb20c5 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:25.539758 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 508/1032] 10.222.0.30 () {60 vars in 1162 bytes} [Wed Jan 5 14:40:25 2022] POST /identity/v3/projects => generated 311 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:40:26.799304 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66361e45-fb9b-4d2c-9d0a-1fe07dcde5a6 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:26.799805 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66361e45-fb9b-4d2c-9d0a-1fe07dcde5a6 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:26.799805 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66361e45-fb9b-4d2c-9d0a-1fe07dcde5a6 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:26.801580 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 525/1033] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:26.806749 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da125490-f108-4960-bc48-573b96b7871a None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:26.807143 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da125490-f108-4960-bc48-573b96b7871a None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:26.807313 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da125490-f108-4960-bc48-573b96b7871a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:26.824960 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-da125490-f108-4960-bc48-573b96b7871a None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:26.826151 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-da125490-f108-4960-bc48-573b96b7871a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:26.885731 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 509/1034] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:26 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:26.911173 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66361e45-fb9b-4d2c-9d0a-1fe07dcde5a6 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:26.924647 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66361e45-fb9b-4d2c-9d0a-1fe07dcde5a6 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:26.931749 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a39b8-32f4-4733-852f-13ba5dd3c894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:26.932569 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a39b8-32f4-4733-852f-13ba5dd3c894 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:26.932852 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a39b8-32f4-4733-852f-13ba5dd3c894 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:26.933159 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a39b8-32f4-4733-852f-13ba5dd3c894 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:26.946666 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a39b8-32f4-4733-852f-13ba5dd3c894 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:40:26.956827 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-059a39b8-32f4-4733-852f-13ba5dd3c894 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 05 14:40:26.961725 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 526/1035] 10.222.0.30 () {56 vars in 1141 bytes} [Wed Jan 5 14:40:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:26.965031 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da125490-f108-4960-bc48-573b96b7871a None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:26.975080 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da125490-f108-4960-bc48-573b96b7871a None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:26.980424 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b101465-12c1-429a-a127-b3fa7699a7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:26.985335 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b101465-12c1-429a-a127-b3fa7699a7f6 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:26.985335 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b101465-12c1-429a-a127-b3fa7699a7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:26.985335 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b101465-12c1-429a-a127-b3fa7699a7f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:26.985335 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b101465-12c1-429a-a127-b3fa7699a7f6 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:26.985335 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b101465-12c1-429a-a127-b3fa7699a7f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:26.985335 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b101465-12c1-429a-a127-b3fa7699a7f6 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:26.993655 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 510/1036] 10.222.0.30 () {56 vars in 1136 bytes} [Wed Jan 5 14:40:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:26.999791 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a39b8-32f4-4733-852f-13ba5dd3c894 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:27.010273 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a39b8-32f4-4733-852f-13ba5dd3c894 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:27.014941 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b06845-f86c-4a9c-af81-7a4ed42c4513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:27.015725 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b06845-f86c-4a9c-af81-7a4ed42c4513 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:27.016011 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b06845-f86c-4a9c-af81-7a4ed42c4513 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:27.016291 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b06845-f86c-4a9c-af81-7a4ed42c4513 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:27.027215 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b06845-f86c-4a9c-af81-7a4ed42c4513 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:27.029108 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b06845-f86c-4a9c-af81-7a4ed42c4513 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:27.048453 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-32b06845-f86c-4a9c-af81-7a4ed42c4513 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:40:27.050073 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 527/1037] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:27.056385 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b101465-12c1-429a-a127-b3fa7699a7f6 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:27.066625 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b101465-12c1-429a-a127-b3fa7699a7f6 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:27.071876 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b116b-ac35-4805-945c-52c8a785b5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:27.072529 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b116b-ac35-4805-945c-52c8a785b5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:27.072818 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b116b-ac35-4805-945c-52c8a785b5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:27.073117 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b116b-ac35-4805-945c-52c8a785b5f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:27.073853 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b116b-ac35-4805-945c-52c8a785b5f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:27.074161 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b116b-ac35-4805-945c-52c8a785b5f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:27.075749 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b116b-ac35-4805-945c-52c8a785b5f7 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:27.087974 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 511/1038] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:27.093347 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b06845-f86c-4a9c-af81-7a4ed42c4513 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:27.102966 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b06845-f86c-4a9c-af81-7a4ed42c4513 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:27.107436 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3b2ab-a957-4e25-9a76-54a6735a0530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:27.108207 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3b2ab-a957-4e25-9a76-54a6735a0530 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:27.108488 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3b2ab-a957-4e25-9a76-54a6735a0530 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:27.108764 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3b2ab-a957-4e25-9a76-54a6735a0530 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:27.115989 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3b2ab-a957-4e25-9a76-54a6735a0530 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:27.118554 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3b2ab-a957-4e25-9a76-54a6735a0530 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:27.138062 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-7bd3b2ab-a957-4e25-9a76-54a6735a0530 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 05 14:40:27.139515 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 528/1039] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Jan 5 14:40:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:27.145396 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b116b-ac35-4805-945c-52c8a785b5f7 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:27.155502 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b116b-ac35-4805-945c-52c8a785b5f7 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:27.160033 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8dfc6d-a67a-43ad-871e-074b5bba004e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:27.160753 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dfc6d-a67a-43ad-871e-074b5bba004e admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:27.161168 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dfc6d-a67a-43ad-871e-074b5bba004e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:27.161516 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dfc6d-a67a-43ad-871e-074b5bba004e admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:27.162409 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8dfc6d-a67a-43ad-871e-074b5bba004e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:27.162785 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8dfc6d-a67a-43ad-871e-074b5bba004e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:27.164678 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8dfc6d-a67a-43ad-871e-074b5bba004e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:27.182334 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 512/1040] 10.222.0.30 () {56 vars in 1154 bytes} [Wed Jan 5 14:40:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:27.188031 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3b2ab-a957-4e25-9a76-54a6735a0530 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:27.198325 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3b2ab-a957-4e25-9a76-54a6735a0530 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:27.203086 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4e2c4-24b5-40c9-85a7-c5628906c2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:27.203717 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4e2c4-24b5-40c9-85a7-c5628906c2fe admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:27.204000 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4e2c4-24b5-40c9-85a7-c5628906c2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:27.204275 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4e2c4-24b5-40c9-85a7-c5628906c2fe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:27.212171 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a4e2c4-24b5-40c9-85a7-c5628906c2fe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:27.214057 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a4e2c4-24b5-40c9-85a7-c5628906c2fe admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:27.222937 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 529/1041] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:40:27 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:40:27.228419 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8dfc6d-a67a-43ad-871e-074b5bba004e admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:27.238096 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8dfc6d-a67a-43ad-871e-074b5bba004e admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:27.243178 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9096b64-b7f6-49b2-88ec-a24bb31c748b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:27.244097 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9096b64-b7f6-49b2-88ec-a24bb31c748b admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:27.244444 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9096b64-b7f6-49b2-88ec-a24bb31c748b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:27.244788 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9096b64-b7f6-49b2-88ec-a24bb31c748b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:27.255839 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9096b64-b7f6-49b2-88ec-a24bb31c748b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:27.258593 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9096b64-b7f6-49b2-88ec-a24bb31c748b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:27.278609 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-e9096b64-b7f6-49b2-88ec-a24bb31c748b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:40:27.280013 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 513/1042] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:27.285863 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4e2c4-24b5-40c9-85a7-c5628906c2fe admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:27.294858 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4e2c4-24b5-40c9-85a7-c5628906c2fe admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:27.299504 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87dfb7-07ff-4991-951f-0d38c6667ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:27.300269 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87dfb7-07ff-4991-951f-0d38c6667ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:27.300576 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87dfb7-07ff-4991-951f-0d38c6667ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:27.300940 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87dfb7-07ff-4991-951f-0d38c6667ef4 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:27.301809 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87dfb7-07ff-4991-951f-0d38c6667ef4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:27.302251 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87dfb7-07ff-4991-951f-0d38c6667ef4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:27.303921 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87dfb7-07ff-4991-951f-0d38c6667ef4 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:27.317229 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 530/1043] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:40:27.322223 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9096b64-b7f6-49b2-88ec-a24bb31c748b admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:27.331966 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9096b64-b7f6-49b2-88ec-a24bb31c748b admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:27.336589 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496e81e-689f-4f95-b964-0a667196eb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:27.337397 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496e81e-689f-4f95-b964-0a667196eb04 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:27.337681 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496e81e-689f-4f95-b964-0a667196eb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:27.337957 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496e81e-689f-4f95-b964-0a667196eb04 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:27.344969 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496e81e-689f-4f95-b964-0a667196eb04 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:27.347059 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496e81e-689f-4f95-b964-0a667196eb04 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:27.360354 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-d496e81e-689f-4f95-b964-0a667196eb04 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:40:27.361692 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 514/1044] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:40:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:40:27.368151 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87dfb7-07ff-4991-951f-0d38c6667ef4 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:27.378259 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87dfb7-07ff-4991-951f-0d38c6667ef4 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:27.383449 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6b60f-60ee-470f-bd2f-0400c7f53a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:27.384100 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6b60f-60ee-470f-bd2f-0400c7f53a0c admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:27.384388 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6b60f-60ee-470f-bd2f-0400c7f53a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:27.384655 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6b60f-60ee-470f-bd2f-0400c7f53a0c admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:27.385478 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6b60f-60ee-470f-bd2f-0400c7f53a0c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:27.385787 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6b60f-60ee-470f-bd2f-0400c7f53a0c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:27.387781 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6b60f-60ee-470f-bd2f-0400c7f53a0c admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:27.400377 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 531/1045] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:40:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:27.406570 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496e81e-689f-4f95-b964-0a667196eb04 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:27.417723 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496e81e-689f-4f95-b964-0a667196eb04 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:27.422309 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3d272-0cfa-49e2-9382-58aedc547d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:27.422933 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3d272-0cfa-49e2-9382-58aedc547d1b admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:27.423243 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3d272-0cfa-49e2-9382-58aedc547d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:27.423485 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3d272-0cfa-49e2-9382-58aedc547d1b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:27.424313 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3d272-0cfa-49e2-9382-58aedc547d1b admin admin] RBAC: Adding query filter params (role.id=401d03aa1ee442828aa97481f13b473c, scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1, user.id=77db235e2f7046e4bdbad7f31b5e3ebc) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:27.424618 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3d272-0cfa-49e2-9382-58aedc547d1b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:27.426655 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3d272-0cfa-49e2-9382-58aedc547d1b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:27.432874 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 515/1046] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:40:27 2022] GET /identity/v3/role_assignments?user.id=77db235e2f7046e4bdbad7f31b5e3ebc&scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1&role.id=401d03aa1ee442828aa97481f13b473c => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:40:27.506734 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657fb05-d302-4732-b516-7629927b96a6 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:27.507179 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657fb05-d302-4732-b516-7629927b96a6 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:27.507460 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657fb05-d302-4732-b516-7629927b96a6 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:27.509617 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 532/1047] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:27.516872 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096c67b-4d31-41c3-8eb0-b85b9f334548 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:27.517231 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096c67b-4d31-41c3-8eb0-b85b9f334548 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:27.517509 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096c67b-4d31-41c3-8eb0-b85b9f334548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:27.536616 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-6096c67b-4d31-41c3-8eb0-b85b9f334548 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:27.537922 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-6096c67b-4d31-41c3-8eb0-b85b9f334548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:27.546863 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 516/1048] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:27 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:27.570411 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657fb05-d302-4732-b516-7629927b96a6 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:27.583060 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657fb05-d302-4732-b516-7629927b96a6 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:27.587534 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65155f0-4274-4bf2-b8d9-2bd72feacffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:27.588194 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65155f0-4274-4bf2-b8d9-2bd72feacffe admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:27.588476 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65155f0-4274-4bf2-b8d9-2bd72feacffe admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:27.588755 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65155f0-4274-4bf2-b8d9-2bd72feacffe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:27.597536 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65155f0-4274-4bf2-b8d9-2bd72feacffe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:27.599337 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65155f0-4274-4bf2-b8d9-2bd72feacffe admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:27.610275 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 533/1049] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:40:27 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:40:27.616676 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096c67b-4d31-41c3-8eb0-b85b9f334548 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:27.627117 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096c67b-4d31-41c3-8eb0-b85b9f334548 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:27.631799 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41929cec-7869-43de-925c-220be2e8c950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:27.633328 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41929cec-7869-43de-925c-220be2e8c950 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:27.633705 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41929cec-7869-43de-925c-220be2e8c950 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:27.634050 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41929cec-7869-43de-925c-220be2e8c950 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:27.635345 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41929cec-7869-43de-925c-220be2e8c950 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:27.637175 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41929cec-7869-43de-925c-220be2e8c950 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:27.639116 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 517/1050] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:27.990542 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4a2e9-7ab9-4449-9713-8c02efc51c25 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:27.991080 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4a2e9-7ab9-4449-9713-8c02efc51c25 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:27.991080 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4a2e9-7ab9-4449-9713-8c02efc51c25 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:27.993512 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 534/1051] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:27.998859 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b7723-191d-4208-8787-ddd988151804 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:27.999300 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b7723-191d-4208-8787-ddd988151804 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:27.999394 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b7723-191d-4208-8787-ddd988151804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:28.018351 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-888b7723-191d-4208-8787-ddd988151804 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:28.019508 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-888b7723-191d-4208-8787-ddd988151804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:28.027029 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 518/1052] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:27 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:28.052386 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4a2e9-7ab9-4449-9713-8c02efc51c25 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:28.064845 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4a2e9-7ab9-4449-9713-8c02efc51c25 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:28.069190 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e049ae8f-02f9-496a-8622-7b2a2313eb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:28.069957 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049ae8f-02f9-496a-8622-7b2a2313eb1f admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:28.070887 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049ae8f-02f9-496a-8622-7b2a2313eb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:28.071165 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049ae8f-02f9-496a-8622-7b2a2313eb1f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:28.072336 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e049ae8f-02f9-496a-8622-7b2a2313eb1f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:28.074033 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e049ae8f-02f9-496a-8622-7b2a2313eb1f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:28.075567 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 535/1053] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:28.080780 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b7723-191d-4208-8787-ddd988151804 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:28.089519 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b7723-191d-4208-8787-ddd988151804 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:28.093944 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3cd1dd-5b48-49a4-b0aa-3ce43d0b6f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:28.094585 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cd1dd-5b48-49a4-b0aa-3ce43d0b6f1d admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:28.094862 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cd1dd-5b48-49a4-b0aa-3ce43d0b6f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:28.095134 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cd1dd-5b48-49a4-b0aa-3ce43d0b6f1d admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:28.095851 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3cd1dd-5b48-49a4-b0aa-3ce43d0b6f1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:28.097798 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3cd1dd-5b48-49a4-b0aa-3ce43d0b6f1d admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:28.171834 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 519/1054] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Jan 5 14:40:28 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 14:40:29.855447 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60ea99-1a6a-44b0-8e79-6f3fa1bc1390 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:29.855971 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60ea99-1a6a-44b0-8e79-6f3fa1bc1390 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:29.855971 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60ea99-1a6a-44b0-8e79-6f3fa1bc1390 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:29.857692 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 536/1055] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:29.862861 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39dca11-bfee-45db-9e88-a637c80ecd6d None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:29.863254 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39dca11-bfee-45db-9e88-a637c80ecd6d None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:29.863405 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39dca11-bfee-45db-9e88-a637c80ecd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:29.881388 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-d39dca11-bfee-45db-9e88-a637c80ecd6d None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:29.882590 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-d39dca11-bfee-45db-9e88-a637c80ecd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:29.890103 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 520/1056] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:29 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:29.915306 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60ea99-1a6a-44b0-8e79-6f3fa1bc1390 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:29.927305 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60ea99-1a6a-44b0-8e79-6f3fa1bc1390 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:29.932267 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951a6c1-a17d-43fb-a2c5-1a72294038f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:29.933054 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951a6c1-a17d-43fb-a2c5-1a72294038f5 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:29.933366 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951a6c1-a17d-43fb-a2c5-1a72294038f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:29.933642 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951a6c1-a17d-43fb-a2c5-1a72294038f5 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:29.943525 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951a6c1-a17d-43fb-a2c5-1a72294038f5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:40:29.951209 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-f951a6c1-a17d-43fb-a2c5-1a72294038f5 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 05 14:40:29.952477 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 537/1057] 10.222.0.30 () {56 vars in 1141 bytes} [Wed Jan 5 14:40:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:40:29.958074 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39dca11-bfee-45db-9e88-a637c80ecd6d None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:29.967770 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39dca11-bfee-45db-9e88-a637c80ecd6d None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:29.972246 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b72e67-53a4-489a-be4a-709a3919a20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:29.972899 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b72e67-53a4-489a-be4a-709a3919a20d admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:29.973216 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b72e67-53a4-489a-be4a-709a3919a20d admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:29.973489 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b72e67-53a4-489a-be4a-709a3919a20d admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:29.974241 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b72e67-53a4-489a-be4a-709a3919a20d admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:29.974543 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b72e67-53a4-489a-be4a-709a3919a20d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:29.976143 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b72e67-53a4-489a-be4a-709a3919a20d admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:29.995925 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 521/1058] 10.222.0.30 () {56 vars in 1136 bytes} [Wed Jan 5 14:40:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:30.002718 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951a6c1-a17d-43fb-a2c5-1a72294038f5 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:30.017519 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951a6c1-a17d-43fb-a2c5-1a72294038f5 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:30.022227 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46021f1d-d541-4dc5-a3ce-ec50caa9a979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:30.023001 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46021f1d-d541-4dc5-a3ce-ec50caa9a979 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:30.023850 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46021f1d-d541-4dc5-a3ce-ec50caa9a979 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:30.024134 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46021f1d-d541-4dc5-a3ce-ec50caa9a979 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:30.034693 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46021f1d-d541-4dc5-a3ce-ec50caa9a979 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:30.036544 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46021f1d-d541-4dc5-a3ce-ec50caa9a979 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:30.053985 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-46021f1d-d541-4dc5-a3ce-ec50caa9a979 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:40:30.055691 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 538/1059] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:30.061478 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b72e67-53a4-489a-be4a-709a3919a20d admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:30.071713 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b72e67-53a4-489a-be4a-709a3919a20d admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:30.076295 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6c09f-eb71-40d3-b2be-bb574f9b03d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:30.077010 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6c09f-eb71-40d3-b2be-bb574f9b03d2 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:30.077406 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6c09f-eb71-40d3-b2be-bb574f9b03d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:30.077754 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6c09f-eb71-40d3-b2be-bb574f9b03d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:30.078550 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6c09f-eb71-40d3-b2be-bb574f9b03d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:30.078924 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6c09f-eb71-40d3-b2be-bb574f9b03d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:30.080577 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6c09f-eb71-40d3-b2be-bb574f9b03d2 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:30.092326 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 522/1060] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:30.097718 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46021f1d-d541-4dc5-a3ce-ec50caa9a979 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:30.107249 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46021f1d-d541-4dc5-a3ce-ec50caa9a979 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:30.111690 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79717e-53ea-4600-96e5-10847362b94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:30.112465 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79717e-53ea-4600-96e5-10847362b94a admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:30.112750 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79717e-53ea-4600-96e5-10847362b94a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:30.113027 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79717e-53ea-4600-96e5-10847362b94a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:30.120645 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c79717e-53ea-4600-96e5-10847362b94a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:30.122675 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c79717e-53ea-4600-96e5-10847362b94a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:30.137171 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-9c79717e-53ea-4600-96e5-10847362b94a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 05 14:40:30.138308 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 539/1061] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Jan 5 14:40:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:30.143934 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6c09f-eb71-40d3-b2be-bb574f9b03d2 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:30.153459 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6c09f-eb71-40d3-b2be-bb574f9b03d2 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:30.157919 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565038d-25b4-4b98-bd84-5cd0fe58daec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:30.158563 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565038d-25b4-4b98-bd84-5cd0fe58daec admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:30.158844 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565038d-25b4-4b98-bd84-5cd0fe58daec admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:30.159117 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565038d-25b4-4b98-bd84-5cd0fe58daec admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:30.159955 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565038d-25b4-4b98-bd84-5cd0fe58daec admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:30.160261 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565038d-25b4-4b98-bd84-5cd0fe58daec admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:30.162158 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565038d-25b4-4b98-bd84-5cd0fe58daec admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:30.181719 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 523/1062] 10.222.0.30 () {56 vars in 1154 bytes} [Wed Jan 5 14:40:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:40:30.187489 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79717e-53ea-4600-96e5-10847362b94a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:30.198021 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79717e-53ea-4600-96e5-10847362b94a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:30.202578 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2734ca8-396b-4eb3-801f-21e5525b2039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:30.203358 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2734ca8-396b-4eb3-801f-21e5525b2039 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:30.203643 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2734ca8-396b-4eb3-801f-21e5525b2039 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:30.203920 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2734ca8-396b-4eb3-801f-21e5525b2039 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:30.214459 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2734ca8-396b-4eb3-801f-21e5525b2039 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:30.216286 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2734ca8-396b-4eb3-801f-21e5525b2039 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:30.233403 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-e2734ca8-396b-4eb3-801f-21e5525b2039 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:40:30.234562 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 540/1063] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:30.240377 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565038d-25b4-4b98-bd84-5cd0fe58daec admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:30.250178 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565038d-25b4-4b98-bd84-5cd0fe58daec admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:30.254948 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780af1b4-47ff-48a8-b026-877791b39fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:30.255588 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780af1b4-47ff-48a8-b026-877791b39fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:30.255872 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780af1b4-47ff-48a8-b026-877791b39fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:30.256149 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780af1b4-47ff-48a8-b026-877791b39fb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:30.256881 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780af1b4-47ff-48a8-b026-877791b39fb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:30.257218 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780af1b4-47ff-48a8-b026-877791b39fb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:30.258816 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780af1b4-47ff-48a8-b026-877791b39fb4 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:30.269851 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 524/1064] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:30.275730 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2734ca8-396b-4eb3-801f-21e5525b2039 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:30.285316 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2734ca8-396b-4eb3-801f-21e5525b2039 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:30.290428 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff90cd-be92-4dfc-aea7-fe52af77094d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:30.291194 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff90cd-be92-4dfc-aea7-fe52af77094d admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:30.291475 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff90cd-be92-4dfc-aea7-fe52af77094d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:30.291747 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff90cd-be92-4dfc-aea7-fe52af77094d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:30.298418 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff90cd-be92-4dfc-aea7-fe52af77094d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:30.300360 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff90cd-be92-4dfc-aea7-fe52af77094d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:30.313179 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-26ff90cd-be92-4dfc-aea7-fe52af77094d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:40:30.318766 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 541/1065] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:40:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:30.319966 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780af1b4-47ff-48a8-b026-877791b39fb4 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:30.329639 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780af1b4-47ff-48a8-b026-877791b39fb4 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:30.334162 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40ca4e-3089-4cf2-b462-40a3adec0f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:30.334802 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40ca4e-3089-4cf2-b462-40a3adec0f42 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:30.335086 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40ca4e-3089-4cf2-b462-40a3adec0f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:30.335394 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40ca4e-3089-4cf2-b462-40a3adec0f42 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:30.336691 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40ca4e-3089-4cf2-b462-40a3adec0f42 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:30.336999 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40ca4e-3089-4cf2-b462-40a3adec0f42 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:30.338909 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40ca4e-3089-4cf2-b462-40a3adec0f42 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:30.350645 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 525/1066] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:40:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:30.360602 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff90cd-be92-4dfc-aea7-fe52af77094d admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:30.370885 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff90cd-be92-4dfc-aea7-fe52af77094d admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:30.375414 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172cd3f-4fb4-4112-ad38-f77da781bf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:30.376956 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172cd3f-4fb4-4112-ad38-f77da781bf6a admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:30.377272 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172cd3f-4fb4-4112-ad38-f77da781bf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:30.377555 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172cd3f-4fb4-4112-ad38-f77da781bf6a admin admin] PATH_INFO: `/v3/projects/fbf90e947f3a4fcdb6f42646a4bf34a1/users/77db235e2f7046e4bdbad7f31b5e3ebc/roles/401d03aa1ee442828aa97481f13b473c` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:30.379844 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1172cd3f-4fb4-4112-ad38-f77da781bf6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf90e947f3a4fcdb6f42646a4bf34a1, user_id=77db235e2f7046e4bdbad7f31b5e3ebc, role_id=401d03aa1ee442828aa97481f13b473c)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:30.382621 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1172cd3f-4fb4-4112-ad38-f77da781bf6a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:30.456366 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 542/1067] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Jan 5 14:40:30 2022] PUT /identity/v3/projects/fbf90e947f3a4fcdb6f42646a4bf34a1/users/77db235e2f7046e4bdbad7f31b5e3ebc/roles/401d03aa1ee442828aa97481f13b473c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 14:40:30.622190 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41380d5e-684f-4b9e-9433-b92e4defe96b None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:30.622514 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41380d5e-684f-4b9e-9433-b92e4defe96b None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:30.622805 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41380d5e-684f-4b9e-9433-b92e4defe96b None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:30.624633 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 526/1068] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:30.630898 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28e98a-bc79-4291-88fb-3f7b581ca629 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:30.631183 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28e98a-bc79-4291-88fb-3f7b581ca629 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:30.631462 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28e98a-bc79-4291-88fb-3f7b581ca629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:30.650565 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-df28e98a-bc79-4291-88fb-3f7b581ca629 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:30.651759 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-df28e98a-bc79-4291-88fb-3f7b581ca629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:30.707902 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 543/1069] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:30 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:30.733011 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41380d5e-684f-4b9e-9433-b92e4defe96b None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:30.745818 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41380d5e-684f-4b9e-9433-b92e4defe96b None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:30.750154 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a044f19-4b8c-4529-a665-06aee12a5b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:30.751185 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a044f19-4b8c-4529-a665-06aee12a5b15 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:30.751470 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a044f19-4b8c-4529-a665-06aee12a5b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:30.751743 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a044f19-4b8c-4529-a665-06aee12a5b15 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:30.761743 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a044f19-4b8c-4529-a665-06aee12a5b15 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:40:30.768714 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-5a044f19-4b8c-4529-a665-06aee12a5b15 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 05 14:40:30.769900 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 527/1070] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:40:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:30.775920 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28e98a-bc79-4291-88fb-3f7b581ca629 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:30.784693 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28e98a-bc79-4291-88fb-3f7b581ca629 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:30.789696 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40f6c5-6eae-41ba-a350-7f0baba96699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:30.790353 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40f6c5-6eae-41ba-a350-7f0baba96699 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:30.790635 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40f6c5-6eae-41ba-a350-7f0baba96699 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:30.790907 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40f6c5-6eae-41ba-a350-7f0baba96699 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:30.791654 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40f6c5-6eae-41ba-a350-7f0baba96699 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:30.791953 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40f6c5-6eae-41ba-a350-7f0baba96699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:30.793559 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40f6c5-6eae-41ba-a350-7f0baba96699 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:30.801542 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 544/1071] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:40:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:30.807934 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a044f19-4b8c-4529-a665-06aee12a5b15 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:30.818005 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a044f19-4b8c-4529-a665-06aee12a5b15 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:30.822493 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b85165-aa8a-4618-bfd9-7ca0ad9aaacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:30.823333 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b85165-aa8a-4618-bfd9-7ca0ad9aaacd admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:30.823617 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b85165-aa8a-4618-bfd9-7ca0ad9aaacd admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:30.823894 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b85165-aa8a-4618-bfd9-7ca0ad9aaacd admin admin] PATH_INFO: `/v3/users/87b286579fbc4185bf12b950760b4e89` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:30.837329 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b85165-aa8a-4618-bfd9-7ca0ad9aaacd admin admin] RBAC: Authorizing `identity:get_user(user_id=87b286579fbc4185bf12b950760b4e89)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:30.839470 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b85165-aa8a-4618-bfd9-7ca0ad9aaacd admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:30.841123 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 528/1072] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:40:30 2022] GET /identity/v3/users/87b286579fbc4185bf12b950760b4e89 => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:30.846619 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40f6c5-6eae-41ba-a350-7f0baba96699 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:30.857817 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40f6c5-6eae-41ba-a350-7f0baba96699 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:30.862345 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7bfb1-fbb6-4a48-a127-7103331e83fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:30.862980 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7bfb1-fbb6-4a48-a127-7103331e83fd admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:30.863262 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7bfb1-fbb6-4a48-a127-7103331e83fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:30.863535 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7bfb1-fbb6-4a48-a127-7103331e83fd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:30.871250 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7bfb1-fbb6-4a48-a127-7103331e83fd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:30.873038 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7bfb1-fbb6-4a48-a127-7103331e83fd admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:30.881891 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 545/1073] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:40:30 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:40:30.887814 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b85165-aa8a-4618-bfd9-7ca0ad9aaacd admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:30.897362 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b85165-aa8a-4618-bfd9-7ca0ad9aaacd admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:30.902383 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6f995-bccf-45b5-a045-7a416eb12fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:30.903230 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6f995-bccf-45b5-a045-7a416eb12fbf admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:30.903517 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6f995-bccf-45b5-a045-7a416eb12fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:30.903795 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6f995-bccf-45b5-a045-7a416eb12fbf admin admin] PATH_INFO: `/v3/projects/b20b7d9af53a485fadbb7d8027379efd` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:30.904973 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6f995-bccf-45b5-a045-7a416eb12fbf admin admin] RBAC: Authorizing `identity:get_project(project_id=b20b7d9af53a485fadbb7d8027379efd)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:30.907051 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6f995-bccf-45b5-a045-7a416eb12fbf admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:30.908685 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 529/1074] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:40:30 2022] GET /identity/v3/projects/b20b7d9af53a485fadbb7d8027379efd => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:30.914578 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7bfb1-fbb6-4a48-a127-7103331e83fd admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:30.923159 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7bfb1-fbb6-4a48-a127-7103331e83fd admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:30.927608 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b9579-a3b1-428a-b57c-d974479a52a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:30.928229 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b9579-a3b1-428a-b57c-d974479a52a2 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:30.928506 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b9579-a3b1-428a-b57c-d974479a52a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:30.928778 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b9579-a3b1-428a-b57c-d974479a52a2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:30.930227 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b9579-a3b1-428a-b57c-d974479a52a2 admin admin] RBAC: Adding query filter params (role.id=494131614fcf424f92e0817fa7ff6961, scope.project.id=b20b7d9af53a485fadbb7d8027379efd, user.id=87b286579fbc4185bf12b950760b4e89) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:30.930533 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b9579-a3b1-428a-b57c-d974479a52a2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:30.932348 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b9579-a3b1-428a-b57c-d974479a52a2 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:30.937641 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 546/1075] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:40:30 2022] GET /identity/v3/role_assignments?user.id=87b286579fbc4185bf12b950760b4e89&scope.project.id=b20b7d9af53a485fadbb7d8027379efd&role.id=494131614fcf424f92e0817fa7ff6961 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:32.821656 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c128f69-14da-4479-b279-4be47991feeb None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:32.822153 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c128f69-14da-4479-b279-4be47991feeb None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:32.822153 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c128f69-14da-4479-b279-4be47991feeb None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:32.823901 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 530/1076] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:32.829130 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617713a-6552-4789-a6ca-5c45e79ba289 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:32.829552 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617713a-6552-4789-a6ca-5c45e79ba289 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:32.829703 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617713a-6552-4789-a6ca-5c45e79ba289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:32.847437 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-5617713a-6552-4789-a6ca-5c45e79ba289 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:32.848650 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-5617713a-6552-4789-a6ca-5c45e79ba289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:32.857173 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 547/1077] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:32 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:32.886069 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c128f69-14da-4479-b279-4be47991feeb None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:32.898153 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c128f69-14da-4479-b279-4be47991feeb None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:32.902504 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742a06a-9f4c-47fc-8db0-c6b56f650862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:32.903294 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742a06a-9f4c-47fc-8db0-c6b56f650862 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:32.903576 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742a06a-9f4c-47fc-8db0-c6b56f650862 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:32.903853 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742a06a-9f4c-47fc-8db0-c6b56f650862 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:32.914312 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742a06a-9f4c-47fc-8db0-c6b56f650862 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:40:32.921898 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-8742a06a-9f4c-47fc-8db0-c6b56f650862 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 05 14:40:32.923100 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 531/1078] 10.222.0.30 () {56 vars in 1141 bytes} [Wed Jan 5 14:40:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:32.929041 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617713a-6552-4789-a6ca-5c45e79ba289 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:32.938562 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617713a-6552-4789-a6ca-5c45e79ba289 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:32.943011 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cb86b-ff4c-4dd9-9a2f-ea7eca3b22f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:32.943669 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cb86b-ff4c-4dd9-9a2f-ea7eca3b22f1 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:32.943942 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cb86b-ff4c-4dd9-9a2f-ea7eca3b22f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:32.944215 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cb86b-ff4c-4dd9-9a2f-ea7eca3b22f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:32.944966 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cb86b-ff4c-4dd9-9a2f-ea7eca3b22f1 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:32.945307 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cb86b-ff4c-4dd9-9a2f-ea7eca3b22f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:32.946881 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cb86b-ff4c-4dd9-9a2f-ea7eca3b22f1 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:32.955008 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 548/1079] 10.222.0.30 () {56 vars in 1136 bytes} [Wed Jan 5 14:40:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:32.960589 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742a06a-9f4c-47fc-8db0-c6b56f650862 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:32.970666 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742a06a-9f4c-47fc-8db0-c6b56f650862 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:32.975144 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20974bc5-71d0-4505-b504-03705be59000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:32.975959 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20974bc5-71d0-4505-b504-03705be59000 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:32.976738 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20974bc5-71d0-4505-b504-03705be59000 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:32.977012 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20974bc5-71d0-4505-b504-03705be59000 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:32.986895 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20974bc5-71d0-4505-b504-03705be59000 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:32.988725 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20974bc5-71d0-4505-b504-03705be59000 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:33.007545 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-20974bc5-71d0-4505-b504-03705be59000 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:40:33.008831 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 532/1080] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:33.014785 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cb86b-ff4c-4dd9-9a2f-ea7eca3b22f1 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:33.024868 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cb86b-ff4c-4dd9-9a2f-ea7eca3b22f1 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:33.029628 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc468d-16a9-43af-92b0-590150ab2c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:33.030333 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc468d-16a9-43af-92b0-590150ab2c46 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:33.030614 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc468d-16a9-43af-92b0-590150ab2c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:33.032970 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc468d-16a9-43af-92b0-590150ab2c46 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:33.032970 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc468d-16a9-43af-92b0-590150ab2c46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:33.032970 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc468d-16a9-43af-92b0-590150ab2c46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:33.033500 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc468d-16a9-43af-92b0-590150ab2c46 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:33.046010 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 549/1081] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:40:33.051412 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20974bc5-71d0-4505-b504-03705be59000 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:33.061856 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20974bc5-71d0-4505-b504-03705be59000 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:33.066442 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453818c3-fcba-4d09-9705-931fe427f873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:33.067263 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453818c3-fcba-4d09-9705-931fe427f873 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:33.067547 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453818c3-fcba-4d09-9705-931fe427f873 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:33.067822 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453818c3-fcba-4d09-9705-931fe427f873 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:33.075176 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453818c3-fcba-4d09-9705-931fe427f873 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:33.077283 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453818c3-fcba-4d09-9705-931fe427f873 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:33.091542 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-453818c3-fcba-4d09-9705-931fe427f873 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 05 14:40:33.092667 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 533/1082] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Jan 5 14:40:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:33.098428 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc468d-16a9-43af-92b0-590150ab2c46 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:33.108815 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc468d-16a9-43af-92b0-590150ab2c46 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:33.113357 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcfcb2-7a37-4363-9221-46d77652b39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:33.114007 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcfcb2-7a37-4363-9221-46d77652b39e admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:33.114289 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcfcb2-7a37-4363-9221-46d77652b39e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:33.114566 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcfcb2-7a37-4363-9221-46d77652b39e admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:33.115402 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcfcb2-7a37-4363-9221-46d77652b39e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:33.115707 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcfcb2-7a37-4363-9221-46d77652b39e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:33.117601 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcfcb2-7a37-4363-9221-46d77652b39e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:33.178681 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 550/1083] 10.222.0.30 () {56 vars in 1154 bytes} [Wed Jan 5 14:40:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:33.184415 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453818c3-fcba-4d09-9705-931fe427f873 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:33.194445 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453818c3-fcba-4d09-9705-931fe427f873 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:33.199205 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761c444-887c-476c-aaf2-9849f48bca37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:33.199832 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761c444-887c-476c-aaf2-9849f48bca37 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:33.200190 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761c444-887c-476c-aaf2-9849f48bca37 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:33.200471 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761c444-887c-476c-aaf2-9849f48bca37 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:33.208180 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761c444-887c-476c-aaf2-9849f48bca37 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:33.210027 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761c444-887c-476c-aaf2-9849f48bca37 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:33.219404 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 534/1084] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:40:33 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:40:33.225022 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcfcb2-7a37-4363-9221-46d77652b39e admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:33.235391 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcfcb2-7a37-4363-9221-46d77652b39e admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:33.240018 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55fb587-b4c4-4bf7-88c3-5c7be48c768e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:33.240792 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fb587-b4c4-4bf7-88c3-5c7be48c768e admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:33.241083 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fb587-b4c4-4bf7-88c3-5c7be48c768e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:33.241378 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fb587-b4c4-4bf7-88c3-5c7be48c768e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:33.251549 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55fb587-b4c4-4bf7-88c3-5c7be48c768e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:33.253385 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55fb587-b4c4-4bf7-88c3-5c7be48c768e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:33.269582 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-b55fb587-b4c4-4bf7-88c3-5c7be48c768e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:40:33.270748 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 551/1085] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:33.276856 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761c444-887c-476c-aaf2-9849f48bca37 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:33.285739 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761c444-887c-476c-aaf2-9849f48bca37 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:33.290886 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056021cf-4da0-469f-ab55-d1e08877b081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:33.291525 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056021cf-4da0-469f-ab55-d1e08877b081 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:33.291811 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056021cf-4da0-469f-ab55-d1e08877b081 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:33.292088 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056021cf-4da0-469f-ab55-d1e08877b081 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:33.292813 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056021cf-4da0-469f-ab55-d1e08877b081 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:33.293146 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056021cf-4da0-469f-ab55-d1e08877b081 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:33.294739 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056021cf-4da0-469f-ab55-d1e08877b081 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:33.303969 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6260122-ba94-4dbc-b339-18a8e1c0854f None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:33.304256 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6260122-ba94-4dbc-b339-18a8e1c0854f None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:33.304652 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6260122-ba94-4dbc-b339-18a8e1c0854f None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:33.305999 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 535/1086] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:40:33.306817 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 552/1087] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 14:40:33.311508 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6260122-ba94-4dbc-b339-18a8e1c0854f None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:33.311940 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b3bdb-9046-4143-b252-c82017f9eaed None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:33.312239 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b3bdb-9046-4143-b252-c82017f9eaed None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:33.312523 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b3bdb-9046-4143-b252-c82017f9eaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:33.324238 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6260122-ba94-4dbc-b339-18a8e1c0854f None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:33.328733 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92580f6b-4ad7-4d21-b766-367bffbaa53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:33.329488 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92580f6b-4ad7-4d21-b766-367bffbaa53e admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:33.329769 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92580f6b-4ad7-4d21-b766-367bffbaa53e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:33.330042 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92580f6b-4ad7-4d21-b766-367bffbaa53e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:33.332058 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-893b3bdb-9046-4143-b252-c82017f9eaed None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:33.333276 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-893b3bdb-9046-4143-b252-c82017f9eaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:33.337346 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92580f6b-4ad7-4d21-b766-367bffbaa53e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:33.339292 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92580f6b-4ad7-4d21-b766-367bffbaa53e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:33.341748 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 536/1088] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:33 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:33.352718 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-92580f6b-4ad7-4d21-b766-367bffbaa53e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:40:33.358606 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 553/1089] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:40:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:33.359617 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b3bdb-9046-4143-b252-c82017f9eaed None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:33.366611 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92580f6b-4ad7-4d21-b766-367bffbaa53e admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:33.369601 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b3bdb-9046-4143-b252-c82017f9eaed None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:33.374165 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4cf7c-4e18-440c-8e16-8fd1d17dc529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:33.374887 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4cf7c-4e18-440c-8e16-8fd1d17dc529 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:33.375173 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4cf7c-4e18-440c-8e16-8fd1d17dc529 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:33.375446 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4cf7c-4e18-440c-8e16-8fd1d17dc529 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:33.376455 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92580f6b-4ad7-4d21-b766-367bffbaa53e admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:33.376567 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4cf7c-4e18-440c-8e16-8fd1d17dc529 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:33.376793 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4cf7c-4e18-440c-8e16-8fd1d17dc529 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:33.378675 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4cf7c-4e18-440c-8e16-8fd1d17dc529 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:33.380850 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131ba4a-648f-474c-9c16-49ce7815a460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:33.381626 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131ba4a-648f-474c-9c16-49ce7815a460 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:33.381903 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131ba4a-648f-474c-9c16-49ce7815a460 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:33.382170 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131ba4a-648f-474c-9c16-49ce7815a460 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:33.390086 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 537/1090] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:40:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:33.392101 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131ba4a-648f-474c-9c16-49ce7815a460 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:40:33.395905 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4cf7c-4e18-440c-8e16-8fd1d17dc529 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:33.399628 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-a131ba4a-648f-474c-9c16-49ce7815a460 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 05 14:40:33.400762 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 554/1091] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:40:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:40:33.405564 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4cf7c-4e18-440c-8e16-8fd1d17dc529 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:33.406545 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131ba4a-648f-474c-9c16-49ce7815a460 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:33.410099 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154f4ee-e404-4fb4-9699-4ed07c4657ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:33.410715 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154f4ee-e404-4fb4-9699-4ed07c4657ec admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:33.411002 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154f4ee-e404-4fb4-9699-4ed07c4657ec admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:33.411460 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154f4ee-e404-4fb4-9699-4ed07c4657ec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:33.412293 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d154f4ee-e404-4fb4-9699-4ed07c4657ec admin admin] RBAC: Adding query filter params (role.id=401d03aa1ee442828aa97481f13b473c, scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1, user.id=77db235e2f7046e4bdbad7f31b5e3ebc) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:33.412607 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d154f4ee-e404-4fb4-9699-4ed07c4657ec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:33.414566 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d154f4ee-e404-4fb4-9699-4ed07c4657ec admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:33.415747 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131ba4a-648f-474c-9c16-49ce7815a460 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:33.430252 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 538/1092] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:40:33 2022] GET /identity/v3/role_assignments?user.id=77db235e2f7046e4bdbad7f31b5e3ebc&scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1&role.id=401d03aa1ee442828aa97481f13b473c => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:40:33.430536 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b87e2-b7ec-4e93-b6ba-9afde876c389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:33.430536 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b87e2-b7ec-4e93-b6ba-9afde876c389 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:33.430536 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b87e2-b7ec-4e93-b6ba-9afde876c389 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:33.430536 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b87e2-b7ec-4e93-b6ba-9afde876c389 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:33.430887 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b87e2-b7ec-4e93-b6ba-9afde876c389 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:33.430887 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b87e2-b7ec-4e93-b6ba-9afde876c389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:33.430887 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b87e2-b7ec-4e93-b6ba-9afde876c389 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:33.433880 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 555/1093] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:40:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:40:33.440251 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154f4ee-e404-4fb4-9699-4ed07c4657ec admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:33.450866 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154f4ee-e404-4fb4-9699-4ed07c4657ec admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:33.455604 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b65999-fef2-4b69-a3b3-78fc98323bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:33.456488 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b65999-fef2-4b69-a3b3-78fc98323bbf admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:33.456772 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b65999-fef2-4b69-a3b3-78fc98323bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:33.457048 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b65999-fef2-4b69-a3b3-78fc98323bbf admin admin] PATH_INFO: `/v3/users/87b286579fbc4185bf12b950760b4e89` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:33.458346 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b65999-fef2-4b69-a3b3-78fc98323bbf admin admin] RBAC: Authorizing `identity:get_user(user_id=87b286579fbc4185bf12b950760b4e89)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:33.460509 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b65999-fef2-4b69-a3b3-78fc98323bbf admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:33.462464 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 539/1094] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:40:33 2022] GET /identity/v3/users/87b286579fbc4185bf12b950760b4e89 => generated 285 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:33.468286 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b87e2-b7ec-4e93-b6ba-9afde876c389 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:33.478837 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b87e2-b7ec-4e93-b6ba-9afde876c389 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:33.483581 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41a961-00a2-4fd6-8c6e-704e39c3b863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:33.484475 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41a961-00a2-4fd6-8c6e-704e39c3b863 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:33.484759 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41a961-00a2-4fd6-8c6e-704e39c3b863 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:33.485036 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41a961-00a2-4fd6-8c6e-704e39c3b863 admin admin] PATH_INFO: `/v3/projects/b20b7d9af53a485fadbb7d8027379efd` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:33.486324 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff41a961-00a2-4fd6-8c6e-704e39c3b863 admin admin] RBAC: Authorizing `identity:get_project(project_id=b20b7d9af53a485fadbb7d8027379efd)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:33.488441 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff41a961-00a2-4fd6-8c6e-704e39c3b863 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:33.490403 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 556/1095] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:40:33 2022] GET /identity/v3/projects/b20b7d9af53a485fadbb7d8027379efd => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:33.497341 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b65999-fef2-4b69-a3b3-78fc98323bbf admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:33.507694 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b65999-fef2-4b69-a3b3-78fc98323bbf admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:33.512434 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab0b5f-dfbe-43fb-ba18-0e04fb31e4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:33.513359 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab0b5f-dfbe-43fb-ba18-0e04fb31e4d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:33.513640 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab0b5f-dfbe-43fb-ba18-0e04fb31e4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:33.513913 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab0b5f-dfbe-43fb-ba18-0e04fb31e4d9 admin admin] PATH_INFO: `/v3/projects/b20b7d9af53a485fadbb7d8027379efd/users/87b286579fbc4185bf12b950760b4e89/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:33.515914 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab0b5f-dfbe-43fb-ba18-0e04fb31e4d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b20b7d9af53a485fadbb7d8027379efd, user_id=87b286579fbc4185bf12b950760b4e89, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:33.518644 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab0b5f-dfbe-43fb-ba18-0e04fb31e4d9 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:33.592123 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 540/1096] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Jan 5 14:40:33 2022] PUT /identity/v3/projects/b20b7d9af53a485fadbb7d8027379efd/users/87b286579fbc4185bf12b950760b4e89/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:40:35.947825 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ee06b-4dd5-47e1-b557-f4eec9b8c869 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:35.948377 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ee06b-4dd5-47e1-b557-f4eec9b8c869 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:35.948377 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ee06b-4dd5-47e1-b557-f4eec9b8c869 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:35.950238 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 557/1097] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:35.955340 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c35a8-ea09-4569-a4ba-82a9ebbaca41 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:35.955716 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c35a8-ea09-4569-a4ba-82a9ebbaca41 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:35.955894 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c35a8-ea09-4569-a4ba-82a9ebbaca41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:35.973219 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-c18c35a8-ea09-4569-a4ba-82a9ebbaca41 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:35.974395 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-c18c35a8-ea09-4569-a4ba-82a9ebbaca41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:36.029626 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 541/1098] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:35 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:36.055034 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ee06b-4dd5-47e1-b557-f4eec9b8c869 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:36.067786 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ee06b-4dd5-47e1-b557-f4eec9b8c869 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:36.072152 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d555d-e72e-4174-b6a6-c8d11efe15e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:36.072921 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d555d-e72e-4174-b6a6-c8d11efe15e8 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:36.073235 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d555d-e72e-4174-b6a6-c8d11efe15e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:36.073510 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d555d-e72e-4174-b6a6-c8d11efe15e8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:36.083292 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d555d-e72e-4174-b6a6-c8d11efe15e8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:40:36.090938 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-175d555d-e72e-4174-b6a6-c8d11efe15e8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 05 14:40:36.092064 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 558/1099] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:40:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:36.097929 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c35a8-ea09-4569-a4ba-82a9ebbaca41 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:36.107210 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c35a8-ea09-4569-a4ba-82a9ebbaca41 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:36.111645 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a3947-e159-4a74-92b7-6c6bc40523e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:36.112284 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a3947-e159-4a74-92b7-6c6bc40523e6 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:36.112564 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a3947-e159-4a74-92b7-6c6bc40523e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:36.112860 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a3947-e159-4a74-92b7-6c6bc40523e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:36.113652 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a3947-e159-4a74-92b7-6c6bc40523e6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:36.113955 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a3947-e159-4a74-92b7-6c6bc40523e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:36.115547 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a3947-e159-4a74-92b7-6c6bc40523e6 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:36.123403 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 542/1100] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:40:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:36.128912 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d555d-e72e-4174-b6a6-c8d11efe15e8 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:36.138706 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d555d-e72e-4174-b6a6-c8d11efe15e8 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:36.143160 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd697890-ce7e-4e48-b2bd-f61be23065ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:36.143969 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd697890-ce7e-4e48-b2bd-f61be23065ea admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:36.144248 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd697890-ce7e-4e48-b2bd-f61be23065ea admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:36.144518 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd697890-ce7e-4e48-b2bd-f61be23065ea admin admin] PATH_INFO: `/v3/users/87b286579fbc4185bf12b950760b4e89` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:36.145729 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd697890-ce7e-4e48-b2bd-f61be23065ea admin admin] RBAC: Authorizing `identity:get_user(user_id=87b286579fbc4185bf12b950760b4e89)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:36.147823 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd697890-ce7e-4e48-b2bd-f61be23065ea admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:36.149868 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 559/1101] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:40:36 2022] GET /identity/v3/users/87b286579fbc4185bf12b950760b4e89 => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:36.154973 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a3947-e159-4a74-92b7-6c6bc40523e6 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:36.164537 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a3947-e159-4a74-92b7-6c6bc40523e6 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:36.168907 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cfd66-c002-4212-b4c8-cbc5b8134014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:36.169544 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cfd66-c002-4212-b4c8-cbc5b8134014 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:36.169823 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cfd66-c002-4212-b4c8-cbc5b8134014 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:36.170094 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cfd66-c002-4212-b4c8-cbc5b8134014 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:36.177446 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cfd66-c002-4212-b4c8-cbc5b8134014 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:36.179129 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cfd66-c002-4212-b4c8-cbc5b8134014 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:36.187560 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 543/1102] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:40:36 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:40:36.192602 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd697890-ce7e-4e48-b2bd-f61be23065ea admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:36.201698 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd697890-ce7e-4e48-b2bd-f61be23065ea admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:36.206119 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a7c5d-a051-486f-b496-f3b969d2604d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:36.206910 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a7c5d-a051-486f-b496-f3b969d2604d admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:36.207191 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a7c5d-a051-486f-b496-f3b969d2604d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:36.207462 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a7c5d-a051-486f-b496-f3b969d2604d admin admin] PATH_INFO: `/v3/projects/b20b7d9af53a485fadbb7d8027379efd` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:36.208608 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a7c5d-a051-486f-b496-f3b969d2604d admin admin] RBAC: Authorizing `identity:get_project(project_id=b20b7d9af53a485fadbb7d8027379efd)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:36.211112 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a7c5d-a051-486f-b496-f3b969d2604d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:36.212671 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 560/1103] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:40:36 2022] GET /identity/v3/projects/b20b7d9af53a485fadbb7d8027379efd => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:36.217985 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cfd66-c002-4212-b4c8-cbc5b8134014 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:36.226755 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cfd66-c002-4212-b4c8-cbc5b8134014 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:36.231195 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a91bac-3878-4a46-a74c-a2ca87d1c0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:36.231781 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a91bac-3878-4a46-a74c-a2ca87d1c0ff admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:36.232059 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a91bac-3878-4a46-a74c-a2ca87d1c0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:36.232330 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a91bac-3878-4a46-a74c-a2ca87d1c0ff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:36.233165 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a91bac-3878-4a46-a74c-a2ca87d1c0ff admin admin] RBAC: Adding query filter params (role.id=494131614fcf424f92e0817fa7ff6961, scope.project.id=b20b7d9af53a485fadbb7d8027379efd, user.id=87b286579fbc4185bf12b950760b4e89) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:36.233473 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a91bac-3878-4a46-a74c-a2ca87d1c0ff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:36.235231 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a91bac-3878-4a46-a74c-a2ca87d1c0ff admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:36.240671 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 544/1104] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:40:36 2022] GET /identity/v3/role_assignments?user.id=87b286579fbc4185bf12b950760b4e89&scope.project.id=b20b7d9af53a485fadbb7d8027379efd&role.id=494131614fcf424f92e0817fa7ff6961 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:38.614834 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427aadfe-4f9e-4a9b-9f45-192e1cbd4da3 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:38.615379 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427aadfe-4f9e-4a9b-9f45-192e1cbd4da3 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:38.615379 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427aadfe-4f9e-4a9b-9f45-192e1cbd4da3 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:38.617687 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 561/1105] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:38.622878 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee37341-2022-4385-920c-5578158b8216 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:38.623272 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee37341-2022-4385-920c-5578158b8216 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:38.623434 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee37341-2022-4385-920c-5578158b8216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:38.642289 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-eee37341-2022-4385-920c-5578158b8216 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:38.643456 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-eee37341-2022-4385-920c-5578158b8216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:38.651548 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 545/1106] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:38 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:38.676989 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427aadfe-4f9e-4a9b-9f45-192e1cbd4da3 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:38.688795 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427aadfe-4f9e-4a9b-9f45-192e1cbd4da3 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:38.693159 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75189e3f-7595-4823-aacb-49a3e6013312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:38.693920 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75189e3f-7595-4823-aacb-49a3e6013312 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:38.694203 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75189e3f-7595-4823-aacb-49a3e6013312 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:38.694478 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75189e3f-7595-4823-aacb-49a3e6013312 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:38.696153 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75189e3f-7595-4823-aacb-49a3e6013312 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:38.697869 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75189e3f-7595-4823-aacb-49a3e6013312 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:38.699399 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 562/1107] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:38.704955 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee37341-2022-4385-920c-5578158b8216 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:38.713604 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee37341-2022-4385-920c-5578158b8216 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:38.717996 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c16f1-4a34-4525-ad7c-ef6ca6453910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:38.718627 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c16f1-4a34-4525-ad7c-ef6ca6453910 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:38.718905 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c16f1-4a34-4525-ad7c-ef6ca6453910 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:38.719178 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c16f1-4a34-4525-ad7c-ef6ca6453910 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:38.719881 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c16f1-4a34-4525-ad7c-ef6ca6453910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:38.721816 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c16f1-4a34-4525-ad7c-ef6ca6453910 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:38.825261 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 546/1108] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Jan 5 14:40:38 2022] POST /identity/v3/users => generated 286 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:40:41.246715 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcf160-0e2a-4067-93e6-535ca709ef20 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:41.247243 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcf160-0e2a-4067-93e6-535ca709ef20 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:41.247243 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcf160-0e2a-4067-93e6-535ca709ef20 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:41.248998 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 563/1109] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:41.254347 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3adf4-9e3b-48ea-b5b1-71b21ed9cb62 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:41.254779 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3adf4-9e3b-48ea-b5b1-71b21ed9cb62 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:41.254905 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3adf4-9e3b-48ea-b5b1-71b21ed9cb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:41.272432 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-cbd3adf4-9e3b-48ea-b5b1-71b21ed9cb62 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:41.274208 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-cbd3adf4-9e3b-48ea-b5b1-71b21ed9cb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:41.281666 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 547/1110] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:41 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:41.307033 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcf160-0e2a-4067-93e6-535ca709ef20 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:41.318858 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcf160-0e2a-4067-93e6-535ca709ef20 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:41.323903 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4a968-652a-4db6-8c9e-09c3e4b1e984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:41.324717 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4a968-652a-4db6-8c9e-09c3e4b1e984 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:41.324994 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4a968-652a-4db6-8c9e-09c3e4b1e984 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:41.325291 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4a968-652a-4db6-8c9e-09c3e4b1e984 admin admin] PATH_INFO: `/v3/roles/78b87341e5464907bcce0d16dca76299` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:41.326732 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4a968-652a-4db6-8c9e-09c3e4b1e984 admin admin] RBAC: Authorizing `identity:get_role(role_id=78b87341e5464907bcce0d16dca76299)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:41.327744 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING py.warnings [None req-82d4a968-652a-4db6-8c9e-09c3e4b1e984 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:40:41.327744 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: warnings.warn(msg) Jan 05 14:40:41.327744 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: Jan 05 14:40:41.328600 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4a968-652a-4db6-8c9e-09c3e4b1e984 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:41.329901 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 564/1111] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:40:41 2022] GET /identity/v3/roles/78b87341e5464907bcce0d16dca76299 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:41.335061 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3adf4-9e3b-48ea-b5b1-71b21ed9cb62 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:41.343590 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3adf4-9e3b-48ea-b5b1-71b21ed9cb62 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:41.347935 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0f9be-dbb4-4d15-931d-c05250d76fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:41.348769 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0f9be-dbb4-4d15-931d-c05250d76fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:41.349047 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0f9be-dbb4-4d15-931d-c05250d76fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:41.349349 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0f9be-dbb4-4d15-931d-c05250d76fe4 admin admin] PATH_INFO: `/v3/users/ade1a4caf0bf4570b758f593f32eecd0` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:41.362072 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0f9be-dbb4-4d15-931d-c05250d76fe4 admin admin] RBAC: Authorizing `identity:get_user(user_id=ade1a4caf0bf4570b758f593f32eecd0)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:41.364165 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0f9be-dbb4-4d15-931d-c05250d76fe4 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:41.365741 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 548/1112] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:40:41 2022] GET /identity/v3/users/ade1a4caf0bf4570b758f593f32eecd0 => generated 286 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:41.371383 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4a968-652a-4db6-8c9e-09c3e4b1e984 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:41.380686 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4a968-652a-4db6-8c9e-09c3e4b1e984 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:41.385756 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19fecb-71b2-4827-96cb-84fbca010520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:41.386349 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19fecb-71b2-4827-96cb-84fbca010520 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:41.386627 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19fecb-71b2-4827-96cb-84fbca010520 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:41.386903 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19fecb-71b2-4827-96cb-84fbca010520 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:41.394258 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c19fecb-71b2-4827-96cb-84fbca010520 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:41.395935 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c19fecb-71b2-4827-96cb-84fbca010520 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:41.404361 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 565/1113] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:40:41 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:40:41.409699 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0f9be-dbb4-4d15-931d-c05250d76fe4 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:41.418841 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0f9be-dbb4-4d15-931d-c05250d76fe4 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:41.423324 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bff0d-6ed4-4dc5-894a-8c111742c63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:41.424131 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bff0d-6ed4-4dc5-894a-8c111742c63a admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:41.424415 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bff0d-6ed4-4dc5-894a-8c111742c63a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:41.424695 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bff0d-6ed4-4dc5-894a-8c111742c63a admin admin] PATH_INFO: `/v3/projects/b20b7d9af53a485fadbb7d8027379efd` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:41.425887 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700bff0d-6ed4-4dc5-894a-8c111742c63a admin admin] RBAC: Authorizing `identity:get_project(project_id=b20b7d9af53a485fadbb7d8027379efd)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:41.427879 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700bff0d-6ed4-4dc5-894a-8c111742c63a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:41.429990 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 549/1114] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:40:41 2022] GET /identity/v3/projects/b20b7d9af53a485fadbb7d8027379efd => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:40:41.435434 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19fecb-71b2-4827-96cb-84fbca010520 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:41.443779 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19fecb-71b2-4827-96cb-84fbca010520 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:41.448777 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82f011-929e-40b8-95c1-21a9848dbb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:41.449410 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82f011-929e-40b8-95c1-21a9848dbb7b admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:41.449692 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82f011-929e-40b8-95c1-21a9848dbb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:41.449962 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82f011-929e-40b8-95c1-21a9848dbb7b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:41.450769 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82f011-929e-40b8-95c1-21a9848dbb7b admin admin] RBAC: Adding query filter params (role.id=78b87341e5464907bcce0d16dca76299, scope.project.id=b20b7d9af53a485fadbb7d8027379efd, user.id=ade1a4caf0bf4570b758f593f32eecd0) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:41.451073 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82f011-929e-40b8-95c1-21a9848dbb7b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:41.452837 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82f011-929e-40b8-95c1-21a9848dbb7b admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:41.458001 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 566/1115] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:40:41 2022] GET /identity/v3/role_assignments?user.id=ade1a4caf0bf4570b758f593f32eecd0&scope.project.id=b20b7d9af53a485fadbb7d8027379efd&role.id=78b87341e5464907bcce0d16dca76299 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:43.781275 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef9ae3-71b6-4e3a-b3be-2f6bf59a6aaf None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:43.781780 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef9ae3-71b6-4e3a-b3be-2f6bf59a6aaf None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:43.781780 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef9ae3-71b6-4e3a-b3be-2f6bf59a6aaf None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:43.783519 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 550/1116] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:43.789040 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6369039-ff6c-4fde-a46f-1d384500d838 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:43.789481 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6369039-ff6c-4fde-a46f-1d384500d838 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:43.789608 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6369039-ff6c-4fde-a46f-1d384500d838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:43.806600 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-f6369039-ff6c-4fde-a46f-1d384500d838 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:43.807763 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-f6369039-ff6c-4fde-a46f-1d384500d838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:43.815311 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 567/1117] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:43 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:43.839472 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef9ae3-71b6-4e3a-b3be-2f6bf59a6aaf None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:43.851877 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef9ae3-71b6-4e3a-b3be-2f6bf59a6aaf None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:43.856220 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053c69b-43b2-4569-8ae3-f16628f6e1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:43.857044 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053c69b-43b2-4569-8ae3-f16628f6e1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:43.857425 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053c69b-43b2-4569-8ae3-f16628f6e1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:43.857702 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053c69b-43b2-4569-8ae3-f16628f6e1f1 admin admin] PATH_INFO: `/v3/roles/78b87341e5464907bcce0d16dca76299` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:43.859160 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053c69b-43b2-4569-8ae3-f16628f6e1f1 admin admin] RBAC: Authorizing `identity:get_role(role_id=78b87341e5464907bcce0d16dca76299)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:43.860184 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING py.warnings [None req-1053c69b-43b2-4569-8ae3-f16628f6e1f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:40:43.860184 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: warnings.warn(msg) Jan 05 14:40:43.860184 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: Jan 05 14:40:43.861121 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053c69b-43b2-4569-8ae3-f16628f6e1f1 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:43.862412 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 551/1118] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:40:43 2022] GET /identity/v3/roles/78b87341e5464907bcce0d16dca76299 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:43.867901 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6369039-ff6c-4fde-a46f-1d384500d838 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:43.876705 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6369039-ff6c-4fde-a46f-1d384500d838 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:43.881162 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54a1e9-45db-40c0-9390-b3952c31701c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:43.882070 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54a1e9-45db-40c0-9390-b3952c31701c admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:43.882304 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54a1e9-45db-40c0-9390-b3952c31701c admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:43.882579 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54a1e9-45db-40c0-9390-b3952c31701c admin admin] PATH_INFO: `/v3/users/ade1a4caf0bf4570b758f593f32eecd0` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:43.883771 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54a1e9-45db-40c0-9390-b3952c31701c admin admin] RBAC: Authorizing `identity:get_user(user_id=ade1a4caf0bf4570b758f593f32eecd0)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:43.885900 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54a1e9-45db-40c0-9390-b3952c31701c admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:43.887427 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 568/1119] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:40:43 2022] GET /identity/v3/users/ade1a4caf0bf4570b758f593f32eecd0 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:43.892405 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053c69b-43b2-4569-8ae3-f16628f6e1f1 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:43.902345 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053c69b-43b2-4569-8ae3-f16628f6e1f1 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:43.906818 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1195377-fc8d-4109-b117-2c04c6da34f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:43.907614 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1195377-fc8d-4109-b117-2c04c6da34f7 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:43.907900 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1195377-fc8d-4109-b117-2c04c6da34f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:43.908178 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1195377-fc8d-4109-b117-2c04c6da34f7 admin admin] PATH_INFO: `/v3/projects/b20b7d9af53a485fadbb7d8027379efd` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:43.909375 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1195377-fc8d-4109-b117-2c04c6da34f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=b20b7d9af53a485fadbb7d8027379efd)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:43.911366 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1195377-fc8d-4109-b117-2c04c6da34f7 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:43.912941 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 552/1120] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:40:43 2022] GET /identity/v3/projects/b20b7d9af53a485fadbb7d8027379efd => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:43.918658 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54a1e9-45db-40c0-9390-b3952c31701c admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:43.927597 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54a1e9-45db-40c0-9390-b3952c31701c admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:43.932022 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6c74a-1d53-4ba4-b88c-234d6058b332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:43.932836 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6c74a-1d53-4ba4-b88c-234d6058b332 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:43.933155 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6c74a-1d53-4ba4-b88c-234d6058b332 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:43.933431 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6c74a-1d53-4ba4-b88c-234d6058b332 admin admin] PATH_INFO: `/v3/projects/b20b7d9af53a485fadbb7d8027379efd/users/ade1a4caf0bf4570b758f593f32eecd0/roles/78b87341e5464907bcce0d16dca76299` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:43.935590 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6c74a-1d53-4ba4-b88c-234d6058b332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b20b7d9af53a485fadbb7d8027379efd, user_id=ade1a4caf0bf4570b758f593f32eecd0, role_id=78b87341e5464907bcce0d16dca76299)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:43.938201 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6c74a-1d53-4ba4-b88c-234d6058b332 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:44.004759 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 569/1121] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Jan 5 14:40:43 2022] PUT /identity/v3/projects/b20b7d9af53a485fadbb7d8027379efd/users/ade1a4caf0bf4570b758f593f32eecd0/roles/78b87341e5464907bcce0d16dca76299 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 14:40:46.366073 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd11fb5-7942-4ffd-acb3-218967da5bcd None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:46.366631 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd11fb5-7942-4ffd-acb3-218967da5bcd None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:46.366723 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd11fb5-7942-4ffd-acb3-218967da5bcd None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:46.368406 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 553/1122] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:46.373659 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6668f8e-49a9-439f-b212-07ca5539b28c None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:46.374056 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6668f8e-49a9-439f-b212-07ca5539b28c None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:46.374216 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6668f8e-49a9-439f-b212-07ca5539b28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:46.391876 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-c6668f8e-49a9-439f-b212-07ca5539b28c None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:46.393040 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-c6668f8e-49a9-439f-b212-07ca5539b28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:46.446322 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 570/1123] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:46 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:46.470912 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd11fb5-7942-4ffd-acb3-218967da5bcd None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:46.483215 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd11fb5-7942-4ffd-acb3-218967da5bcd None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:46.487475 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59c3c8-0230-46b0-b84d-6ef5af9ececb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:46.488292 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59c3c8-0230-46b0-b84d-6ef5af9ececb admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:46.488600 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59c3c8-0230-46b0-b84d-6ef5af9ececb admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:46.488873 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59c3c8-0230-46b0-b84d-6ef5af9ececb admin admin] PATH_INFO: `/v3/roles/78b87341e5464907bcce0d16dca76299` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:46.490355 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59c3c8-0230-46b0-b84d-6ef5af9ececb admin admin] RBAC: Authorizing `identity:get_role(role_id=78b87341e5464907bcce0d16dca76299)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:46.492548 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59c3c8-0230-46b0-b84d-6ef5af9ececb admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:46.493874 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 554/1124] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:40:46 2022] GET /identity/v3/roles/78b87341e5464907bcce0d16dca76299 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:46.499247 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6668f8e-49a9-439f-b212-07ca5539b28c None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:46.508284 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6668f8e-49a9-439f-b212-07ca5539b28c None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:46.512748 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34572fe8-2624-429f-a553-69c428004c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:46.513632 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34572fe8-2624-429f-a553-69c428004c30 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:46.513911 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34572fe8-2624-429f-a553-69c428004c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:46.514179 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34572fe8-2624-429f-a553-69c428004c30 admin admin] PATH_INFO: `/v3/users/ade1a4caf0bf4570b758f593f32eecd0` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:46.515360 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34572fe8-2624-429f-a553-69c428004c30 admin admin] RBAC: Authorizing `identity:get_user(user_id=ade1a4caf0bf4570b758f593f32eecd0)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:46.517499 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34572fe8-2624-429f-a553-69c428004c30 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:46.519048 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 571/1125] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:40:46 2022] GET /identity/v3/users/ade1a4caf0bf4570b758f593f32eecd0 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:46.524262 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59c3c8-0230-46b0-b84d-6ef5af9ececb admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:46.533812 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59c3c8-0230-46b0-b84d-6ef5af9ececb admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:46.538728 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68491089-1a15-40f7-b316-120e9fd755b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:46.539329 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68491089-1a15-40f7-b316-120e9fd755b9 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:46.539633 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68491089-1a15-40f7-b316-120e9fd755b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:46.539928 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68491089-1a15-40f7-b316-120e9fd755b9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:46.547339 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68491089-1a15-40f7-b316-120e9fd755b9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:46.549026 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68491089-1a15-40f7-b316-120e9fd755b9 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:46.558011 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 555/1126] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:40:46 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:40:46.563192 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34572fe8-2624-429f-a553-69c428004c30 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:46.572309 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34572fe8-2624-429f-a553-69c428004c30 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:46.576658 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef173543-50b5-4519-9437-9093fb254c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:46.577501 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef173543-50b5-4519-9437-9093fb254c3c admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:46.577779 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef173543-50b5-4519-9437-9093fb254c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:46.578048 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef173543-50b5-4519-9437-9093fb254c3c admin admin] PATH_INFO: `/v3/projects/b20b7d9af53a485fadbb7d8027379efd` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:46.579197 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef173543-50b5-4519-9437-9093fb254c3c admin admin] RBAC: Authorizing `identity:get_project(project_id=b20b7d9af53a485fadbb7d8027379efd)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:46.581196 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef173543-50b5-4519-9437-9093fb254c3c admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:46.582751 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 572/1127] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:40:46 2022] GET /identity/v3/projects/b20b7d9af53a485fadbb7d8027379efd => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:46.588720 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68491089-1a15-40f7-b316-120e9fd755b9 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:46.596922 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68491089-1a15-40f7-b316-120e9fd755b9 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:46.601937 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b95651-d8c3-414f-8667-73f9fcafd2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:46.602522 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b95651-d8c3-414f-8667-73f9fcafd2fd admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:46.602799 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b95651-d8c3-414f-8667-73f9fcafd2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:46.603072 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b95651-d8c3-414f-8667-73f9fcafd2fd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:46.603874 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b95651-d8c3-414f-8667-73f9fcafd2fd admin admin] RBAC: Adding query filter params (role.id=78b87341e5464907bcce0d16dca76299, scope.project.id=b20b7d9af53a485fadbb7d8027379efd, user.id=ade1a4caf0bf4570b758f593f32eecd0) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:46.604176 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b95651-d8c3-414f-8667-73f9fcafd2fd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:46.605989 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b95651-d8c3-414f-8667-73f9fcafd2fd admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:46.611487 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 556/1128] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:40:46 2022] GET /identity/v3/role_assignments?user.id=ade1a4caf0bf4570b758f593f32eecd0&scope.project.id=b20b7d9af53a485fadbb7d8027379efd&role.id=78b87341e5464907bcce0d16dca76299 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:48.996119 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08288eaa-b4b1-4bd8-ba75-ea70ba9eb315 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:48.996675 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08288eaa-b4b1-4bd8-ba75-ea70ba9eb315 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:48.996779 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08288eaa-b4b1-4bd8-ba75-ea70ba9eb315 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:48.998712 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 573/1129] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:49.004087 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932245cf-1eb1-42dc-a6ff-114541d98032 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:49.004473 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932245cf-1eb1-42dc-a6ff-114541d98032 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:49.004646 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932245cf-1eb1-42dc-a6ff-114541d98032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:49.022578 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-932245cf-1eb1-42dc-a6ff-114541d98032 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:49.023755 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-932245cf-1eb1-42dc-a6ff-114541d98032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:49.031348 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 557/1130] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:49 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:49.056337 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08288eaa-b4b1-4bd8-ba75-ea70ba9eb315 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:49.068176 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08288eaa-b4b1-4bd8-ba75-ea70ba9eb315 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:49.073221 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b7428-dbda-4028-9c5d-c00e1d593c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:49.073985 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b7428-dbda-4028-9c5d-c00e1d593c95 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:49.074264 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b7428-dbda-4028-9c5d-c00e1d593c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:49.074533 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b7428-dbda-4028-9c5d-c00e1d593c95 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:49.075775 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b7428-dbda-4028-9c5d-c00e1d593c95 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:49.077481 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b7428-dbda-4028-9c5d-c00e1d593c95 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:49.079014 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 574/1131] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:49.084462 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932245cf-1eb1-42dc-a6ff-114541d98032 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:49.093407 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932245cf-1eb1-42dc-a6ff-114541d98032 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:49.097876 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22025dd1-0295-4a6b-a088-e09ff8a06e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:49.098516 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22025dd1-0295-4a6b-a088-e09ff8a06e70 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:49.098800 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22025dd1-0295-4a6b-a088-e09ff8a06e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:49.099076 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22025dd1-0295-4a6b-a088-e09ff8a06e70 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:49.099787 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22025dd1-0295-4a6b-a088-e09ff8a06e70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:49.101743 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22025dd1-0295-4a6b-a088-e09ff8a06e70 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:49.182705 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 558/1132] 10.222.0.30 () {60 vars in 1162 bytes} [Wed Jan 5 14:40:49 2022] POST /identity/v3/projects => generated 311 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:40:51.584028 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e3a81-6bac-4439-9e63-f872ee61cacc None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:51.584539 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e3a81-6bac-4439-9e63-f872ee61cacc None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:51.584629 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e3a81-6bac-4439-9e63-f872ee61cacc None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:51.586997 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 575/1133] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:51.592023 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f827e5-ac66-4fed-befe-5dd79a6d7762 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:51.592387 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f827e5-ac66-4fed-befe-5dd79a6d7762 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:51.592580 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f827e5-ac66-4fed-befe-5dd79a6d7762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:51.609835 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-90f827e5-ac66-4fed-befe-5dd79a6d7762 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:51.610998 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-90f827e5-ac66-4fed-befe-5dd79a6d7762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:51.665831 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 559/1134] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:51 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:51.691455 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e3a81-6bac-4439-9e63-f872ee61cacc None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:51.703868 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e3a81-6bac-4439-9e63-f872ee61cacc None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:51.708221 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ffdc9-ae30-4608-b27f-0cf8858497b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:51.708988 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ffdc9-ae30-4608-b27f-0cf8858497b4 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:51.709305 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ffdc9-ae30-4608-b27f-0cf8858497b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:51.709583 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ffdc9-ae30-4608-b27f-0cf8858497b4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:51.711318 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ffdc9-ae30-4608-b27f-0cf8858497b4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:51.713005 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ffdc9-ae30-4608-b27f-0cf8858497b4 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:51.714578 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 576/1135] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:40:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:51.719784 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f827e5-ac66-4fed-befe-5dd79a6d7762 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:51.728309 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f827e5-ac66-4fed-befe-5dd79a6d7762 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:51.732660 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5854da5a-991b-479b-bb53-709c15294660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:51.733335 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854da5a-991b-479b-bb53-709c15294660 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:51.733614 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854da5a-991b-479b-bb53-709c15294660 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:51.733884 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854da5a-991b-479b-bb53-709c15294660 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:51.734596 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5854da5a-991b-479b-bb53-709c15294660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:51.736476 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5854da5a-991b-479b-bb53-709c15294660 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:51.872927 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 560/1136] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Jan 5 14:40:51 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 14:40:54.278002 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262d2c8-807f-4e51-9058-4f137b242e37 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:54.278535 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262d2c8-807f-4e51-9058-4f137b242e37 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:54.278535 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262d2c8-807f-4e51-9058-4f137b242e37 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:54.280355 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 577/1137] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:54.285395 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8882f-aa93-40a8-86c4-966dbf6616f3 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:54.285768 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8882f-aa93-40a8-86c4-966dbf6616f3 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:54.285948 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8882f-aa93-40a8-86c4-966dbf6616f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:54.303748 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-9aa8882f-aa93-40a8-86c4-966dbf6616f3 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:54.304912 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-9aa8882f-aa93-40a8-86c4-966dbf6616f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:54.313752 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 561/1138] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:54 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:54.341644 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262d2c8-807f-4e51-9058-4f137b242e37 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:54.354161 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262d2c8-807f-4e51-9058-4f137b242e37 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:54.358500 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540354a8-1424-4142-a564-9fc7b8cb0069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:54.359264 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540354a8-1424-4142-a564-9fc7b8cb0069 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:54.359541 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540354a8-1424-4142-a564-9fc7b8cb0069 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:54.359807 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540354a8-1424-4142-a564-9fc7b8cb0069 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:54.369560 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540354a8-1424-4142-a564-9fc7b8cb0069 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:40:54.376756 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-540354a8-1424-4142-a564-9fc7b8cb0069 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 05 14:40:54.377902 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 578/1139] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:40:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:54.383738 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8882f-aa93-40a8-86c4-966dbf6616f3 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:54.392468 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8882f-aa93-40a8-86c4-966dbf6616f3 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:54.396865 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ceb73e-a8c0-4266-822d-d15b0962e4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:54.398090 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ceb73e-a8c0-4266-822d-d15b0962e4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:54.398369 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ceb73e-a8c0-4266-822d-d15b0962e4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:54.398637 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ceb73e-a8c0-4266-822d-d15b0962e4a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:54.399385 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ceb73e-a8c0-4266-822d-d15b0962e4a2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:54.399687 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ceb73e-a8c0-4266-822d-d15b0962e4a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:54.401299 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ceb73e-a8c0-4266-822d-d15b0962e4a2 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:54.409227 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 562/1140] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:40:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:54.415122 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540354a8-1424-4142-a564-9fc7b8cb0069 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:54.424797 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540354a8-1424-4142-a564-9fc7b8cb0069 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:54.429206 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b4049-2397-433b-9547-9655406e08f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:54.430026 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b4049-2397-433b-9547-9655406e08f6 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:54.430302 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b4049-2397-433b-9547-9655406e08f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:54.430574 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b4049-2397-433b-9547-9655406e08f6 admin admin] PATH_INFO: `/v3/users/dcf308746d7f444483cace2234a79ad3` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:54.442775 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b4049-2397-433b-9547-9655406e08f6 admin admin] RBAC: Authorizing `identity:get_user(user_id=dcf308746d7f444483cace2234a79ad3)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:54.445430 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b4049-2397-433b-9547-9655406e08f6 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:54.446967 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 579/1141] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:40:54 2022] GET /identity/v3/users/dcf308746d7f444483cace2234a79ad3 => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:54.452169 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ceb73e-a8c0-4266-822d-d15b0962e4a2 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:54.461974 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ceb73e-a8c0-4266-822d-d15b0962e4a2 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:54.466384 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433325e-d55b-4323-b441-cb02d7b7c62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:54.466988 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433325e-d55b-4323-b441-cb02d7b7c62a admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:54.467270 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433325e-d55b-4323-b441-cb02d7b7c62a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:54.467547 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433325e-d55b-4323-b441-cb02d7b7c62a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:54.475014 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433325e-d55b-4323-b441-cb02d7b7c62a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:54.476764 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433325e-d55b-4323-b441-cb02d7b7c62a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:54.485284 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 563/1142] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:40:54 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 14:40:54.490426 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b4049-2397-433b-9547-9655406e08f6 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:54.499598 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b4049-2397-433b-9547-9655406e08f6 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:54.504245 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821be60-c4c4-42ca-b925-be97e83f596e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:54.505058 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821be60-c4c4-42ca-b925-be97e83f596e admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:54.505369 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821be60-c4c4-42ca-b925-be97e83f596e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:54.505642 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821be60-c4c4-42ca-b925-be97e83f596e admin admin] PATH_INFO: `/v3/projects/24ab92ee303f45d1b103eea0349558ee` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:54.507296 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821be60-c4c4-42ca-b925-be97e83f596e admin admin] RBAC: Authorizing `identity:get_project(project_id=24ab92ee303f45d1b103eea0349558ee)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:54.509327 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821be60-c4c4-42ca-b925-be97e83f596e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:54.510931 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 580/1143] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:40:54 2022] GET /identity/v3/projects/24ab92ee303f45d1b103eea0349558ee => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:54.516531 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433325e-d55b-4323-b441-cb02d7b7c62a admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:54.525758 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433325e-d55b-4323-b441-cb02d7b7c62a admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:54.530241 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9df11-d0af-4d86-ad07-7b5cd1240f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:54.530803 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9df11-d0af-4d86-ad07-7b5cd1240f82 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:54.531084 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9df11-d0af-4d86-ad07-7b5cd1240f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:54.531355 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9df11-d0af-4d86-ad07-7b5cd1240f82 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:54.532175 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9df11-d0af-4d86-ad07-7b5cd1240f82 admin admin] RBAC: Adding query filter params (role.id=494131614fcf424f92e0817fa7ff6961, scope.project.id=24ab92ee303f45d1b103eea0349558ee, user.id=dcf308746d7f444483cace2234a79ad3) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:54.532482 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9df11-d0af-4d86-ad07-7b5cd1240f82 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:54.534322 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9df11-d0af-4d86-ad07-7b5cd1240f82 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:54.539486 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 564/1144] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:40:54 2022] GET /identity/v3/role_assignments?user.id=dcf308746d7f444483cace2234a79ad3&scope.project.id=24ab92ee303f45d1b103eea0349558ee&role.id=494131614fcf424f92e0817fa7ff6961 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:56.869869 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fb3a5-0868-4c45-bf29-cbb01f408c0f None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:56.870367 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fb3a5-0868-4c45-bf29-cbb01f408c0f None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:56.870485 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fb3a5-0868-4c45-bf29-cbb01f408c0f None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:56.872158 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 581/1145] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:56.877532 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bf00b-0711-4898-8a94-f253b2d211be None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:56.877949 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bf00b-0711-4898-8a94-f253b2d211be None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:56.878078 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bf00b-0711-4898-8a94-f253b2d211be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:56.895810 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-e22bf00b-0711-4898-8a94-f253b2d211be None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:56.896963 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-e22bf00b-0711-4898-8a94-f253b2d211be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:56.905058 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 565/1146] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:56 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:56.928237 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fb3a5-0868-4c45-bf29-cbb01f408c0f None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:56.940051 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fb3a5-0868-4c45-bf29-cbb01f408c0f None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:56.944830 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eeeb8c-484f-42b0-9c5a-738bf52bd416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:56.945617 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eeeb8c-484f-42b0-9c5a-738bf52bd416 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:56.945895 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eeeb8c-484f-42b0-9c5a-738bf52bd416 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:56.946163 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eeeb8c-484f-42b0-9c5a-738bf52bd416 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:56.955832 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eeeb8c-484f-42b0-9c5a-738bf52bd416 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:40:56.962958 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-e1eeeb8c-484f-42b0-9c5a-738bf52bd416 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 05 14:40:56.964060 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 582/1147] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:40:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:56.969599 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bf00b-0711-4898-8a94-f253b2d211be None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:56.978851 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bf00b-0711-4898-8a94-f253b2d211be None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:56.983263 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06312e-30ff-4df2-a849-e87c6fa1da91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:56.983899 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06312e-30ff-4df2-a849-e87c6fa1da91 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:56.984176 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06312e-30ff-4df2-a849-e87c6fa1da91 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:56.984446 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06312e-30ff-4df2-a849-e87c6fa1da91 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:56.985242 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06312e-30ff-4df2-a849-e87c6fa1da91 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:56.985546 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06312e-30ff-4df2-a849-e87c6fa1da91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:56.987128 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06312e-30ff-4df2-a849-e87c6fa1da91 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:56.995098 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 566/1148] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:40:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:57.000638 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eeeb8c-484f-42b0-9c5a-738bf52bd416 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:57.010987 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eeeb8c-484f-42b0-9c5a-738bf52bd416 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:57.015448 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff17d61-d112-4b96-ba6b-ada7613125b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:57.016272 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff17d61-d112-4b96-ba6b-ada7613125b9 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:57.016553 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff17d61-d112-4b96-ba6b-ada7613125b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:57.016826 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff17d61-d112-4b96-ba6b-ada7613125b9 admin admin] PATH_INFO: `/v3/users/dcf308746d7f444483cace2234a79ad3` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:57.018033 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff17d61-d112-4b96-ba6b-ada7613125b9 admin admin] RBAC: Authorizing `identity:get_user(user_id=dcf308746d7f444483cace2234a79ad3)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:57.020119 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff17d61-d112-4b96-ba6b-ada7613125b9 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:57.021685 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 583/1149] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:40:56 2022] GET /identity/v3/users/dcf308746d7f444483cace2234a79ad3 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:57.027284 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06312e-30ff-4df2-a849-e87c6fa1da91 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:57.036301 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06312e-30ff-4df2-a849-e87c6fa1da91 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:57.040720 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb90dc5-e026-4678-9886-b627801d594c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:57.041565 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb90dc5-e026-4678-9886-b627801d594c admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:57.041846 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb90dc5-e026-4678-9886-b627801d594c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:57.042119 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb90dc5-e026-4678-9886-b627801d594c admin admin] PATH_INFO: `/v3/projects/24ab92ee303f45d1b103eea0349558ee` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:57.043264 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb90dc5-e026-4678-9886-b627801d594c admin admin] RBAC: Authorizing `identity:get_project(project_id=24ab92ee303f45d1b103eea0349558ee)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:57.045287 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb90dc5-e026-4678-9886-b627801d594c admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:57.046848 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 567/1150] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:40:57 2022] GET /identity/v3/projects/24ab92ee303f45d1b103eea0349558ee => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:57.051918 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff17d61-d112-4b96-ba6b-ada7613125b9 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:57.061553 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff17d61-d112-4b96-ba6b-ada7613125b9 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:57.066015 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e8198-b9b1-4a5f-838a-bac8c407f304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:57.066834 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e8198-b9b1-4a5f-838a-bac8c407f304 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:57.067113 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e8198-b9b1-4a5f-838a-bac8c407f304 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:57.067388 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e8198-b9b1-4a5f-838a-bac8c407f304 admin admin] PATH_INFO: `/v3/projects/24ab92ee303f45d1b103eea0349558ee/users/dcf308746d7f444483cace2234a79ad3/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:57.069911 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e8198-b9b1-4a5f-838a-bac8c407f304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24ab92ee303f45d1b103eea0349558ee, user_id=dcf308746d7f444483cace2234a79ad3, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:57.072505 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e8198-b9b1-4a5f-838a-bac8c407f304 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:57.164154 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 584/1151] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Jan 5 14:40:57 2022] PUT /identity/v3/projects/24ab92ee303f45d1b103eea0349558ee/users/dcf308746d7f444483cace2234a79ad3/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:40:59.514537 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d11e5-3e7f-4a26-b577-24caa13c356f None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:59.515012 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d11e5-3e7f-4a26-b577-24caa13c356f None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:59.515111 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d11e5-3e7f-4a26-b577-24caa13c356f None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:59.516837 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 568/1152] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:40:59.521976 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376732b4-2ebf-49bc-9484-6cd6423a9cfd None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:59.522478 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376732b4-2ebf-49bc-9484-6cd6423a9cfd None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:59.522572 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376732b4-2ebf-49bc-9484-6cd6423a9cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:59.539395 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-376732b4-2ebf-49bc-9484-6cd6423a9cfd None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:40:59.540549 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-376732b4-2ebf-49bc-9484-6cd6423a9cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:40:59.594002 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 585/1153] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:40:59 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:40:59.618848 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d11e5-3e7f-4a26-b577-24caa13c356f None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:59.630875 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d11e5-3e7f-4a26-b577-24caa13c356f None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:59.635320 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a86971-e32c-47c3-8f08-f940307b1262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:59.636104 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a86971-e32c-47c3-8f08-f940307b1262 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:59.636383 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a86971-e32c-47c3-8f08-f940307b1262 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:59.636656 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a86971-e32c-47c3-8f08-f940307b1262 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:59.646439 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a86971-e32c-47c3-8f08-f940307b1262 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:40:59.653983 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-49a86971-e32c-47c3-8f08-f940307b1262 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 05 14:40:59.655088 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 569/1154] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:40:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:40:59.660492 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376732b4-2ebf-49bc-9484-6cd6423a9cfd None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:59.669530 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376732b4-2ebf-49bc-9484-6cd6423a9cfd None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:59.673918 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416e2d6-a8ec-4d90-afea-34db996b592e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:59.674559 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416e2d6-a8ec-4d90-afea-34db996b592e admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:59.674840 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416e2d6-a8ec-4d90-afea-34db996b592e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:59.675114 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416e2d6-a8ec-4d90-afea-34db996b592e admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:59.675858 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416e2d6-a8ec-4d90-afea-34db996b592e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:59.676163 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416e2d6-a8ec-4d90-afea-34db996b592e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:59.677778 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416e2d6-a8ec-4d90-afea-34db996b592e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:59.685524 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 586/1155] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:40:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:59.690748 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a86971-e32c-47c3-8f08-f940307b1262 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:59.700893 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a86971-e32c-47c3-8f08-f940307b1262 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:59.705309 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d5ac6-0ae5-4cdc-845f-a35d1fa8e969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:59.706112 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d5ac6-0ae5-4cdc-845f-a35d1fa8e969 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:59.706391 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d5ac6-0ae5-4cdc-845f-a35d1fa8e969 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:59.706665 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d5ac6-0ae5-4cdc-845f-a35d1fa8e969 admin admin] PATH_INFO: `/v3/users/dcf308746d7f444483cace2234a79ad3` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:59.707838 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d5ac6-0ae5-4cdc-845f-a35d1fa8e969 admin admin] RBAC: Authorizing `identity:get_user(user_id=dcf308746d7f444483cace2234a79ad3)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:59.710634 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d5ac6-0ae5-4cdc-845f-a35d1fa8e969 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:59.712140 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 570/1156] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:40:59 2022] GET /identity/v3/users/dcf308746d7f444483cace2234a79ad3 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:59.717090 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416e2d6-a8ec-4d90-afea-34db996b592e admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:59.725943 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416e2d6-a8ec-4d90-afea-34db996b592e admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:59.730331 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6f708-1c95-4737-8b86-1e2b725323d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:59.730919 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6f708-1c95-4737-8b86-1e2b725323d9 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:59.731199 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6f708-1c95-4737-8b86-1e2b725323d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:59.731471 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6f708-1c95-4737-8b86-1e2b725323d9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:59.738882 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f6f708-1c95-4737-8b86-1e2b725323d9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:59.740565 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f6f708-1c95-4737-8b86-1e2b725323d9 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:59.748911 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 587/1157] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:40:59 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:40:59.754280 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d5ac6-0ae5-4cdc-845f-a35d1fa8e969 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:59.763982 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d5ac6-0ae5-4cdc-845f-a35d1fa8e969 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:59.768338 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42587d27-b7d2-4ad7-b2a4-fbb567eafc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:59.769151 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42587d27-b7d2-4ad7-b2a4-fbb567eafc57 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:59.769432 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42587d27-b7d2-4ad7-b2a4-fbb567eafc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:59.769702 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42587d27-b7d2-4ad7-b2a4-fbb567eafc57 admin admin] PATH_INFO: `/v3/projects/24ab92ee303f45d1b103eea0349558ee` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:59.770834 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42587d27-b7d2-4ad7-b2a4-fbb567eafc57 admin admin] RBAC: Authorizing `identity:get_project(project_id=24ab92ee303f45d1b103eea0349558ee)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:59.773512 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42587d27-b7d2-4ad7-b2a4-fbb567eafc57 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:59.775064 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 571/1158] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:40:59 2022] GET /identity/v3/projects/24ab92ee303f45d1b103eea0349558ee => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:40:59.780383 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6f708-1c95-4737-8b86-1e2b725323d9 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:40:59.788650 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6f708-1c95-4737-8b86-1e2b725323d9 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:40:59.793163 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a1723-996e-49ae-9a86-1c202d75e043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:40:59.793762 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a1723-996e-49ae-9a86-1c202d75e043 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:40:59.794048 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a1723-996e-49ae-9a86-1c202d75e043 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:40:59.794328 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a1723-996e-49ae-9a86-1c202d75e043 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:40:59.795142 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a1723-996e-49ae-9a86-1c202d75e043 admin admin] RBAC: Adding query filter params (role.id=494131614fcf424f92e0817fa7ff6961, scope.project.id=24ab92ee303f45d1b103eea0349558ee, user.id=dcf308746d7f444483cace2234a79ad3) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:40:59.795460 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a1723-996e-49ae-9a86-1c202d75e043 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:40:59.797274 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a1723-996e-49ae-9a86-1c202d75e043 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:40:59.802853 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 588/1159] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:40:59 2022] GET /identity/v3/role_assignments?user.id=dcf308746d7f444483cace2234a79ad3&scope.project.id=24ab92ee303f45d1b103eea0349558ee&role.id=494131614fcf424f92e0817fa7ff6961 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:41:02.181918 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b40b01-1628-47a9-8f9d-7cc01c5bac3b None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:02.182450 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b40b01-1628-47a9-8f9d-7cc01c5bac3b None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:02.182450 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b40b01-1628-47a9-8f9d-7cc01c5bac3b None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:02.184234 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 572/1160] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:41:02.190513 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e2bfb-7ce7-43f1-995d-4c9f88f5c4f9 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:02.190945 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e2bfb-7ce7-43f1-995d-4c9f88f5c4f9 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:02.191048 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e2bfb-7ce7-43f1-995d-4c9f88f5c4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:02.210170 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-b08e2bfb-7ce7-43f1-995d-4c9f88f5c4f9 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:41:02.211348 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-b08e2bfb-7ce7-43f1-995d-4c9f88f5c4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:41:02.218804 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 589/1161] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:41:02 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:41:02.241521 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b40b01-1628-47a9-8f9d-7cc01c5bac3b None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:41:02.253564 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b40b01-1628-47a9-8f9d-7cc01c5bac3b None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:41:02.258448 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16bf6e-02e2-4f9b-9780-5912b9b61757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:41:02.259062 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16bf6e-02e2-4f9b-9780-5912b9b61757 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:02.259346 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16bf6e-02e2-4f9b-9780-5912b9b61757 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:02.259623 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16bf6e-02e2-4f9b-9780-5912b9b61757 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:02.267019 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16bf6e-02e2-4f9b-9780-5912b9b61757 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:41:02.268747 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16bf6e-02e2-4f9b-9780-5912b9b61757 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:41:02.277832 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 573/1162] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:41:02 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:41:02.283265 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e2bfb-7ce7-43f1-995d-4c9f88f5c4f9 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:41:02.291702 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e2bfb-7ce7-43f1-995d-4c9f88f5c4f9 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:41:02.296085 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ecc2b-774f-4ae5-a6b6-be901c7eb857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:41:02.296850 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ecc2b-774f-4ae5-a6b6-be901c7eb857 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:02.297165 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ecc2b-774f-4ae5-a6b6-be901c7eb857 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:02.297439 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ecc2b-774f-4ae5-a6b6-be901c7eb857 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:02.304507 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ecc2b-774f-4ae5-a6b6-be901c7eb857 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:41:02.306315 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ecc2b-774f-4ae5-a6b6-be901c7eb857 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:41:02.320077 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-c05ecc2b-774f-4ae5-a6b6-be901c7eb857 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jan 05 14:41:02.321181 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 590/1163] 10.222.0.30 () {56 vars in 1138 bytes} [Wed Jan 5 14:41:02 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:41:02.326642 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16bf6e-02e2-4f9b-9780-5912b9b61757 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:41:02.335599 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16bf6e-02e2-4f9b-9780-5912b9b61757 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:41:02.340036 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c26ff-b5b7-40c6-814e-77a5307f81f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:41:02.340654 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c26ff-b5b7-40c6-814e-77a5307f81f0 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:02.340934 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c26ff-b5b7-40c6-814e-77a5307f81f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:02.341246 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c26ff-b5b7-40c6-814e-77a5307f81f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:02.341955 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c26ff-b5b7-40c6-814e-77a5307f81f0 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:41:02.342253 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c26ff-b5b7-40c6-814e-77a5307f81f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:41:02.343796 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c26ff-b5b7-40c6-814e-77a5307f81f0 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:41:02.351347 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 574/1164] 10.222.0.30 () {56 vars in 1136 bytes} [Wed Jan 5 14:41:02 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:41:04.701293 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179be7fa-5321-4aec-bcc6-44a0d6486355 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:04.701833 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179be7fa-5321-4aec-bcc6-44a0d6486355 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:04.701833 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179be7fa-5321-4aec-bcc6-44a0d6486355 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:04.703620 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 591/1165] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:41:04.708756 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5993ca7-9b8b-47f2-82aa-9cf4a5938760 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:04.709192 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5993ca7-9b8b-47f2-82aa-9cf4a5938760 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:04.709863 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5993ca7-9b8b-47f2-82aa-9cf4a5938760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:04.727595 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-d5993ca7-9b8b-47f2-82aa-9cf4a5938760 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:41:04.728760 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-d5993ca7-9b8b-47f2-82aa-9cf4a5938760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:41:04.736325 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 575/1166] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:41:04 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:41:04.760270 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179be7fa-5321-4aec-bcc6-44a0d6486355 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:41:04.773223 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179be7fa-5321-4aec-bcc6-44a0d6486355 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:41:04.777575 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442e270-1350-4534-bba8-87b7a0d2a0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:41:04.778210 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442e270-1350-4534-bba8-87b7a0d2a0eb admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:04.778487 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442e270-1350-4534-bba8-87b7a0d2a0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:04.778757 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442e270-1350-4534-bba8-87b7a0d2a0eb admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:04.779493 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442e270-1350-4534-bba8-87b7a0d2a0eb admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:41:04.780495 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING py.warnings [None req-1442e270-1350-4534-bba8-87b7a0d2a0eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:41:04.780495 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: warnings.warn(msg) Jan 05 14:41:04.780495 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: Jan 05 14:41:04.781412 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442e270-1350-4534-bba8-87b7a0d2a0eb admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:41:04.895511 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 592/1167] 10.222.0.30 () {60 vars in 1159 bytes} [Wed Jan 5 14:41:04 2022] POST /identity/v3/domains => generated 267 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 14:41:07.294460 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b15ea-baa0-4052-acfd-7d8e5c4bb2ea None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:07.295010 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b15ea-baa0-4052-acfd-7d8e5c4bb2ea None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:07.295010 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b15ea-baa0-4052-acfd-7d8e5c4bb2ea None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:07.296776 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 576/1168] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:41:07.301914 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95328045-1cba-495e-94b9-fd33f93fd091 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:07.302312 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95328045-1cba-495e-94b9-fd33f93fd091 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:07.306850 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95328045-1cba-495e-94b9-fd33f93fd091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:07.320227 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-95328045-1cba-495e-94b9-fd33f93fd091 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:41:07.321437 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-95328045-1cba-495e-94b9-fd33f93fd091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:41:07.375319 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 593/1169] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:41:07 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:41:07.399439 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b15ea-baa0-4052-acfd-7d8e5c4bb2ea None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:41:07.411361 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b15ea-baa0-4052-acfd-7d8e5c4bb2ea None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:41:07.416214 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e0809-4b1a-47c9-9e7c-83553bb40665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:41:07.417040 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e0809-4b1a-47c9-9e7c-83553bb40665 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:07.417352 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e0809-4b1a-47c9-9e7c-83553bb40665 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:07.417625 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e0809-4b1a-47c9-9e7c-83553bb40665 admin admin] PATH_INFO: `/v3/domains/68978de5b1724eb6840a3bf52555074d` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:07.427812 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e0809-4b1a-47c9-9e7c-83553bb40665 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=68978de5b1724eb6840a3bf52555074d)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:41:07.430374 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e0809-4b1a-47c9-9e7c-83553bb40665 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:41:07.431923 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 577/1170] 10.222.0.30 () {56 vars in 1204 bytes} [Wed Jan 5 14:41:07 2022] GET /identity/v3/domains/68978de5b1724eb6840a3bf52555074d => generated 267 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:41:07.437444 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95328045-1cba-495e-94b9-fd33f93fd091 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:41:07.446147 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95328045-1cba-495e-94b9-fd33f93fd091 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:41:07.450679 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d40040-c445-47fc-b162-525ca85a1bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:41:07.451319 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d40040-c445-47fc-b162-525ca85a1bf6 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:07.451603 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d40040-c445-47fc-b162-525ca85a1bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:07.451880 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d40040-c445-47fc-b162-525ca85a1bf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:07.452596 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d40040-c445-47fc-b162-525ca85a1bf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:41:07.454497 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d40040-c445-47fc-b162-525ca85a1bf6 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:41:07.543484 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 594/1171] 10.222.0.30 () {60 vars in 1162 bytes} [Wed Jan 5 14:41:07 2022] POST /identity/v3/projects => generated 361 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 14:41:09.953648 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009e959-21aa-4516-a77d-6c114c7a0eff None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:09.954199 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009e959-21aa-4516-a77d-6c114c7a0eff None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:09.954199 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009e959-21aa-4516-a77d-6c114c7a0eff None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:09.955945 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 578/1172] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:41:09.961572 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62c845-537d-4fcb-9fea-2e7afede8be3 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:09.961950 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62c845-537d-4fcb-9fea-2e7afede8be3 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:09.962127 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62c845-537d-4fcb-9fea-2e7afede8be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:09.979828 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-ea62c845-537d-4fcb-9fea-2e7afede8be3 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:41:09.981005 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-ea62c845-537d-4fcb-9fea-2e7afede8be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:41:10.036189 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 595/1173] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:41:09 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:41:10.064887 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009e959-21aa-4516-a77d-6c114c7a0eff None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:41:10.077532 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009e959-21aa-4516-a77d-6c114c7a0eff None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:41:10.081849 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a37ce-bf3b-4a6a-816e-64816ad5f477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:41:10.082684 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a37ce-bf3b-4a6a-816e-64816ad5f477 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:10.082963 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a37ce-bf3b-4a6a-816e-64816ad5f477 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:10.083235 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a37ce-bf3b-4a6a-816e-64816ad5f477 admin admin] PATH_INFO: `/v3/domains/68978de5b1724eb6840a3bf52555074d` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:10.084399 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a37ce-bf3b-4a6a-816e-64816ad5f477 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=68978de5b1724eb6840a3bf52555074d)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:41:10.086388 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a37ce-bf3b-4a6a-816e-64816ad5f477 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:41:10.087923 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 579/1174] 10.222.0.30 () {56 vars in 1204 bytes} [Wed Jan 5 14:41:10 2022] GET /identity/v3/domains/68978de5b1724eb6840a3bf52555074d => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:41:10.093312 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62c845-537d-4fcb-9fea-2e7afede8be3 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:41:10.102006 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62c845-537d-4fcb-9fea-2e7afede8be3 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:41:10.106440 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ce9f5-f8ad-42d8-983f-1dee44a49ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:41:10.107087 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ce9f5-f8ad-42d8-983f-1dee44a49ab8 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:10.107372 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ce9f5-f8ad-42d8-983f-1dee44a49ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:10.107649 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ce9f5-f8ad-42d8-983f-1dee44a49ab8 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:10.108366 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ce9f5-f8ad-42d8-983f-1dee44a49ab8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:41:10.110279 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ce9f5-f8ad-42d8-983f-1dee44a49ab8 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:41:10.191719 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 596/1175] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Jan 5 14:41:10 2022] POST /identity/v3/users => generated 311 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:41:12.593929 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083ce36-6686-4889-b720-ab586a237683 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:12.594462 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083ce36-6686-4889-b720-ab586a237683 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:12.594462 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083ce36-6686-4889-b720-ab586a237683 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:12.596222 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 580/1176] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:41:12.601496 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1b878-e708-494c-b385-0c5cc3db34fb None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:12.601897 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1b878-e708-494c-b385-0c5cc3db34fb None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:12.602057 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1b878-e708-494c-b385-0c5cc3db34fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:12.619200 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-90d1b878-e708-494c-b385-0c5cc3db34fb None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:41:12.620372 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-90d1b878-e708-494c-b385-0c5cc3db34fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:41:12.628162 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 597/1177] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:41:12 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:41:12.654293 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083ce36-6686-4889-b720-ab586a237683 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:41:12.666101 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083ce36-6686-4889-b720-ab586a237683 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:41:12.670472 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d6e31-eafb-4982-a934-7ebf736eeffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:41:12.671230 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d6e31-eafb-4982-a934-7ebf736eeffb admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:12.671511 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d6e31-eafb-4982-a934-7ebf736eeffb admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:12.671785 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d6e31-eafb-4982-a934-7ebf736eeffb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:12.682002 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d6e31-eafb-4982-a934-7ebf736eeffb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:41:12.689008 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-a77d6e31-eafb-4982-a934-7ebf736eeffb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 05 14:41:12.690164 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 581/1178] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:41:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:41:12.696229 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1b878-e708-494c-b385-0c5cc3db34fb None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:41:12.704852 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1b878-e708-494c-b385-0c5cc3db34fb None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:41:12.709910 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8e29f-2373-4438-a061-d19a3909b9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:41:12.710548 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8e29f-2373-4438-a061-d19a3909b9fa admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:12.710828 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8e29f-2373-4438-a061-d19a3909b9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:12.711103 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8e29f-2373-4438-a061-d19a3909b9fa admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:12.711852 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace8e29f-2373-4438-a061-d19a3909b9fa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:41:12.712159 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace8e29f-2373-4438-a061-d19a3909b9fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:41:12.713765 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace8e29f-2373-4438-a061-d19a3909b9fa admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:41:12.721599 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 598/1179] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:41:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:41:12.726864 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d6e31-eafb-4982-a934-7ebf736eeffb admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:41:12.736370 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d6e31-eafb-4982-a934-7ebf736eeffb admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:41:12.742002 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e6e01-ade1-4925-81d1-e80dc7728498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:41:12.742850 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e6e01-ade1-4925-81d1-e80dc7728498 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:12.743129 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e6e01-ade1-4925-81d1-e80dc7728498 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:12.743402 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e6e01-ade1-4925-81d1-e80dc7728498 admin admin] PATH_INFO: `/v3/users/7194ca2316f948028e2d1537a1641c7d` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:12.759976 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e6e01-ade1-4925-81d1-e80dc7728498 admin admin] RBAC: Authorizing `identity:get_user(user_id=7194ca2316f948028e2d1537a1641c7d)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:41:12.762074 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e6e01-ade1-4925-81d1-e80dc7728498 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:41:12.763685 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 582/1180] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:41:12 2022] GET /identity/v3/users/7194ca2316f948028e2d1537a1641c7d => generated 311 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:41:12.769448 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8e29f-2373-4438-a061-d19a3909b9fa admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:41:12.779556 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8e29f-2373-4438-a061-d19a3909b9fa admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:41:12.784039 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577dc647-ab60-4ef8-856e-bdacfacbaf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:41:12.784674 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dc647-ab60-4ef8-856e-bdacfacbaf64 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:12.784960 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dc647-ab60-4ef8-856e-bdacfacbaf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:12.785265 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dc647-ab60-4ef8-856e-bdacfacbaf64 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:12.792732 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577dc647-ab60-4ef8-856e-bdacfacbaf64 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:41:12.794489 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577dc647-ab60-4ef8-856e-bdacfacbaf64 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:41:12.803540 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 599/1181] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:41:12 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:41:12.808941 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e6e01-ade1-4925-81d1-e80dc7728498 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:41:12.818068 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e6e01-ade1-4925-81d1-e80dc7728498 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:41:12.823143 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32086e-dabb-4ba4-87ec-6993cd1339cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:41:12.823963 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32086e-dabb-4ba4-87ec-6993cd1339cc admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:12.824240 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32086e-dabb-4ba4-87ec-6993cd1339cc admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:12.824510 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32086e-dabb-4ba4-87ec-6993cd1339cc admin admin] PATH_INFO: `/v3/projects/2f77b9c9dbb14f058377ec2aa0156835` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:12.825691 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32086e-dabb-4ba4-87ec-6993cd1339cc admin admin] RBAC: Authorizing `identity:get_project(project_id=2f77b9c9dbb14f058377ec2aa0156835)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:41:12.827674 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32086e-dabb-4ba4-87ec-6993cd1339cc admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:41:12.829309 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 583/1182] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:41:12 2022] GET /identity/v3/projects/2f77b9c9dbb14f058377ec2aa0156835 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:41:12.834873 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577dc647-ab60-4ef8-856e-bdacfacbaf64 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:41:12.843210 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577dc647-ab60-4ef8-856e-bdacfacbaf64 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:41:12.847608 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde183e-a9ea-430f-b573-b98df522deb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:41:12.848204 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde183e-a9ea-430f-b573-b98df522deb6 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:12.848482 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde183e-a9ea-430f-b573-b98df522deb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:12.848752 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde183e-a9ea-430f-b573-b98df522deb6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:12.849606 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde183e-a9ea-430f-b573-b98df522deb6 admin admin] RBAC: Adding query filter params (role.id=494131614fcf424f92e0817fa7ff6961, scope.project.id=2f77b9c9dbb14f058377ec2aa0156835, user.id=7194ca2316f948028e2d1537a1641c7d) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:41:12.849912 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde183e-a9ea-430f-b573-b98df522deb6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:41:12.851674 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde183e-a9ea-430f-b573-b98df522deb6 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:41:12.856735 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 600/1183] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:41:12 2022] GET /identity/v3/role_assignments?user.id=7194ca2316f948028e2d1537a1641c7d&scope.project.id=2f77b9c9dbb14f058377ec2aa0156835&role.id=494131614fcf424f92e0817fa7ff6961 => generated 259 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:41:15.189016 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f5dfe-846c-4a5a-b70d-7640d6b88848 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:15.189589 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f5dfe-846c-4a5a-b70d-7640d6b88848 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:15.189589 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f5dfe-846c-4a5a-b70d-7640d6b88848 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:15.191375 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 584/1184] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:41:15.197194 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723eff67-c4ca-4d2f-99cc-c496def15167 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:15.197623 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723eff67-c4ca-4d2f-99cc-c496def15167 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:15.197755 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723eff67-c4ca-4d2f-99cc-c496def15167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:15.215074 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-723eff67-c4ca-4d2f-99cc-c496def15167 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:41:15.216244 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-723eff67-c4ca-4d2f-99cc-c496def15167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:41:15.223747 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 601/1185] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:41:15 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:41:15.248302 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f5dfe-846c-4a5a-b70d-7640d6b88848 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:41:15.261568 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f5dfe-846c-4a5a-b70d-7640d6b88848 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:41:15.265993 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f411eb5-d475-48ba-b182-298dd0fa333f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:41:15.266761 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f411eb5-d475-48ba-b182-298dd0fa333f admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:15.267042 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f411eb5-d475-48ba-b182-298dd0fa333f admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:15.267320 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f411eb5-d475-48ba-b182-298dd0fa333f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:15.277319 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f411eb5-d475-48ba-b182-298dd0fa333f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:41:15.284241 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-4f411eb5-d475-48ba-b182-298dd0fa333f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 05 14:41:15.285407 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 585/1186] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:41:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:41:15.291270 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723eff67-c4ca-4d2f-99cc-c496def15167 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:41:15.299877 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723eff67-c4ca-4d2f-99cc-c496def15167 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:41:15.304847 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cd136-c898-44e8-bdcc-d4652ff35660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:41:15.305518 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cd136-c898-44e8-bdcc-d4652ff35660 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:15.305798 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cd136-c898-44e8-bdcc-d4652ff35660 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:15.306070 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cd136-c898-44e8-bdcc-d4652ff35660 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:15.306816 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9cd136-c898-44e8-bdcc-d4652ff35660 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:41:15.307116 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9cd136-c898-44e8-bdcc-d4652ff35660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:41:15.308688 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9cd136-c898-44e8-bdcc-d4652ff35660 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:41:15.316482 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 602/1187] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:41:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:41:15.322415 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f411eb5-d475-48ba-b182-298dd0fa333f admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:41:15.332934 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f411eb5-d475-48ba-b182-298dd0fa333f admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:41:15.337392 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341d929-ddb9-4158-a6a7-9e324b6a870d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:41:15.338202 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341d929-ddb9-4158-a6a7-9e324b6a870d admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:15.338478 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341d929-ddb9-4158-a6a7-9e324b6a870d admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:15.338747 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341d929-ddb9-4158-a6a7-9e324b6a870d admin admin] PATH_INFO: `/v3/users/7194ca2316f948028e2d1537a1641c7d` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:15.339913 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341d929-ddb9-4158-a6a7-9e324b6a870d admin admin] RBAC: Authorizing `identity:get_user(user_id=7194ca2316f948028e2d1537a1641c7d)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:41:15.342036 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341d929-ddb9-4158-a6a7-9e324b6a870d admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:41:15.343547 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 586/1188] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:41:15 2022] GET /identity/v3/users/7194ca2316f948028e2d1537a1641c7d => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:41:15.348639 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cd136-c898-44e8-bdcc-d4652ff35660 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:41:15.357652 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cd136-c898-44e8-bdcc-d4652ff35660 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:41:15.362102 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd893566-c7e4-4dea-bc27-730085894ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:41:15.362909 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd893566-c7e4-4dea-bc27-730085894ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:15.363186 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd893566-c7e4-4dea-bc27-730085894ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:15.363456 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd893566-c7e4-4dea-bc27-730085894ae3 admin admin] PATH_INFO: `/v3/projects/2f77b9c9dbb14f058377ec2aa0156835` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:15.364604 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd893566-c7e4-4dea-bc27-730085894ae3 admin admin] RBAC: Authorizing `identity:get_project(project_id=2f77b9c9dbb14f058377ec2aa0156835)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:41:15.367123 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd893566-c7e4-4dea-bc27-730085894ae3 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:41:15.368672 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 603/1189] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:41:15 2022] GET /identity/v3/projects/2f77b9c9dbb14f058377ec2aa0156835 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:41:15.373829 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341d929-ddb9-4158-a6a7-9e324b6a870d admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:41:15.384233 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341d929-ddb9-4158-a6a7-9e324b6a870d admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:41:15.390399 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffba62d-008c-4f46-b501-42f0a9f6d6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:41:15.391258 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffba62d-008c-4f46-b501-42f0a9f6d6f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:15.391543 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffba62d-008c-4f46-b501-42f0a9f6d6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:15.391807 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffba62d-008c-4f46-b501-42f0a9f6d6f8 admin admin] PATH_INFO: `/v3/projects/2f77b9c9dbb14f058377ec2aa0156835/users/7194ca2316f948028e2d1537a1641c7d/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:15.393781 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffba62d-008c-4f46-b501-42f0a9f6d6f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f77b9c9dbb14f058377ec2aa0156835, user_id=7194ca2316f948028e2d1537a1641c7d, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:41:15.396417 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffba62d-008c-4f46-b501-42f0a9f6d6f8 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:41:15.466926 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 587/1190] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Jan 5 14:41:15 2022] PUT /identity/v3/projects/2f77b9c9dbb14f058377ec2aa0156835/users/7194ca2316f948028e2d1537a1641c7d/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 14:41:17.812171 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4d540-a397-4a12-82ad-5c5a01d1915b None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:17.812680 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4d540-a397-4a12-82ad-5c5a01d1915b None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:17.812680 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4d540-a397-4a12-82ad-5c5a01d1915b None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:17.814434 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 604/1191] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:41:17.820085 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfe2ac-4af3-4f36-83b2-f66cda19aa78 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:17.820492 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfe2ac-4af3-4f36-83b2-f66cda19aa78 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:17.820629 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfe2ac-4af3-4f36-83b2-f66cda19aa78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:17.838389 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-d7cfe2ac-4af3-4f36-83b2-f66cda19aa78 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:41:17.839561 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-d7cfe2ac-4af3-4f36-83b2-f66cda19aa78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:41:17.893372 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 588/1192] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:41:17 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:41:17.918416 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4d540-a397-4a12-82ad-5c5a01d1915b None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:41:17.930197 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4d540-a397-4a12-82ad-5c5a01d1915b None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:41:17.934477 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21558f17-d30d-4bc3-862e-a1b906e7d165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:41:17.935242 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21558f17-d30d-4bc3-862e-a1b906e7d165 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:17.935525 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21558f17-d30d-4bc3-862e-a1b906e7d165 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:17.935798 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21558f17-d30d-4bc3-862e-a1b906e7d165 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:17.946550 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21558f17-d30d-4bc3-862e-a1b906e7d165 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:41:17.953582 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-21558f17-d30d-4bc3-862e-a1b906e7d165 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 05 14:41:17.954700 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 605/1193] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:41:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:41:17.960849 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfe2ac-4af3-4f36-83b2-f66cda19aa78 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:41:17.969561 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfe2ac-4af3-4f36-83b2-f66cda19aa78 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:41:17.974014 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd7844-7d3f-4e07-977e-9874695e3458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:41:17.974662 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd7844-7d3f-4e07-977e-9874695e3458 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:17.974946 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd7844-7d3f-4e07-977e-9874695e3458 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:17.975224 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd7844-7d3f-4e07-977e-9874695e3458 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:17.975976 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd7844-7d3f-4e07-977e-9874695e3458 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:41:17.976283 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd7844-7d3f-4e07-977e-9874695e3458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:41:17.977932 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd7844-7d3f-4e07-977e-9874695e3458 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:41:17.985886 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 589/1194] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:41:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:41:17.991106 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21558f17-d30d-4bc3-862e-a1b906e7d165 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:41:18.001015 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21558f17-d30d-4bc3-862e-a1b906e7d165 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:41:18.005446 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f0b10-33e9-4839-980b-ee5aa3d977d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:41:18.006753 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f0b10-33e9-4839-980b-ee5aa3d977d3 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:18.007028 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f0b10-33e9-4839-980b-ee5aa3d977d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:18.007297 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f0b10-33e9-4839-980b-ee5aa3d977d3 admin admin] PATH_INFO: `/v3/users/7194ca2316f948028e2d1537a1641c7d` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:18.008463 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f0b10-33e9-4839-980b-ee5aa3d977d3 admin admin] RBAC: Authorizing `identity:get_user(user_id=7194ca2316f948028e2d1537a1641c7d)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:41:18.010591 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f0b10-33e9-4839-980b-ee5aa3d977d3 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:41:18.012105 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 606/1195] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jan 5 14:41:17 2022] GET /identity/v3/users/7194ca2316f948028e2d1537a1641c7d => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:41:18.017304 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd7844-7d3f-4e07-977e-9874695e3458 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:41:18.026964 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd7844-7d3f-4e07-977e-9874695e3458 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:41:18.031400 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7560e0-fbc9-4ed4-9b07-59d6ad7bca78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:41:18.032000 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7560e0-fbc9-4ed4-9b07-59d6ad7bca78 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:18.032285 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7560e0-fbc9-4ed4-9b07-59d6ad7bca78 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:18.032563 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7560e0-fbc9-4ed4-9b07-59d6ad7bca78 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:18.040127 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7560e0-fbc9-4ed4-9b07-59d6ad7bca78 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:41:18.041871 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7560e0-fbc9-4ed4-9b07-59d6ad7bca78 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:41:18.050574 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 590/1196] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:41:18 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:41:18.056177 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f0b10-33e9-4839-980b-ee5aa3d977d3 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:41:18.065298 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f0b10-33e9-4839-980b-ee5aa3d977d3 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:41:18.070218 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a77f50-16c1-47cc-879b-acf674a6acde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:41:18.071011 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a77f50-16c1-47cc-879b-acf674a6acde admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:18.071296 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a77f50-16c1-47cc-879b-acf674a6acde admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:18.071569 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a77f50-16c1-47cc-879b-acf674a6acde admin admin] PATH_INFO: `/v3/projects/2f77b9c9dbb14f058377ec2aa0156835` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:18.072706 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a77f50-16c1-47cc-879b-acf674a6acde admin admin] RBAC: Authorizing `identity:get_project(project_id=2f77b9c9dbb14f058377ec2aa0156835)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:41:18.074705 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a77f50-16c1-47cc-879b-acf674a6acde admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:41:18.076262 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 607/1197] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:41:18 2022] GET /identity/v3/projects/2f77b9c9dbb14f058377ec2aa0156835 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:41:18.081627 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7560e0-fbc9-4ed4-9b07-59d6ad7bca78 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:41:18.089821 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7560e0-fbc9-4ed4-9b07-59d6ad7bca78 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:41:18.094213 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe18d87-9a58-4e16-91f2-d2d54338bf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:41:18.094807 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe18d87-9a58-4e16-91f2-d2d54338bf1b admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:41:18.095084 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe18d87-9a58-4e16-91f2-d2d54338bf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:41:18.095355 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe18d87-9a58-4e16-91f2-d2d54338bf1b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:41:18.096161 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe18d87-9a58-4e16-91f2-d2d54338bf1b admin admin] RBAC: Adding query filter params (role.id=494131614fcf424f92e0817fa7ff6961, scope.project.id=2f77b9c9dbb14f058377ec2aa0156835, user.id=7194ca2316f948028e2d1537a1641c7d) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:41:18.096464 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe18d87-9a58-4e16-91f2-d2d54338bf1b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:41:18.098272 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe18d87-9a58-4e16-91f2-d2d54338bf1b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:41:18.103727 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 591/1198] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:41:18 2022] GET /identity/v3/role_assignments?user.id=7194ca2316f948028e2d1537a1641c7d&scope.project.id=2f77b9c9dbb14f058377ec2aa0156835&role.id=494131614fcf424f92e0817fa7ff6961 => generated 608 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:42:40.219272 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21c795-6ae7-40e0-897a-74384269b17b None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:40.219855 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21c795-6ae7-40e0-897a-74384269b17b None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:40.219855 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21c795-6ae7-40e0-897a-74384269b17b None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:40.221791 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 608/1199] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:42:40.226686 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400c9df-a127-46c5-8e96-3c5e93ebb55d None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:40.227079 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400c9df-a127-46c5-8e96-3c5e93ebb55d None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:40.227232 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400c9df-a127-46c5-8e96-3c5e93ebb55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:40.244786 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-a400c9df-a127-46c5-8e96-3c5e93ebb55d None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:42:40.246087 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-a400c9df-a127-46c5-8e96-3c5e93ebb55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:42:40.255073 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 592/1200] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:42:40 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:42:40.283664 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21c795-6ae7-40e0-897a-74384269b17b None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:40.295930 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21c795-6ae7-40e0-897a-74384269b17b None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:40.300582 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df186c9-625e-4c41-8841-6426afd4657c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:40.301400 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df186c9-625e-4c41-8841-6426afd4657c admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:40.301689 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df186c9-625e-4c41-8841-6426afd4657c admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:40.301965 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df186c9-625e-4c41-8841-6426afd4657c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:40.312087 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df186c9-625e-4c41-8841-6426afd4657c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:40.313948 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df186c9-625e-4c41-8841-6426afd4657c admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:40.330970 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-4df186c9-625e-4c41-8841-6426afd4657c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:42:40.332732 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 609/1201] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:42:40.338667 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400c9df-a127-46c5-8e96-3c5e93ebb55d None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:40.347463 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400c9df-a127-46c5-8e96-3c5e93ebb55d None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:40.351991 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b0547-1aaa-494d-a8e2-48d909885169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:40.352631 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b0547-1aaa-494d-a8e2-48d909885169 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:40.352915 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b0547-1aaa-494d-a8e2-48d909885169 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:40.353237 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b0547-1aaa-494d-a8e2-48d909885169 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:40.354067 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b0547-1aaa-494d-a8e2-48d909885169 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:40.354375 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b0547-1aaa-494d-a8e2-48d909885169 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:40.355973 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b0547-1aaa-494d-a8e2-48d909885169 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:40.367012 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 593/1202] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:42:40.372190 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df186c9-625e-4c41-8841-6426afd4657c admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:40.382340 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df186c9-625e-4c41-8841-6426afd4657c admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:40.387013 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca09a09-f066-4a4b-96d1-0273592a13f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:40.387646 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca09a09-f066-4a4b-96d1-0273592a13f2 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:40.387926 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca09a09-f066-4a4b-96d1-0273592a13f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:40.388232 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca09a09-f066-4a4b-96d1-0273592a13f2 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:40.388947 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca09a09-f066-4a4b-96d1-0273592a13f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:40.390872 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca09a09-f066-4a4b-96d1-0273592a13f2 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:40.487305 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 610/1203] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Jan 5 14:42:40 2022] POST /identity/v3/users => generated 251 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 14:42:42.921097 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597549a-acd1-4c78-b87a-0ed0968f56b5 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:42.921617 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597549a-acd1-4c78-b87a-0ed0968f56b5 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:42.921744 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597549a-acd1-4c78-b87a-0ed0968f56b5 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:42.923492 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 594/1204] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:42:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:42:42.929055 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee79fa-6110-4f8e-a7c2-29605ff1868c None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:42.929495 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee79fa-6110-4f8e-a7c2-29605ff1868c None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:42.929629 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee79fa-6110-4f8e-a7c2-29605ff1868c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:42.947543 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-31ee79fa-6110-4f8e-a7c2-29605ff1868c None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:42:42.948707 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-31ee79fa-6110-4f8e-a7c2-29605ff1868c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:42:42.956670 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 611/1205] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:42:42 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:42:42.981591 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597549a-acd1-4c78-b87a-0ed0968f56b5 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:42.994459 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597549a-acd1-4c78-b87a-0ed0968f56b5 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:42.999185 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1b878-2375-4e0c-9fc0-654fb682fafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:42.999994 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1b878-2375-4e0c-9fc0-654fb682fafd admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:43.000275 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1b878-2375-4e0c-9fc0-654fb682fafd admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:43.000548 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1b878-2375-4e0c-9fc0-654fb682fafd admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:43.011890 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce1b878-2375-4e0c-9fc0-654fb682fafd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:42:43.019102 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-6ce1b878-2375-4e0c-9fc0-654fb682fafd admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 05 14:42:43.020271 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 595/1206] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Jan 5 14:42:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:42:43.026115 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee79fa-6110-4f8e-a7c2-29605ff1868c None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:43.034801 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee79fa-6110-4f8e-a7c2-29605ff1868c None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:43.039409 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8206cad-bc34-4e8d-a969-6669d7108ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:43.042294 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8206cad-bc34-4e8d-a969-6669d7108ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:43.042294 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8206cad-bc34-4e8d-a969-6669d7108ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:43.042294 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8206cad-bc34-4e8d-a969-6669d7108ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:43.042294 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8206cad-bc34-4e8d-a969-6669d7108ae4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:43.042294 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8206cad-bc34-4e8d-a969-6669d7108ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:43.043357 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8206cad-bc34-4e8d-a969-6669d7108ae4 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:43.051744 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 612/1207] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Jan 5 14:42:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:42:43.057500 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1b878-2375-4e0c-9fc0-654fb682fafd admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:43.067657 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1b878-2375-4e0c-9fc0-654fb682fafd admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:43.072226 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fed262-b33f-4cec-bc04-6c67ada6c7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:43.072987 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fed262-b33f-4cec-bc04-6c67ada6c7fb admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:43.073303 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fed262-b33f-4cec-bc04-6c67ada6c7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:43.073581 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fed262-b33f-4cec-bc04-6c67ada6c7fb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:43.083703 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fed262-b33f-4cec-bc04-6c67ada6c7fb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:43.085556 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fed262-b33f-4cec-bc04-6c67ada6c7fb admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:43.102171 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-b3fed262-b33f-4cec-bc04-6c67ada6c7fb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:42:43.103356 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 596/1208] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:42:43.108984 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8206cad-bc34-4e8d-a969-6669d7108ae4 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:43.118894 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8206cad-bc34-4e8d-a969-6669d7108ae4 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:43.123738 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1441cd-bac2-4054-aec7-005ab4f13354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:43.124367 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1441cd-bac2-4054-aec7-005ab4f13354 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:43.124651 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1441cd-bac2-4054-aec7-005ab4f13354 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:43.124926 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1441cd-bac2-4054-aec7-005ab4f13354 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:43.125680 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1441cd-bac2-4054-aec7-005ab4f13354 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:43.125984 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1441cd-bac2-4054-aec7-005ab4f13354 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:43.127547 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1441cd-bac2-4054-aec7-005ab4f13354 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:43.139362 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 613/1209] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:42:43.144776 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fed262-b33f-4cec-bc04-6c67ada6c7fb admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:43.154214 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fed262-b33f-4cec-bc04-6c67ada6c7fb admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:43.158822 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983decc0-158a-45a9-b40b-e44252876489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:43.160112 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983decc0-158a-45a9-b40b-e44252876489 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:43.160394 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983decc0-158a-45a9-b40b-e44252876489 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:43.160666 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983decc0-158a-45a9-b40b-e44252876489 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:43.167907 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983decc0-158a-45a9-b40b-e44252876489 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:43.169978 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983decc0-158a-45a9-b40b-e44252876489 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:43.184535 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-983decc0-158a-45a9-b40b-e44252876489 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 05 14:42:43.185606 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 597/1210] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:42:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:42:43.191125 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1441cd-bac2-4054-aec7-005ab4f13354 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:43.200563 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1441cd-bac2-4054-aec7-005ab4f13354 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:43.205162 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675cc3e-e04e-4598-a351-c4d4463067dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:43.205884 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675cc3e-e04e-4598-a351-c4d4463067dc admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:43.206170 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675cc3e-e04e-4598-a351-c4d4463067dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:43.206447 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675cc3e-e04e-4598-a351-c4d4463067dc admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:43.207289 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f675cc3e-e04e-4598-a351-c4d4463067dc admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:43.207597 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f675cc3e-e04e-4598-a351-c4d4463067dc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:43.209476 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f675cc3e-e04e-4598-a351-c4d4463067dc admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:43.227484 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 614/1211] 10.222.0.30 () {56 vars in 1164 bytes} [Wed Jan 5 14:42:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:42:43.233043 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983decc0-158a-45a9-b40b-e44252876489 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:43.243147 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983decc0-158a-45a9-b40b-e44252876489 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:43.247605 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca01214-9973-46a0-bcfc-5a9b660796ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:43.248961 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca01214-9973-46a0-bcfc-5a9b660796ad admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:43.248961 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca01214-9973-46a0-bcfc-5a9b660796ad admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:43.249297 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca01214-9973-46a0-bcfc-5a9b660796ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:43.256777 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca01214-9973-46a0-bcfc-5a9b660796ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:43.258560 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca01214-9973-46a0-bcfc-5a9b660796ad admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:43.267387 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 598/1212] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:42:43 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:42:43.272892 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675cc3e-e04e-4598-a351-c4d4463067dc admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:43.282353 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675cc3e-e04e-4598-a351-c4d4463067dc admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:43.287397 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab612767-0642-44c0-9608-cdad771e96ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:43.288169 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab612767-0642-44c0-9608-cdad771e96ed admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:43.288460 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab612767-0642-44c0-9608-cdad771e96ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:43.288778 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab612767-0642-44c0-9608-cdad771e96ed admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:43.298736 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab612767-0642-44c0-9608-cdad771e96ed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:43.301224 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab612767-0642-44c0-9608-cdad771e96ed admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:43.431105 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-ab612767-0642-44c0-9608-cdad771e96ed admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:42:43.432303 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 615/1213] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:42:43.438361 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca01214-9973-46a0-bcfc-5a9b660796ad admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:43.448042 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca01214-9973-46a0-bcfc-5a9b660796ad admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:43.452669 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa0eaa-3631-4238-a065-cbaf1f2a5f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:43.453332 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa0eaa-3631-4238-a065-cbaf1f2a5f2b admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:43.453618 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa0eaa-3631-4238-a065-cbaf1f2a5f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:43.453893 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa0eaa-3631-4238-a065-cbaf1f2a5f2b admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:43.454613 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa0eaa-3631-4238-a065-cbaf1f2a5f2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:43.454916 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa0eaa-3631-4238-a065-cbaf1f2a5f2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:43.457246 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa0eaa-3631-4238-a065-cbaf1f2a5f2b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:43.468213 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 599/1214] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:42:43.473803 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab612767-0642-44c0-9608-cdad771e96ed admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:43.483297 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab612767-0642-44c0-9608-cdad771e96ed admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:43.487831 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a7914-3cb7-48c0-bec2-b34b3a57bd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:43.488611 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a7914-3cb7-48c0-bec2-b34b3a57bd15 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:43.488894 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a7914-3cb7-48c0-bec2-b34b3a57bd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:43.489209 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a7914-3cb7-48c0-bec2-b34b3a57bd15 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:43.495945 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a7914-3cb7-48c0-bec2-b34b3a57bd15 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:43.498170 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a7914-3cb7-48c0-bec2-b34b3a57bd15 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:43.512196 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-914a7914-3cb7-48c0-bec2-b34b3a57bd15 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:42:43.513353 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 616/1215] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:42:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:42:43.519696 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa0eaa-3631-4238-a065-cbaf1f2a5f2b admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:43.529420 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa0eaa-3631-4238-a065-cbaf1f2a5f2b admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:43.534106 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c308c5-8582-40d1-b87f-da7d31f8c8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:43.534710 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c308c5-8582-40d1-b87f-da7d31f8c8da admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:43.534995 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c308c5-8582-40d1-b87f-da7d31f8c8da admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:43.535279 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c308c5-8582-40d1-b87f-da7d31f8c8da admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:43.536189 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c308c5-8582-40d1-b87f-da7d31f8c8da admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:43.536500 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c308c5-8582-40d1-b87f-da7d31f8c8da admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:43.538368 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c308c5-8582-40d1-b87f-da7d31f8c8da admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:43.551068 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 600/1216] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:42:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:42:43.557087 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a7914-3cb7-48c0-bec2-b34b3a57bd15 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:43.567433 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a7914-3cb7-48c0-bec2-b34b3a57bd15 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:43.571931 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff75f08-f63d-409b-8c0e-0d0a1c12020d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:43.572562 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff75f08-f63d-409b-8c0e-0d0a1c12020d admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:43.572851 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff75f08-f63d-409b-8c0e-0d0a1c12020d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:43.573169 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff75f08-f63d-409b-8c0e-0d0a1c12020d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:43.574005 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff75f08-f63d-409b-8c0e-0d0a1c12020d admin admin] RBAC: Adding query filter params (role.id=9868670385c0469093001f6f2c310f1a, scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1, user.id=8847b97a7089420a8b8b817f3059c660) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:43.574317 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff75f08-f63d-409b-8c0e-0d0a1c12020d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:43.576148 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff75f08-f63d-409b-8c0e-0d0a1c12020d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:43.581445 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 617/1217] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:42:43 2022] GET /identity/v3/role_assignments?user.id=8847b97a7089420a8b8b817f3059c660&scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1&role.id=9868670385c0469093001f6f2c310f1a => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:42:45.988730 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a07eb-0f6d-4de0-8158-3ad722c25bf6 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:45.989313 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a07eb-0f6d-4de0-8158-3ad722c25bf6 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:45.989313 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a07eb-0f6d-4de0-8158-3ad722c25bf6 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:45.991093 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 601/1218] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:42:45.996140 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ba509-69a0-427e-bb76-1fa8d61d5e86 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:45.996576 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ba509-69a0-427e-bb76-1fa8d61d5e86 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:45.996677 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ba509-69a0-427e-bb76-1fa8d61d5e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:46.014490 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-ac1ba509-69a0-427e-bb76-1fa8d61d5e86 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:42:46.015673 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-ac1ba509-69a0-427e-bb76-1fa8d61d5e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:42:46.023830 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 618/1219] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:42:45 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:42:46.048867 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a07eb-0f6d-4de0-8158-3ad722c25bf6 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:46.061532 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a07eb-0f6d-4de0-8158-3ad722c25bf6 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:46.065878 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dec65e-203d-45b3-880f-ae1f87f6e421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:46.066670 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dec65e-203d-45b3-880f-ae1f87f6e421 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:46.066949 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dec65e-203d-45b3-880f-ae1f87f6e421 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:46.067223 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dec65e-203d-45b3-880f-ae1f87f6e421 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:46.077047 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dec65e-203d-45b3-880f-ae1f87f6e421 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:42:46.084760 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-45dec65e-203d-45b3-880f-ae1f87f6e421 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 05 14:42:46.085920 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 602/1220] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Jan 5 14:42:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:42:46.091723 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ba509-69a0-427e-bb76-1fa8d61d5e86 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:46.101116 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ba509-69a0-427e-bb76-1fa8d61d5e86 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:46.105598 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fcc3dc-4c66-4c85-84b2-bb6f29c5f136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:46.106246 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcc3dc-4c66-4c85-84b2-bb6f29c5f136 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:46.106525 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcc3dc-4c66-4c85-84b2-bb6f29c5f136 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:46.106799 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcc3dc-4c66-4c85-84b2-bb6f29c5f136 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:46.107550 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fcc3dc-4c66-4c85-84b2-bb6f29c5f136 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:46.107851 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fcc3dc-4c66-4c85-84b2-bb6f29c5f136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:46.109477 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fcc3dc-4c66-4c85-84b2-bb6f29c5f136 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:46.117451 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 619/1221] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Jan 5 14:42:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:42:46.122463 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dec65e-203d-45b3-880f-ae1f87f6e421 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:46.132612 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dec65e-203d-45b3-880f-ae1f87f6e421 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:46.137301 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149fe8cd-f1f8-4243-bfd5-aa7e6b7b6772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:46.138081 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fe8cd-f1f8-4243-bfd5-aa7e6b7b6772 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:46.138368 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fe8cd-f1f8-4243-bfd5-aa7e6b7b6772 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:46.138652 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fe8cd-f1f8-4243-bfd5-aa7e6b7b6772 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:46.149368 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149fe8cd-f1f8-4243-bfd5-aa7e6b7b6772 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:46.151178 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149fe8cd-f1f8-4243-bfd5-aa7e6b7b6772 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:46.168125 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-149fe8cd-f1f8-4243-bfd5-aa7e6b7b6772 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:42:46.169288 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 603/1222] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:42:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:42:46.174785 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fcc3dc-4c66-4c85-84b2-bb6f29c5f136 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:46.184205 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fcc3dc-4c66-4c85-84b2-bb6f29c5f136 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:46.188697 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4efdd3c-ac32-498b-96b8-80dd15c511de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:46.189374 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efdd3c-ac32-498b-96b8-80dd15c511de admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:46.189682 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efdd3c-ac32-498b-96b8-80dd15c511de admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:46.189962 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efdd3c-ac32-498b-96b8-80dd15c511de admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:46.190685 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4efdd3c-ac32-498b-96b8-80dd15c511de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:46.191490 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4efdd3c-ac32-498b-96b8-80dd15c511de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:46.193080 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4efdd3c-ac32-498b-96b8-80dd15c511de admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:46.204420 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 620/1223] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:42:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:42:46.210101 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149fe8cd-f1f8-4243-bfd5-aa7e6b7b6772 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:46.219471 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149fe8cd-f1f8-4243-bfd5-aa7e6b7b6772 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:46.224039 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25166027-80f0-4720-bdb0-8ab9fa5830b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:46.224813 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25166027-80f0-4720-bdb0-8ab9fa5830b6 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:46.225115 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25166027-80f0-4720-bdb0-8ab9fa5830b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:46.225390 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25166027-80f0-4720-bdb0-8ab9fa5830b6 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:46.232485 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25166027-80f0-4720-bdb0-8ab9fa5830b6 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:46.234498 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25166027-80f0-4720-bdb0-8ab9fa5830b6 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:46.248548 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-25166027-80f0-4720-bdb0-8ab9fa5830b6 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 05 14:42:46.249627 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 604/1224] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:42:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:42:46.255742 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4efdd3c-ac32-498b-96b8-80dd15c511de admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:46.265633 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4efdd3c-ac32-498b-96b8-80dd15c511de admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:46.270781 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05757de-160c-45c4-a573-205aed2503aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:46.271421 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05757de-160c-45c4-a573-205aed2503aa admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:46.271699 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05757de-160c-45c4-a573-205aed2503aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:46.271971 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05757de-160c-45c4-a573-205aed2503aa admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:46.272804 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05757de-160c-45c4-a573-205aed2503aa admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:46.273133 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05757de-160c-45c4-a573-205aed2503aa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:46.275106 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05757de-160c-45c4-a573-205aed2503aa admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:46.291808 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 621/1225] 10.222.0.30 () {56 vars in 1164 bytes} [Wed Jan 5 14:42:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:42:46.297245 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25166027-80f0-4720-bdb0-8ab9fa5830b6 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:46.306596 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25166027-80f0-4720-bdb0-8ab9fa5830b6 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:46.311061 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f911512-d09a-4ac1-b8fb-58febc06628d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:46.311816 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f911512-d09a-4ac1-b8fb-58febc06628d admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:46.312094 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f911512-d09a-4ac1-b8fb-58febc06628d admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:46.312363 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f911512-d09a-4ac1-b8fb-58febc06628d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:46.322678 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f911512-d09a-4ac1-b8fb-58febc06628d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:46.324499 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f911512-d09a-4ac1-b8fb-58febc06628d admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:46.341284 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-9f911512-d09a-4ac1-b8fb-58febc06628d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:42:46.342379 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 605/1226] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:42:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:42:46.347647 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05757de-160c-45c4-a573-205aed2503aa admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:46.357219 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05757de-160c-45c4-a573-205aed2503aa admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:46.361765 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8eeb64-7083-45ad-9c06-8975f3a42b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:46.362441 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8eeb64-7083-45ad-9c06-8975f3a42b7f admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:46.362723 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8eeb64-7083-45ad-9c06-8975f3a42b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:46.362998 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8eeb64-7083-45ad-9c06-8975f3a42b7f admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:46.363717 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8eeb64-7083-45ad-9c06-8975f3a42b7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:46.364019 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8eeb64-7083-45ad-9c06-8975f3a42b7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:46.365629 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8eeb64-7083-45ad-9c06-8975f3a42b7f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:46.376700 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 622/1227] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:42:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:42:46.382314 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f911512-d09a-4ac1-b8fb-58febc06628d admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:46.391606 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f911512-d09a-4ac1-b8fb-58febc06628d admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:46.396719 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66647691-ef84-415d-b48c-30dfb0edb962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:46.400503 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66647691-ef84-415d-b48c-30dfb0edb962 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:46.400503 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66647691-ef84-415d-b48c-30dfb0edb962 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:46.400503 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66647691-ef84-415d-b48c-30dfb0edb962 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:46.404842 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66647691-ef84-415d-b48c-30dfb0edb962 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:46.406830 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66647691-ef84-415d-b48c-30dfb0edb962 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:46.419839 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-66647691-ef84-415d-b48c-30dfb0edb962 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:42:46.421017 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 606/1228] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:42:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:42:46.426372 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8eeb64-7083-45ad-9c06-8975f3a42b7f admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:46.435575 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8eeb64-7083-45ad-9c06-8975f3a42b7f admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:46.440240 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba161ecf-5cbc-43d1-9e5e-97b8c6b4fe34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:46.441401 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba161ecf-5cbc-43d1-9e5e-97b8c6b4fe34 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:46.441681 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba161ecf-5cbc-43d1-9e5e-97b8c6b4fe34 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:46.441953 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba161ecf-5cbc-43d1-9e5e-97b8c6b4fe34 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:46.442730 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba161ecf-5cbc-43d1-9e5e-97b8c6b4fe34 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:46.443033 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba161ecf-5cbc-43d1-9e5e-97b8c6b4fe34 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:46.444904 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba161ecf-5cbc-43d1-9e5e-97b8c6b4fe34 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:46.456959 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 623/1229] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:42:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:42:46.462543 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66647691-ef84-415d-b48c-30dfb0edb962 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:46.473822 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66647691-ef84-415d-b48c-30dfb0edb962 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:46.478237 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79175c31-55db-43f2-a0b8-99a512edc443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:46.479082 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79175c31-55db-43f2-a0b8-99a512edc443 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:46.479358 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79175c31-55db-43f2-a0b8-99a512edc443 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:46.479628 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79175c31-55db-43f2-a0b8-99a512edc443 admin admin] PATH_INFO: `/v3/projects/fbf90e947f3a4fcdb6f42646a4bf34a1/users/8847b97a7089420a8b8b817f3059c660/roles/9868670385c0469093001f6f2c310f1a` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:46.493564 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79175c31-55db-43f2-a0b8-99a512edc443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf90e947f3a4fcdb6f42646a4bf34a1, user_id=8847b97a7089420a8b8b817f3059c660, role_id=9868670385c0469093001f6f2c310f1a)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:46.497194 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79175c31-55db-43f2-a0b8-99a512edc443 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:46.664406 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 607/1230] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Jan 5 14:42:46 2022] PUT /identity/v3/projects/fbf90e947f3a4fcdb6f42646a4bf34a1/users/8847b97a7089420a8b8b817f3059c660/roles/9868670385c0469093001f6f2c310f1a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 14:42:49.049084 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1c7e7-d5f4-4829-aead-0654aa4526ad None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:49.049612 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1c7e7-d5f4-4829-aead-0654aa4526ad None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:49.049704 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1c7e7-d5f4-4829-aead-0654aa4526ad None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:49.051901 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 624/1231] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:42:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:42:49.057010 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877eb994-feaa-465c-b673-af3a8b0b1fa1 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:49.057503 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877eb994-feaa-465c-b673-af3a8b0b1fa1 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:49.057694 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877eb994-feaa-465c-b673-af3a8b0b1fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:49.075604 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-877eb994-feaa-465c-b673-af3a8b0b1fa1 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:42:49.076818 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-877eb994-feaa-465c-b673-af3a8b0b1fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:42:49.134649 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 608/1232] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:42:49 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:42:49.162818 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1c7e7-d5f4-4829-aead-0654aa4526ad None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:49.175069 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1c7e7-d5f4-4829-aead-0654aa4526ad None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:49.179924 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68aaf6-8bdc-48ef-8079-6d77a2a42be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:49.180734 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68aaf6-8bdc-48ef-8079-6d77a2a42be0 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:49.181009 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68aaf6-8bdc-48ef-8079-6d77a2a42be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:49.181313 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68aaf6-8bdc-48ef-8079-6d77a2a42be0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:49.191734 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68aaf6-8bdc-48ef-8079-6d77a2a42be0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:42:49.199008 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-2b68aaf6-8bdc-48ef-8079-6d77a2a42be0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 05 14:42:49.200370 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 625/1233] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Jan 5 14:42:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:42:49.206029 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877eb994-feaa-465c-b673-af3a8b0b1fa1 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:49.215397 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877eb994-feaa-465c-b673-af3a8b0b1fa1 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:49.219850 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba2a9b-4610-47c2-a232-ae463ab74af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:49.220526 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba2a9b-4610-47c2-a232-ae463ab74af4 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:49.220823 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba2a9b-4610-47c2-a232-ae463ab74af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:49.221117 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba2a9b-4610-47c2-a232-ae463ab74af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:49.221870 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba2a9b-4610-47c2-a232-ae463ab74af4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:49.222173 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba2a9b-4610-47c2-a232-ae463ab74af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:49.223764 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba2a9b-4610-47c2-a232-ae463ab74af4 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:49.231533 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 609/1234] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Jan 5 14:42:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:42:49.236881 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68aaf6-8bdc-48ef-8079-6d77a2a42be0 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:49.246926 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68aaf6-8bdc-48ef-8079-6d77a2a42be0 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:49.251619 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ff4dd-03c1-4021-8ef8-6bda02e902cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:49.252368 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ff4dd-03c1-4021-8ef8-6bda02e902cd admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:49.252645 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ff4dd-03c1-4021-8ef8-6bda02e902cd admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:49.252915 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ff4dd-03c1-4021-8ef8-6bda02e902cd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:49.263188 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ff4dd-03c1-4021-8ef8-6bda02e902cd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:49.265408 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ff4dd-03c1-4021-8ef8-6bda02e902cd admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:49.282638 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-486ff4dd-03c1-4021-8ef8-6bda02e902cd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:42:49.283812 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 626/1235] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:42:49.289274 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba2a9b-4610-47c2-a232-ae463ab74af4 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:49.298672 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba2a9b-4610-47c2-a232-ae463ab74af4 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:49.303269 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271346d7-7b9c-4693-b6c7-e1ae6c701fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:49.303849 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271346d7-7b9c-4693-b6c7-e1ae6c701fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:49.304130 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271346d7-7b9c-4693-b6c7-e1ae6c701fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:49.304402 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271346d7-7b9c-4693-b6c7-e1ae6c701fd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:49.305146 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271346d7-7b9c-4693-b6c7-e1ae6c701fd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:49.305449 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271346d7-7b9c-4693-b6c7-e1ae6c701fd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:49.307028 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271346d7-7b9c-4693-b6c7-e1ae6c701fd2 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:49.322810 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 610/1236] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:42:49.325432 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ff4dd-03c1-4021-8ef8-6bda02e902cd admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:49.335503 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ff4dd-03c1-4021-8ef8-6bda02e902cd admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:49.340188 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd2ded-48e7-4500-b088-82d0bf4ad90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:49.340977 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd2ded-48e7-4500-b088-82d0bf4ad90c admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:49.341296 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd2ded-48e7-4500-b088-82d0bf4ad90c admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:49.341574 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd2ded-48e7-4500-b088-82d0bf4ad90c admin admin] PATH_INFO: `/v3/users/placement` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:49.348711 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd2ded-48e7-4500-b088-82d0bf4ad90c admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:49.350756 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd2ded-48e7-4500-b088-82d0bf4ad90c admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:49.364801 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-64dd2ded-48e7-4500-b088-82d0bf4ad90c admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 05 14:42:49.366047 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 627/1237] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:42:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:42:49.371339 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271346d7-7b9c-4693-b6c7-e1ae6c701fd2 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:49.381505 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271346d7-7b9c-4693-b6c7-e1ae6c701fd2 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:49.386083 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4001bd-27f5-49d0-acd5-95b728eb9a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:49.386722 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4001bd-27f5-49d0-acd5-95b728eb9a96 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:49.387002 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4001bd-27f5-49d0-acd5-95b728eb9a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:49.387274 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4001bd-27f5-49d0-acd5-95b728eb9a96 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:49.388141 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4001bd-27f5-49d0-acd5-95b728eb9a96 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:49.388445 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4001bd-27f5-49d0-acd5-95b728eb9a96 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:49.390314 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4001bd-27f5-49d0-acd5-95b728eb9a96 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:49.407454 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 611/1238] 10.222.0.30 () {56 vars in 1164 bytes} [Wed Jan 5 14:42:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:42:49.412804 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd2ded-48e7-4500-b088-82d0bf4ad90c admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:49.422299 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd2ded-48e7-4500-b088-82d0bf4ad90c admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:49.426826 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af00181-8b41-470c-96a4-021331b21345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:49.427437 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af00181-8b41-470c-96a4-021331b21345 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:49.427719 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af00181-8b41-470c-96a4-021331b21345 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:49.427992 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af00181-8b41-470c-96a4-021331b21345 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:49.435693 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af00181-8b41-470c-96a4-021331b21345 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:49.437470 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af00181-8b41-470c-96a4-021331b21345 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:49.446620 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 628/1239] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:42:49 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:42:49.451878 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4001bd-27f5-49d0-acd5-95b728eb9a96 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:49.461728 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4001bd-27f5-49d0-acd5-95b728eb9a96 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:49.466192 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68b372-70e5-4ae3-89fa-9242d1cacb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:49.466950 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68b372-70e5-4ae3-89fa-9242d1cacb0c admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:49.467235 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68b372-70e5-4ae3-89fa-9242d1cacb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:49.467498 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68b372-70e5-4ae3-89fa-9242d1cacb0c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:49.477383 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68b372-70e5-4ae3-89fa-9242d1cacb0c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:49.479788 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68b372-70e5-4ae3-89fa-9242d1cacb0c admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:49.495621 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-7d68b372-70e5-4ae3-89fa-9242d1cacb0c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:42:49.496733 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 612/1240] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:42:49.502494 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af00181-8b41-470c-96a4-021331b21345 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:49.512130 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af00181-8b41-470c-96a4-021331b21345 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:49.516706 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb0cee-6e7a-44a7-ade0-5b3c415c1247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:49.517407 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb0cee-6e7a-44a7-ade0-5b3c415c1247 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:49.518603 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb0cee-6e7a-44a7-ade0-5b3c415c1247 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:49.518603 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb0cee-6e7a-44a7-ade0-5b3c415c1247 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:49.518774 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb0cee-6e7a-44a7-ade0-5b3c415c1247 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:49.519588 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb0cee-6e7a-44a7-ade0-5b3c415c1247 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:49.521176 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb0cee-6e7a-44a7-ade0-5b3c415c1247 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:49.532304 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 629/1241] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:42:49.537478 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68b372-70e5-4ae3-89fa-9242d1cacb0c admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:49.546785 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68b372-70e5-4ae3-89fa-9242d1cacb0c admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:49.551850 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69009a25-7296-44da-bb49-7e4a78075592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:49.552604 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69009a25-7296-44da-bb49-7e4a78075592 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:49.552881 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69009a25-7296-44da-bb49-7e4a78075592 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:49.553190 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69009a25-7296-44da-bb49-7e4a78075592 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:49.559940 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69009a25-7296-44da-bb49-7e4a78075592 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:49.561955 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69009a25-7296-44da-bb49-7e4a78075592 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:49.575406 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-69009a25-7296-44da-bb49-7e4a78075592 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:42:49.576539 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 613/1242] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:42:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:42:49.581997 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb0cee-6e7a-44a7-ade0-5b3c415c1247 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:49.591373 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb0cee-6e7a-44a7-ade0-5b3c415c1247 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:49.596037 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a9e7f-07c3-4868-903b-236d7ed4a041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:49.596663 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a9e7f-07c3-4868-903b-236d7ed4a041 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:49.596945 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a9e7f-07c3-4868-903b-236d7ed4a041 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:49.597281 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a9e7f-07c3-4868-903b-236d7ed4a041 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:49.598058 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a9e7f-07c3-4868-903b-236d7ed4a041 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:49.598361 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a9e7f-07c3-4868-903b-236d7ed4a041 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:49.600232 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a9e7f-07c3-4868-903b-236d7ed4a041 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:49.612056 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 630/1243] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:42:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:42:49.618229 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69009a25-7296-44da-bb49-7e4a78075592 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:49.629218 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69009a25-7296-44da-bb49-7e4a78075592 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:49.633997 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fcb1b3-c49f-485b-b805-dcc4740ce7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:49.634656 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcb1b3-c49f-485b-b805-dcc4740ce7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:49.640740 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcb1b3-c49f-485b-b805-dcc4740ce7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:49.640740 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcb1b3-c49f-485b-b805-dcc4740ce7a0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:49.640740 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fcb1b3-c49f-485b-b805-dcc4740ce7a0 admin admin] RBAC: Adding query filter params (role.id=9868670385c0469093001f6f2c310f1a, scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1, user.id=8847b97a7089420a8b8b817f3059c660) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:49.640740 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fcb1b3-c49f-485b-b805-dcc4740ce7a0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:49.640740 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fcb1b3-c49f-485b-b805-dcc4740ce7a0 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:49.644068 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 614/1244] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:42:49 2022] GET /identity/v3/role_assignments?user.id=8847b97a7089420a8b8b817f3059c660&scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1&role.id=9868670385c0469093001f6f2c310f1a => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:42:52.116893 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016406c-d019-41d4-b8a1-f36fae8e21eb None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:52.117674 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016406c-d019-41d4-b8a1-f36fae8e21eb None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:52.117674 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016406c-d019-41d4-b8a1-f36fae8e21eb None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:52.119322 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 631/1245] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:42:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 14:42:52.124839 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7cf6c-f799-4416-bd01-425b1d9d5b2a None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:52.125255 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7cf6c-f799-4416-bd01-425b1d9d5b2a None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:52.125419 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7cf6c-f799-4416-bd01-425b1d9d5b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:52.142154 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-08d7cf6c-f799-4416-bd01-425b1d9d5b2a None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:42:52.143316 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-08d7cf6c-f799-4416-bd01-425b1d9d5b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:42:52.152301 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 615/1246] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:42:52 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:42:52.178201 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016406c-d019-41d4-b8a1-f36fae8e21eb None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:52.190163 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016406c-d019-41d4-b8a1-f36fae8e21eb None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:52.195015 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34eb33-ec08-4576-8735-f2e595698d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:52.195782 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34eb33-ec08-4576-8735-f2e595698d63 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:52.200022 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34eb33-ec08-4576-8735-f2e595698d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:52.200022 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34eb33-ec08-4576-8735-f2e595698d63 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:52.206168 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34eb33-ec08-4576-8735-f2e595698d63 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:42:52.213916 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-5a34eb33-ec08-4576-8735-f2e595698d63 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 05 14:42:52.215092 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 632/1247] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:42:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:42:52.220962 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7cf6c-f799-4416-bd01-425b1d9d5b2a None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:52.229846 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7cf6c-f799-4416-bd01-425b1d9d5b2a None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:52.234273 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a47a3-f726-4239-bddc-b42df5fa2a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:52.234911 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a47a3-f726-4239-bddc-b42df5fa2a21 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:52.235191 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a47a3-f726-4239-bddc-b42df5fa2a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:52.235497 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a47a3-f726-4239-bddc-b42df5fa2a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:52.236241 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a47a3-f726-4239-bddc-b42df5fa2a21 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:52.236549 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a47a3-f726-4239-bddc-b42df5fa2a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:52.238217 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a47a3-f726-4239-bddc-b42df5fa2a21 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:52.246158 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 616/1248] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:42:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:42:52.251694 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34eb33-ec08-4576-8735-f2e595698d63 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:52.262301 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34eb33-ec08-4576-8735-f2e595698d63 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:52.266797 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b127667-892a-491d-a862-fcfb98fe2410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:52.267556 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b127667-892a-491d-a862-fcfb98fe2410 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:52.267835 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b127667-892a-491d-a862-fcfb98fe2410 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:52.268152 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b127667-892a-491d-a862-fcfb98fe2410 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:52.278569 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b127667-892a-491d-a862-fcfb98fe2410 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:52.280412 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b127667-892a-491d-a862-fcfb98fe2410 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:52.297009 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-4b127667-892a-491d-a862-fcfb98fe2410 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:42:52.298153 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 633/1249] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:42:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:42:52.303808 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a47a3-f726-4239-bddc-b42df5fa2a21 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:52.313284 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a47a3-f726-4239-bddc-b42df5fa2a21 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:52.318297 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731683b-5ff8-4c44-b492-ee3f942a6fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:52.318929 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731683b-5ff8-4c44-b492-ee3f942a6fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:52.319255 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731683b-5ff8-4c44-b492-ee3f942a6fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:52.319534 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731683b-5ff8-4c44-b492-ee3f942a6fb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:52.320285 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731683b-5ff8-4c44-b492-ee3f942a6fb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:52.320588 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731683b-5ff8-4c44-b492-ee3f942a6fb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:52.322211 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731683b-5ff8-4c44-b492-ee3f942a6fb3 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:52.334230 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 617/1250] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:42:52.339703 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b127667-892a-491d-a862-fcfb98fe2410 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:52.349038 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b127667-892a-491d-a862-fcfb98fe2410 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:52.353527 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250473d-ce58-4b24-9007-2c5dde350fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:52.354289 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250473d-ce58-4b24-9007-2c5dde350fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:52.354568 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250473d-ce58-4b24-9007-2c5dde350fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:52.354841 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250473d-ce58-4b24-9007-2c5dde350fb6 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:52.361826 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250473d-ce58-4b24-9007-2c5dde350fb6 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:52.364014 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250473d-ce58-4b24-9007-2c5dde350fb6 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:52.379791 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-d250473d-ce58-4b24-9007-2c5dde350fb6 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 05 14:42:52.380841 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 634/1251] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:42:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:42:52.386489 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731683b-5ff8-4c44-b492-ee3f942a6fb3 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:52.396647 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731683b-5ff8-4c44-b492-ee3f942a6fb3 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:52.401154 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbef48e-7b77-470e-8826-1804d624ea5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:52.401797 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbef48e-7b77-470e-8826-1804d624ea5c admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:52.402075 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbef48e-7b77-470e-8826-1804d624ea5c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:52.402347 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbef48e-7b77-470e-8826-1804d624ea5c admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:52.403180 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbef48e-7b77-470e-8826-1804d624ea5c admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:52.403483 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbef48e-7b77-470e-8826-1804d624ea5c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:52.405374 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbef48e-7b77-470e-8826-1804d624ea5c admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:52.423013 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 618/1252] 10.222.0.30 () {56 vars in 1164 bytes} [Wed Jan 5 14:42:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:42:52.429167 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250473d-ce58-4b24-9007-2c5dde350fb6 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:52.438804 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250473d-ce58-4b24-9007-2c5dde350fb6 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:52.443377 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f76e4a-c412-4be9-8a75-91b4b192044d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:52.443999 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f76e4a-c412-4be9-8a75-91b4b192044d admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:52.444284 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f76e4a-c412-4be9-8a75-91b4b192044d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:52.444561 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f76e4a-c412-4be9-8a75-91b4b192044d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:52.452231 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f76e4a-c412-4be9-8a75-91b4b192044d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:52.454011 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f76e4a-c412-4be9-8a75-91b4b192044d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:52.462902 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 635/1253] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:42:52 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 14:42:52.468493 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbef48e-7b77-470e-8826-1804d624ea5c admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:52.478466 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbef48e-7b77-470e-8826-1804d624ea5c admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:52.482914 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3d11f-5042-4914-a158-cd6fa9cac9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:52.483681 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3d11f-5042-4914-a158-cd6fa9cac9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:52.483962 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3d11f-5042-4914-a158-cd6fa9cac9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:52.484234 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3d11f-5042-4914-a158-cd6fa9cac9c5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:52.494973 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3d11f-5042-4914-a158-cd6fa9cac9c5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:52.496806 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3d11f-5042-4914-a158-cd6fa9cac9c5 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:52.513568 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-79f3d11f-5042-4914-a158-cd6fa9cac9c5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:42:52.514719 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 619/1254] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:42:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:42:52.520355 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f76e4a-c412-4be9-8a75-91b4b192044d admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:52.529242 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f76e4a-c412-4be9-8a75-91b4b192044d admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:52.533900 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed362881-a988-4bd5-9532-1f452ce14ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:52.535037 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed362881-a988-4bd5-9532-1f452ce14ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:52.535322 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed362881-a988-4bd5-9532-1f452ce14ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:52.535600 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed362881-a988-4bd5-9532-1f452ce14ed1 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:52.536334 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed362881-a988-4bd5-9532-1f452ce14ed1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:52.536636 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed362881-a988-4bd5-9532-1f452ce14ed1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:52.538328 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed362881-a988-4bd5-9532-1f452ce14ed1 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:52.549244 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 636/1255] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:42:52.555077 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3d11f-5042-4914-a158-cd6fa9cac9c5 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:52.564476 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3d11f-5042-4914-a158-cd6fa9cac9c5 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:52.569271 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db8ed7-68b0-4045-9390-58172257cadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:52.570049 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db8ed7-68b0-4045-9390-58172257cadc admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:52.570321 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db8ed7-68b0-4045-9390-58172257cadc admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:52.570594 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db8ed7-68b0-4045-9390-58172257cadc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:52.577314 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78db8ed7-68b0-4045-9390-58172257cadc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:52.579287 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78db8ed7-68b0-4045-9390-58172257cadc admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:52.592484 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-78db8ed7-68b0-4045-9390-58172257cadc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:42:52.593609 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 620/1256] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:42:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:42:52.599823 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed362881-a988-4bd5-9532-1f452ce14ed1 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:52.609468 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed362881-a988-4bd5-9532-1f452ce14ed1 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:52.614246 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff646af4-ef59-4622-a114-92b2ba41dd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:52.614883 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff646af4-ef59-4622-a114-92b2ba41dd93 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:52.615167 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff646af4-ef59-4622-a114-92b2ba41dd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:52.615441 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff646af4-ef59-4622-a114-92b2ba41dd93 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:52.616227 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff646af4-ef59-4622-a114-92b2ba41dd93 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:52.616534 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff646af4-ef59-4622-a114-92b2ba41dd93 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:52.618439 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff646af4-ef59-4622-a114-92b2ba41dd93 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:52.630658 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 637/1257] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:42:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:42:52.636398 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db8ed7-68b0-4045-9390-58172257cadc admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:52.646983 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db8ed7-68b0-4045-9390-58172257cadc admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:52.651505 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0c3bf-1e23-4e19-859e-3af6c216138b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:52.652114 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0c3bf-1e23-4e19-859e-3af6c216138b admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:52.652396 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0c3bf-1e23-4e19-859e-3af6c216138b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:52.652672 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0c3bf-1e23-4e19-859e-3af6c216138b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:52.653542 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0c3bf-1e23-4e19-859e-3af6c216138b admin admin] RBAC: Adding query filter params (role.id=494131614fcf424f92e0817fa7ff6961, scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1, user.id=8847b97a7089420a8b8b817f3059c660) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:52.653854 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0c3bf-1e23-4e19-859e-3af6c216138b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:52.655669 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0c3bf-1e23-4e19-859e-3af6c216138b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:52.661476 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 621/1258] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:42:52 2022] GET /identity/v3/role_assignments?user.id=8847b97a7089420a8b8b817f3059c660&scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1&role.id=494131614fcf424f92e0817fa7ff6961 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:42:55.012938 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388eb23-f64d-47fd-ac36-f5216e382dc0 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:55.013533 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388eb23-f64d-47fd-ac36-f5216e382dc0 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:55.013533 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388eb23-f64d-47fd-ac36-f5216e382dc0 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:55.015297 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 638/1259] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:42:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:42:55.020873 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759ba3f-0ae8-478d-b920-8e8ca02806bc None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:55.023172 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759ba3f-0ae8-478d-b920-8e8ca02806bc None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:55.023172 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759ba3f-0ae8-478d-b920-8e8ca02806bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:55.039024 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-e759ba3f-0ae8-478d-b920-8e8ca02806bc None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:42:55.040196 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-e759ba3f-0ae8-478d-b920-8e8ca02806bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:42:55.047919 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 622/1260] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:42:55 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:42:55.071687 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388eb23-f64d-47fd-ac36-f5216e382dc0 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:55.084036 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388eb23-f64d-47fd-ac36-f5216e382dc0 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:55.088324 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775a577-d5bd-470e-b183-54d3873c14c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:55.089109 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775a577-d5bd-470e-b183-54d3873c14c7 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:55.089392 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775a577-d5bd-470e-b183-54d3873c14c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:55.089662 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775a577-d5bd-470e-b183-54d3873c14c7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:55.100156 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d775a577-d5bd-470e-b183-54d3873c14c7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:42:55.107193 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-d775a577-d5bd-470e-b183-54d3873c14c7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 05 14:42:55.108313 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 639/1261] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:42:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:42:55.114460 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759ba3f-0ae8-478d-b920-8e8ca02806bc None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:55.123614 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759ba3f-0ae8-478d-b920-8e8ca02806bc None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:55.128087 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c48003-d425-47ec-a9b6-f33225893f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:55.128755 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c48003-d425-47ec-a9b6-f33225893f86 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:55.129037 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c48003-d425-47ec-a9b6-f33225893f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:55.129361 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c48003-d425-47ec-a9b6-f33225893f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:55.130118 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c48003-d425-47ec-a9b6-f33225893f86 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:55.130425 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c48003-d425-47ec-a9b6-f33225893f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:55.132015 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c48003-d425-47ec-a9b6-f33225893f86 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:55.140236 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 623/1262] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:42:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:42:55.146352 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775a577-d5bd-470e-b183-54d3873c14c7 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:55.155785 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775a577-d5bd-470e-b183-54d3873c14c7 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:55.160779 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f912f34-b615-487b-a893-de4d6e64d854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:55.161575 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f912f34-b615-487b-a893-de4d6e64d854 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:55.161856 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f912f34-b615-487b-a893-de4d6e64d854 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:55.162123 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f912f34-b615-487b-a893-de4d6e64d854 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:55.172303 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f912f34-b615-487b-a893-de4d6e64d854 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:55.174111 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f912f34-b615-487b-a893-de4d6e64d854 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:55.190024 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-7f912f34-b615-487b-a893-de4d6e64d854 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:42:55.194731 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 640/1263] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:42:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:42:55.197320 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c48003-d425-47ec-a9b6-f33225893f86 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:55.207553 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c48003-d425-47ec-a9b6-f33225893f86 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:55.212176 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f7c7e-4fca-4141-b128-a49330ecc4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:55.212814 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f7c7e-4fca-4141-b128-a49330ecc4cc admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:55.213125 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f7c7e-4fca-4141-b128-a49330ecc4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:55.213405 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f7c7e-4fca-4141-b128-a49330ecc4cc admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:55.214127 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f7c7e-4fca-4141-b128-a49330ecc4cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:55.214433 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f7c7e-4fca-4141-b128-a49330ecc4cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:55.216040 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f7c7e-4fca-4141-b128-a49330ecc4cc admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:55.229125 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 624/1264] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:42:55.234401 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f912f34-b615-487b-a893-de4d6e64d854 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:55.243826 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f912f34-b615-487b-a893-de4d6e64d854 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:55.248536 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c19e1-ded6-488f-841c-f36a7950bc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:55.249375 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c19e1-ded6-488f-841c-f36a7950bc03 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:55.249653 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c19e1-ded6-488f-841c-f36a7950bc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:55.249923 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c19e1-ded6-488f-841c-f36a7950bc03 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:55.258089 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c19e1-ded6-488f-841c-f36a7950bc03 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:55.260103 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c19e1-ded6-488f-841c-f36a7950bc03 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:55.286467 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-2c4c19e1-ded6-488f-841c-f36a7950bc03 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 05 14:42:55.286467 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 641/1265] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:42:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:42:55.286701 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f7c7e-4fca-4141-b128-a49330ecc4cc admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:55.291452 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f7c7e-4fca-4141-b128-a49330ecc4cc admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:55.296041 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc4d86-c23f-4ac0-8fae-3a51cc7c1793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:55.296680 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc4d86-c23f-4ac0-8fae-3a51cc7c1793 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:55.296959 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc4d86-c23f-4ac0-8fae-3a51cc7c1793 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:55.297268 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc4d86-c23f-4ac0-8fae-3a51cc7c1793 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:55.298104 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc4d86-c23f-4ac0-8fae-3a51cc7c1793 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:55.298406 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc4d86-c23f-4ac0-8fae-3a51cc7c1793 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:55.301000 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc4d86-c23f-4ac0-8fae-3a51cc7c1793 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:55.318406 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 625/1266] 10.222.0.30 () {56 vars in 1164 bytes} [Wed Jan 5 14:42:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:42:55.323835 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c19e1-ded6-488f-841c-f36a7950bc03 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:55.333409 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c19e1-ded6-488f-841c-f36a7950bc03 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:55.337893 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98353d35-603e-435e-9b3f-5a42dfb05a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:55.340096 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98353d35-603e-435e-9b3f-5a42dfb05a2b admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:55.340096 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98353d35-603e-435e-9b3f-5a42dfb05a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:55.340096 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98353d35-603e-435e-9b3f-5a42dfb05a2b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:55.350257 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98353d35-603e-435e-9b3f-5a42dfb05a2b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:55.352160 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98353d35-603e-435e-9b3f-5a42dfb05a2b admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:55.368438 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-98353d35-603e-435e-9b3f-5a42dfb05a2b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:42:55.369561 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 642/1267] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:42:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:42:55.375183 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc4d86-c23f-4ac0-8fae-3a51cc7c1793 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:55.384686 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc4d86-c23f-4ac0-8fae-3a51cc7c1793 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:55.389158 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515a497-92b2-4b2e-a48b-b5842f27f447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:55.389785 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515a497-92b2-4b2e-a48b-b5842f27f447 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:55.390064 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515a497-92b2-4b2e-a48b-b5842f27f447 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:55.400879 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515a497-92b2-4b2e-a48b-b5842f27f447 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:55.400879 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0515a497-92b2-4b2e-a48b-b5842f27f447 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:55.400879 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0515a497-92b2-4b2e-a48b-b5842f27f447 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:55.400879 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0515a497-92b2-4b2e-a48b-b5842f27f447 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:55.403964 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 626/1268] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:42:55.409318 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98353d35-603e-435e-9b3f-5a42dfb05a2b admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:55.419483 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98353d35-603e-435e-9b3f-5a42dfb05a2b admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:55.424149 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b1b21-6aab-474e-a3cf-a47e19cdae78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:55.424920 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b1b21-6aab-474e-a3cf-a47e19cdae78 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:55.430512 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b1b21-6aab-474e-a3cf-a47e19cdae78 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:55.430512 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b1b21-6aab-474e-a3cf-a47e19cdae78 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:55.433082 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b1b21-6aab-474e-a3cf-a47e19cdae78 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:55.435043 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b1b21-6aab-474e-a3cf-a47e19cdae78 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:55.448751 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-1a0b1b21-6aab-474e-a3cf-a47e19cdae78 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:42:55.449974 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 643/1269] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:42:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:42:55.455452 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515a497-92b2-4b2e-a48b-b5842f27f447 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:55.464858 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515a497-92b2-4b2e-a48b-b5842f27f447 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:55.469458 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe9431-34c8-4f5f-8461-556d4aa7df94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:55.470087 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe9431-34c8-4f5f-8461-556d4aa7df94 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:55.470373 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe9431-34c8-4f5f-8461-556d4aa7df94 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:55.470651 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe9431-34c8-4f5f-8461-556d4aa7df94 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:55.471437 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe9431-34c8-4f5f-8461-556d4aa7df94 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:55.471745 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe9431-34c8-4f5f-8461-556d4aa7df94 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:55.474140 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe9431-34c8-4f5f-8461-556d4aa7df94 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:55.485773 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 627/1270] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:42:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:42:55.492265 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b1b21-6aab-474e-a3cf-a47e19cdae78 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:55.501947 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b1b21-6aab-474e-a3cf-a47e19cdae78 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:55.506531 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d50b7-2ad2-4ad0-83af-6a401c9a3a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:55.507415 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d50b7-2ad2-4ad0-83af-6a401c9a3a10 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:55.507694 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d50b7-2ad2-4ad0-83af-6a401c9a3a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:55.507966 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d50b7-2ad2-4ad0-83af-6a401c9a3a10 admin admin] PATH_INFO: `/v3/projects/fbf90e947f3a4fcdb6f42646a4bf34a1/users/8847b97a7089420a8b8b817f3059c660/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:55.521147 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d50b7-2ad2-4ad0-83af-6a401c9a3a10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf90e947f3a4fcdb6f42646a4bf34a1, user_id=8847b97a7089420a8b8b817f3059c660, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:55.521147 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d50b7-2ad2-4ad0-83af-6a401c9a3a10 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:55.633252 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 644/1271] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Jan 5 14:42:55 2022] PUT /identity/v3/projects/fbf90e947f3a4fcdb6f42646a4bf34a1/users/8847b97a7089420a8b8b817f3059c660/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:42:58.000357 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed48ce-e727-43d7-a68a-5b2bd82ebee9 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:58.000886 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed48ce-e727-43d7-a68a-5b2bd82ebee9 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:58.000976 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed48ce-e727-43d7-a68a-5b2bd82ebee9 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:58.002819 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 628/1272] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:42:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:42:58.008032 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a7e91-ff19-4f70-9983-0d61fd933950 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:58.008441 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a7e91-ff19-4f70-9983-0d61fd933950 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:58.008598 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a7e91-ff19-4f70-9983-0d61fd933950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:58.026459 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-795a7e91-ff19-4f70-9983-0d61fd933950 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:42:58.027635 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-795a7e91-ff19-4f70-9983-0d61fd933950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:42:58.086937 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 645/1273] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:42:58 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:42:58.112626 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed48ce-e727-43d7-a68a-5b2bd82ebee9 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:58.125054 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed48ce-e727-43d7-a68a-5b2bd82ebee9 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:58.129681 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d100e76-de49-4e7d-b18e-e2412a33bc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:58.130222 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d100e76-de49-4e7d-b18e-e2412a33bc87 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:58.130501 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d100e76-de49-4e7d-b18e-e2412a33bc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:58.130775 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d100e76-de49-4e7d-b18e-e2412a33bc87 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:58.140599 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d100e76-de49-4e7d-b18e-e2412a33bc87 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 05 14:42:58.148127 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-6d100e76-de49-4e7d-b18e-e2412a33bc87 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 05 14:42:58.149303 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 629/1274] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jan 5 14:42:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:42:58.155098 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a7e91-ff19-4f70-9983-0d61fd933950 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:58.164765 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a7e91-ff19-4f70-9983-0d61fd933950 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:58.169269 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3366ab3-1697-4707-acd1-b704f915c39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:58.169915 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3366ab3-1697-4707-acd1-b704f915c39d admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:58.170195 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3366ab3-1697-4707-acd1-b704f915c39d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:58.170467 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3366ab3-1697-4707-acd1-b704f915c39d admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:58.171219 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3366ab3-1697-4707-acd1-b704f915c39d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:58.171528 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3366ab3-1697-4707-acd1-b704f915c39d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:58.173142 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3366ab3-1697-4707-acd1-b704f915c39d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:58.181161 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 646/1275] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jan 5 14:42:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:42:58.186490 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d100e76-de49-4e7d-b18e-e2412a33bc87 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:58.196217 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d100e76-de49-4e7d-b18e-e2412a33bc87 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:58.200683 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956822cc-562a-4e56-b7e8-f74304a3dd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:58.201457 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956822cc-562a-4e56-b7e8-f74304a3dd37 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:58.201739 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956822cc-562a-4e56-b7e8-f74304a3dd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:58.202013 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956822cc-562a-4e56-b7e8-f74304a3dd37 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:58.213450 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956822cc-562a-4e56-b7e8-f74304a3dd37 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:58.215431 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956822cc-562a-4e56-b7e8-f74304a3dd37 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:58.231685 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-956822cc-562a-4e56-b7e8-f74304a3dd37 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:42:58.232829 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 630/1276] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:42:58.238820 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3366ab3-1697-4707-acd1-b704f915c39d admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:58.248621 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3366ab3-1697-4707-acd1-b704f915c39d admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:58.253844 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b746f6-1c31-4dbd-8688-5842b8a92368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:58.254435 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b746f6-1c31-4dbd-8688-5842b8a92368 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:58.254766 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b746f6-1c31-4dbd-8688-5842b8a92368 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:58.255044 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b746f6-1c31-4dbd-8688-5842b8a92368 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:58.255764 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b746f6-1c31-4dbd-8688-5842b8a92368 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:58.256068 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b746f6-1c31-4dbd-8688-5842b8a92368 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:58.257687 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b746f6-1c31-4dbd-8688-5842b8a92368 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:58.269800 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 647/1277] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:42:58.275322 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956822cc-562a-4e56-b7e8-f74304a3dd37 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:58.284823 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956822cc-562a-4e56-b7e8-f74304a3dd37 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:58.289406 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adb041-9d3a-4393-94e4-7b5b583ef36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:58.290175 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adb041-9d3a-4393-94e4-7b5b583ef36c admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:58.290450 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adb041-9d3a-4393-94e4-7b5b583ef36c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:58.290715 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adb041-9d3a-4393-94e4-7b5b583ef36c admin admin] PATH_INFO: `/v3/users/placement` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:58.298458 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adb041-9d3a-4393-94e4-7b5b583ef36c admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:58.300533 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adb041-9d3a-4393-94e4-7b5b583ef36c admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:58.313884 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-a3adb041-9d3a-4393-94e4-7b5b583ef36c admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 05 14:42:58.314973 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 631/1278] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:42:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 05 14:42:58.320886 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b746f6-1c31-4dbd-8688-5842b8a92368 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:58.330776 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b746f6-1c31-4dbd-8688-5842b8a92368 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:58.335976 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a6073-c840-4de3-8873-9ed673e7fd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:58.336621 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a6073-c840-4de3-8873-9ed673e7fd69 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:58.336901 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a6073-c840-4de3-8873-9ed673e7fd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:58.337210 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a6073-c840-4de3-8873-9ed673e7fd69 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:58.338052 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a6073-c840-4de3-8873-9ed673e7fd69 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:58.338357 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a6073-c840-4de3-8873-9ed673e7fd69 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:58.340186 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a6073-c840-4de3-8873-9ed673e7fd69 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:58.356814 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 648/1279] 10.222.0.30 () {56 vars in 1164 bytes} [Wed Jan 5 14:42:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:42:58.362364 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adb041-9d3a-4393-94e4-7b5b583ef36c admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:58.371825 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adb041-9d3a-4393-94e4-7b5b583ef36c admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:58.376832 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fee15b-f072-4b58-bacb-a6bc4ef47dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:58.377550 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fee15b-f072-4b58-bacb-a6bc4ef47dea admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:58.377807 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fee15b-f072-4b58-bacb-a6bc4ef47dea admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:58.378080 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fee15b-f072-4b58-bacb-a6bc4ef47dea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:58.386290 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fee15b-f072-4b58-bacb-a6bc4ef47dea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:58.388017 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fee15b-f072-4b58-bacb-a6bc4ef47dea admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:58.397234 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 632/1280] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jan 5 14:42:58 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:42:58.402674 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a6073-c840-4de3-8873-9ed673e7fd69 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:58.412255 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a6073-c840-4de3-8873-9ed673e7fd69 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:58.418628 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d345ac-457a-4d2a-a2e3-88f252c727c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:58.419384 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d345ac-457a-4d2a-a2e3-88f252c727c5 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:58.419663 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d345ac-457a-4d2a-a2e3-88f252c727c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:58.419935 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d345ac-457a-4d2a-a2e3-88f252c727c5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:58.429934 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d345ac-457a-4d2a-a2e3-88f252c727c5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:58.431783 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d345ac-457a-4d2a-a2e3-88f252c727c5 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:58.448856 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-29d345ac-457a-4d2a-a2e3-88f252c727c5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 05 14:42:58.450004 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 649/1281] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jan 5 14:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:42:58.455350 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fee15b-f072-4b58-bacb-a6bc4ef47dea admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:58.464653 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fee15b-f072-4b58-bacb-a6bc4ef47dea admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:58.469090 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28dcbbe-4611-47cb-9e9a-24b892de97d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:58.469726 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28dcbbe-4611-47cb-9e9a-24b892de97d2 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:58.470003 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28dcbbe-4611-47cb-9e9a-24b892de97d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:58.471932 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28dcbbe-4611-47cb-9e9a-24b892de97d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:58.471932 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28dcbbe-4611-47cb-9e9a-24b892de97d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:58.471932 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28dcbbe-4611-47cb-9e9a-24b892de97d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:58.472817 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28dcbbe-4611-47cb-9e9a-24b892de97d2 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:58.484977 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 633/1282] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Jan 5 14:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:42:58.490395 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d345ac-457a-4d2a-a2e3-88f252c727c5 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:58.500217 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d345ac-457a-4d2a-a2e3-88f252c727c5 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:58.505424 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d81ac-abbe-48bf-b8cd-3c69f7d5bf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:58.506145 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d81ac-abbe-48bf-b8cd-3c69f7d5bf54 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:58.506424 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d81ac-abbe-48bf-b8cd-3c69f7d5bf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:58.506690 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d81ac-abbe-48bf-b8cd-3c69f7d5bf54 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:58.513387 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d81ac-abbe-48bf-b8cd-3c69f7d5bf54 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:58.517973 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d81ac-abbe-48bf-b8cd-3c69f7d5bf54 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:58.528505 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING keystone.server.flask.application [None req-a58d81ac-abbe-48bf-b8cd-3c69f7d5bf54 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 05 14:42:58.529655 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 650/1283] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jan 5 14:42:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:42:58.535328 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28dcbbe-4611-47cb-9e9a-24b892de97d2 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:58.544894 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28dcbbe-4611-47cb-9e9a-24b892de97d2 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:58.549561 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8ba0c-0ffb-46ab-80f4-05e76bebf6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:58.550951 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8ba0c-0ffb-46ab-80f4-05e76bebf6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:58.550951 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8ba0c-0ffb-46ab-80f4-05e76bebf6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:58.551322 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8ba0c-0ffb-46ab-80f4-05e76bebf6b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:58.552192 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8ba0c-0ffb-46ab-80f4-05e76bebf6b7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:58.552502 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8ba0c-0ffb-46ab-80f4-05e76bebf6b7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:58.554376 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8ba0c-0ffb-46ab-80f4-05e76bebf6b7 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:58.565638 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 634/1284] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Jan 5 14:42:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:42:58.571824 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d81ac-abbe-48bf-b8cd-3c69f7d5bf54 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:42:58.581798 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d81ac-abbe-48bf-b8cd-3c69f7d5bf54 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:42:58.586267 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67b677-3bcc-4771-a900-d620e53ca06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:42:58.586878 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67b677-3bcc-4771-a900-d620e53ca06b admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:42:58.587156 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67b677-3bcc-4771-a900-d620e53ca06b admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:42:58.587426 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67b677-3bcc-4771-a900-d620e53ca06b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:42:58.588246 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67b677-3bcc-4771-a900-d620e53ca06b admin admin] RBAC: Adding query filter params (role.id=494131614fcf424f92e0817fa7ff6961, scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1, user.id=8847b97a7089420a8b8b817f3059c660) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:42:58.588554 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67b677-3bcc-4771-a900-d620e53ca06b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:42:58.590392 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67b677-3bcc-4771-a900-d620e53ca06b admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:42:58.595944 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 651/1285] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Jan 5 14:42:58 2022] GET /identity/v3/role_assignments?user.id=8847b97a7089420a8b8b817f3059c660&scope.project.id=fbf90e947f3a4fcdb6f42646a4bf34a1&role.id=494131614fcf424f92e0817fa7ff6961 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:43:01.047783 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d487f-f1c6-4e4a-a1aa-649c5ad38d07 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:43:01.048402 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d487f-f1c6-4e4a-a1aa-649c5ad38d07 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:43:01.048402 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d487f-f1c6-4e4a-a1aa-649c5ad38d07 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:43:01.050178 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 635/1286] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:43:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:43:01.056772 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b53128-9c80-4f0d-90e7-a76c9a4d521f None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:43:01.059116 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b53128-9c80-4f0d-90e7-a76c9a4d521f None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:43:01.059116 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b53128-9c80-4f0d-90e7-a76c9a4d521f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:43:01.075345 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-64b53128-9c80-4f0d-90e7-a76c9a4d521f None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:43:01.076518 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-64b53128-9c80-4f0d-90e7-a76c9a4d521f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:43:01.084877 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 652/1287] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:43:01 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:43:01.108455 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d487f-f1c6-4e4a-a1aa-649c5ad38d07 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:43:01.124664 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d487f-f1c6-4e4a-a1aa-649c5ad38d07 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:43:01.130173 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854556bf-e5e9-44c5-91e0-01b64e8e4ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:43:01.130966 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854556bf-e5e9-44c5-91e0-01b64e8e4ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:43:01.131245 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854556bf-e5e9-44c5-91e0-01b64e8e4ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:43:01.131608 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854556bf-e5e9-44c5-91e0-01b64e8e4ba0 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:43:01.132714 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854556bf-e5e9-44c5-91e0-01b64e8e4ba0 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:43:01.135031 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854556bf-e5e9-44c5-91e0-01b64e8e4ba0 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:43:01.151423 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-854556bf-e5e9-44c5-91e0-01b64e8e4ba0 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 05 14:43:01.153469 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 636/1288] 10.222.0.30 () {56 vars in 1138 bytes} [Wed Jan 5 14:43:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:43:01.159529 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b53128-9c80-4f0d-90e7-a76c9a4d521f None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:43:01.169366 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b53128-9c80-4f0d-90e7-a76c9a4d521f None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:43:01.173924 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a4807-39ab-4e02-8c69-c19dc380fa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:43:01.174529 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a4807-39ab-4e02-8c69-c19dc380fa29 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:43:01.175853 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a4807-39ab-4e02-8c69-c19dc380fa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:43:01.175853 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a4807-39ab-4e02-8c69-c19dc380fa29 admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:43:01.175853 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a4807-39ab-4e02-8c69-c19dc380fa29 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:43:01.176120 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a4807-39ab-4e02-8c69-c19dc380fa29 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:43:01.177713 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a4807-39ab-4e02-8c69-c19dc380fa29 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:43:01.182426 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 653/1289] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Jan 5 14:43:01 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:43:01.188085 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854556bf-e5e9-44c5-91e0-01b64e8e4ba0 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:43:01.198288 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854556bf-e5e9-44c5-91e0-01b64e8e4ba0 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:43:01.203014 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642d30a-8034-484f-9ac5-7d5082b0e7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:43:01.204008 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642d30a-8034-484f-9ac5-7d5082b0e7fb admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:43:01.204008 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642d30a-8034-484f-9ac5-7d5082b0e7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:43:01.204201 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642d30a-8034-484f-9ac5-7d5082b0e7fb admin admin] PATH_INFO: `/v3/services` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:43:01.204863 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642d30a-8034-484f-9ac5-7d5082b0e7fb admin admin] RBAC: Adding query filter params (type=placement) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:43:01.205202 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642d30a-8034-484f-9ac5-7d5082b0e7fb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:43:01.207407 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642d30a-8034-484f-9ac5-7d5082b0e7fb admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:43:01.211783 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 637/1290] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Jan 5 14:43:01 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:43:03.614967 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee49ef-0fbe-4397-acb2-95b7c0af99a5 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:43:03.615501 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee49ef-0fbe-4397-acb2-95b7c0af99a5 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:43:03.615603 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee49ef-0fbe-4397-acb2-95b7c0af99a5 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:43:03.617417 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 654/1291] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:43:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:43:03.622384 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86affcd4-9a38-4a92-91f1-e565ba7183d2 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:43:03.622807 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86affcd4-9a38-4a92-91f1-e565ba7183d2 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:43:03.623250 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86affcd4-9a38-4a92-91f1-e565ba7183d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:43:03.640947 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-86affcd4-9a38-4a92-91f1-e565ba7183d2 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:43:03.642143 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-86affcd4-9a38-4a92-91f1-e565ba7183d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:43:03.649726 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 638/1292] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:43:03 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:43:03.674179 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee49ef-0fbe-4397-acb2-95b7c0af99a5 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:43:03.686847 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee49ef-0fbe-4397-acb2-95b7c0af99a5 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:43:03.691316 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4b9fc-af47-4f1c-942e-794483b4e6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:43:03.691950 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4b9fc-af47-4f1c-942e-794483b4e6d9 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:43:03.692235 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4b9fc-af47-4f1c-942e-794483b4e6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:43:03.692514 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4b9fc-af47-4f1c-942e-794483b4e6d9 admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:43:03.693360 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4b9fc-af47-4f1c-942e-794483b4e6d9 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:43:03.695041 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4b9fc-af47-4f1c-942e-794483b4e6d9 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:43:03.802355 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 655/1293] 10.222.0.30 () {60 vars in 1162 bytes} [Wed Jan 5 14:43:03 2022] POST /identity/v3/services => generated 246 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:43:06.192210 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e18cd-5091-40cc-b5be-bb91f52ab4f1 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:43:06.192740 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e18cd-5091-40cc-b5be-bb91f52ab4f1 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:43:06.192740 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e18cd-5091-40cc-b5be-bb91f52ab4f1 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:43:06.194559 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 639/1294] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:43:06.200027 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ae242-e638-4e4f-87b8-baf69fb9df0e None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:43:06.200442 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ae242-e638-4e4f-87b8-baf69fb9df0e None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:43:06.200582 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ae242-e638-4e4f-87b8-baf69fb9df0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:43:06.218411 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-547ae242-e638-4e4f-87b8-baf69fb9df0e None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:43:06.219586 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-547ae242-e638-4e4f-87b8-baf69fb9df0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:43:06.236955 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 656/1295] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:43:06 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:43:06.262034 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e18cd-5091-40cc-b5be-bb91f52ab4f1 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:43:06.274436 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e18cd-5091-40cc-b5be-bb91f52ab4f1 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:43:06.278790 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6008ac7-f799-460b-8d8f-ffbabed6509f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:43:06.279555 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6008ac7-f799-460b-8d8f-ffbabed6509f admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:43:06.279831 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6008ac7-f799-460b-8d8f-ffbabed6509f admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:43:06.280102 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6008ac7-f799-460b-8d8f-ffbabed6509f admin admin] PATH_INFO: `/v3/services/placement` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:43:06.280754 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6008ac7-f799-460b-8d8f-ffbabed6509f admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:43:06.282370 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6008ac7-f799-460b-8d8f-ffbabed6509f admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:43:06.293835 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-c6008ac7-f799-460b-8d8f-ffbabed6509f admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 05 14:43:06.300826 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 640/1296] 10.222.0.30 () {56 vars in 1138 bytes} [Wed Jan 5 14:43:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:43:06.301590 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ae242-e638-4e4f-87b8-baf69fb9df0e None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:43:06.310462 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ae242-e638-4e4f-87b8-baf69fb9df0e None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:43:06.315206 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3d88c-d2ff-4d4f-beb2-948ebfb7c124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:43:06.316396 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3d88c-d2ff-4d4f-beb2-948ebfb7c124 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:43:06.316689 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3d88c-d2ff-4d4f-beb2-948ebfb7c124 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:43:06.316962 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3d88c-d2ff-4d4f-beb2-948ebfb7c124 admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:43:06.317819 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3d88c-d2ff-4d4f-beb2-948ebfb7c124 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:43:06.318121 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3d88c-d2ff-4d4f-beb2-948ebfb7c124 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:43:06.319710 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3d88c-d2ff-4d4f-beb2-948ebfb7c124 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:43:06.324910 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 657/1297] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Jan 5 14:43:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:43:06.330432 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6008ac7-f799-460b-8d8f-ffbabed6509f admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:43:06.339682 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6008ac7-f799-460b-8d8f-ffbabed6509f admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:43:06.344069 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81f923-d02a-426c-aa2e-8bc204078bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:43:06.344681 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81f923-d02a-426c-aa2e-8bc204078bbd admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:43:06.344970 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81f923-d02a-426c-aa2e-8bc204078bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:43:06.345267 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81f923-d02a-426c-aa2e-8bc204078bbd admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:43:06.346041 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81f923-d02a-426c-aa2e-8bc204078bbd admin admin] RBAC: Adding query filter params (interface=public, service_id=ccb4b30dd5594bea91ce164533d75755, region_id=RegionOne) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:43:06.346439 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81f923-d02a-426c-aa2e-8bc204078bbd admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:43:06.348015 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81f923-d02a-426c-aa2e-8bc204078bbd admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:43:06.352768 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 641/1298] 10.222.0.30 () {56 vars in 1272 bytes} [Wed Jan 5 14:43:06 2022] GET /identity/v3/endpoints?service_id=ccb4b30dd5594bea91ce164533d75755&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:43:06.358002 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3d88c-d2ff-4d4f-beb2-948ebfb7c124 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:43:06.368112 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3d88c-d2ff-4d4f-beb2-948ebfb7c124 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:43:06.372739 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad3baa-0951-4271-9e00-be7e67ab18e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:43:06.373669 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad3baa-0951-4271-9e00-be7e67ab18e3 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:43:06.380817 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad3baa-0951-4271-9e00-be7e67ab18e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:43:06.380817 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad3baa-0951-4271-9e00-be7e67ab18e3 admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:43:06.380817 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad3baa-0951-4271-9e00-be7e67ab18e3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:43:06.380817 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad3baa-0951-4271-9e00-be7e67ab18e3 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:43:06.383832 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 658/1299] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jan 5 14:43:06 2022] GET /identity/v3/services => generated 2191 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:43:08.739114 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c916c89-4025-4fee-9f38-160d5d9372e6 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:43:08.739652 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c916c89-4025-4fee-9f38-160d5d9372e6 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:43:08.739652 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c916c89-4025-4fee-9f38-160d5d9372e6 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:43:08.741446 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 642/1300] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:43:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:43:08.746485 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07af5d6-fa6d-4c01-9f80-9cfd86a31f28 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:43:08.749540 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07af5d6-fa6d-4c01-9f80-9cfd86a31f28 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:43:08.749540 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07af5d6-fa6d-4c01-9f80-9cfd86a31f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:43:08.764838 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-b07af5d6-fa6d-4c01-9f80-9cfd86a31f28 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:43:08.766002 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-b07af5d6-fa6d-4c01-9f80-9cfd86a31f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:43:08.773903 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 659/1301] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:43:08 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:43:08.799505 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c916c89-4025-4fee-9f38-160d5d9372e6 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:43:08.812218 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c916c89-4025-4fee-9f38-160d5d9372e6 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:43:08.816510 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c19860-7551-4c3a-81f8-e0b4a29a2c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:43:08.817384 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c19860-7551-4c3a-81f8-e0b4a29a2c72 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:43:08.817668 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c19860-7551-4c3a-81f8-e0b4a29a2c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:43:08.817943 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c19860-7551-4c3a-81f8-e0b4a29a2c72 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:43:08.818591 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c19860-7551-4c3a-81f8-e0b4a29a2c72 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:43:08.820181 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c19860-7551-4c3a-81f8-e0b4a29a2c72 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:43:08.831056 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING keystone.server.flask.application [None req-d5c19860-7551-4c3a-81f8-e0b4a29a2c72 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 05 14:43:08.832156 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 643/1302] 10.222.0.30 () {56 vars in 1138 bytes} [Wed Jan 5 14:43:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 05 14:43:08.838175 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07af5d6-fa6d-4c01-9f80-9cfd86a31f28 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:43:08.847641 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07af5d6-fa6d-4c01-9f80-9cfd86a31f28 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:43:08.852185 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777437b-b432-4a74-b64c-7ae6516fc127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:43:08.852827 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777437b-b432-4a74-b64c-7ae6516fc127 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:43:08.853131 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777437b-b432-4a74-b64c-7ae6516fc127 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:43:08.853411 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777437b-b432-4a74-b64c-7ae6516fc127 admin admin] PATH_INFO: `/v3/services` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:43:08.854122 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777437b-b432-4a74-b64c-7ae6516fc127 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:43:08.854425 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777437b-b432-4a74-b64c-7ae6516fc127 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:43:08.855986 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777437b-b432-4a74-b64c-7ae6516fc127 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:43:08.861075 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 660/1303] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Jan 5 14:43:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:43:08.866931 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c19860-7551-4c3a-81f8-e0b4a29a2c72 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:43:08.876945 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c19860-7551-4c3a-81f8-e0b4a29a2c72 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:43:08.882005 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacec93-8830-43f7-b86c-39ccb3f8d130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:43:08.882615 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacec93-8830-43f7-b86c-39ccb3f8d130 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:43:08.882896 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacec93-8830-43f7-b86c-39ccb3f8d130 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:43:08.883169 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacec93-8830-43f7-b86c-39ccb3f8d130 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:43:08.883906 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacec93-8830-43f7-b86c-39ccb3f8d130 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:43:08.885503 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacec93-8830-43f7-b86c-39ccb3f8d130 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:43:08.961906 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 644/1304] 10.222.0.30 () {60 vars in 1165 bytes} [Wed Jan 5 14:43:08 2022] POST /identity/v3/endpoints => generated 331 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:51:01.156533 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8162c4-dde7-4c96-b04d-bbbc5e8845ec None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:01.158217 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8162c4-dde7-4c96-b04d-bbbc5e8845ec None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:01.158706 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8162c4-dde7-4c96-b04d-bbbc5e8845ec None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:01.168387 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a0c2c-a827-4882-befd-b284f9b1aa3c None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:01.169441 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a0c2c-a827-4882-befd-b284f9b1aa3c None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:01.169950 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a0c2c-a827-4882-befd-b284f9b1aa3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:01.174047 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 661/1305] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:51:01 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:51:01.260993 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-fd2a0c2c-a827-4882-befd-b284f9b1aa3c None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:51:01.262604 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-fd2a0c2c-a827-4882-befd-b284f9b1aa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:01.415452 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 645/1306] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:51:01.420544 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8162c4-dde7-4c96-b04d-bbbc5e8845ec None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:51:01.422210 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-3a8162c4-dde7-4c96-b04d-bbbc5e8845ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:01.558946 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8162c4-dde7-4c96-b04d-bbbc5e8845ec None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:51:01.700286 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3884e6-6272-46dc-9f99-f9cbb2e44937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:51:01.702239 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3884e6-6272-46dc-9f99-f9cbb2e44937 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:01.702529 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3884e6-6272-46dc-9f99-f9cbb2e44937 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:01.703257 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3884e6-6272-46dc-9f99-f9cbb2e44937 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:01.704068 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3884e6-6272-46dc-9f99-f9cbb2e44937 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:51:01.706494 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3884e6-6272-46dc-9f99-f9cbb2e44937 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:51:01.733314 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 662/1307] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jan 5 14:51:01 2022] GET /identity/v3/projects => generated 2553 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:51:04.191696 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287d34b-4523-40fb-991d-14d6e01a7743 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:04.192202 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287d34b-4523-40fb-991d-14d6e01a7743 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:04.192313 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287d34b-4523-40fb-991d-14d6e01a7743 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:04.194078 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 646/1308] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:51:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:51:04.200769 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f9d15-2e4f-4ba5-9a17-210571e0bc81 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:04.201250 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f9d15-2e4f-4ba5-9a17-210571e0bc81 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:04.201425 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f9d15-2e4f-4ba5-9a17-210571e0bc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:04.272429 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-382f9d15-2e4f-4ba5-9a17-210571e0bc81 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:51:04.273864 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-382f9d15-2e4f-4ba5-9a17-210571e0bc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:04.405705 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 663/1309] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:51:04.430862 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287d34b-4523-40fb-991d-14d6e01a7743 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:51:04.432627 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-8287d34b-4523-40fb-991d-14d6e01a7743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:04.680161 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287d34b-4523-40fb-991d-14d6e01a7743 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:51:04.770985 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49736e55-16e9-4b5d-8c9c-484d358b9a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:51:04.771557 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49736e55-16e9-4b5d-8c9c-484d358b9a3b admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:04.771838 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49736e55-16e9-4b5d-8c9c-484d358b9a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:04.772135 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49736e55-16e9-4b5d-8c9c-484d358b9a3b admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:04.772868 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49736e55-16e9-4b5d-8c9c-484d358b9a3b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:51:04.774772 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49736e55-16e9-4b5d-8c9c-484d358b9a3b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:51:04.793377 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 647/1310] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jan 5 14:51:04 2022] GET /identity/v3/projects => generated 2553 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:51:07.231906 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdb6c8-55bf-4ff0-857e-cafbe810a9b9 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:07.232438 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdb6c8-55bf-4ff0-857e-cafbe810a9b9 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:07.232438 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdb6c8-55bf-4ff0-857e-cafbe810a9b9 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:07.234282 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 664/1311] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:51:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:51:07.239291 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e6b20-f663-4887-a361-30d442f7f14a None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:07.239676 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e6b20-f663-4887-a361-30d442f7f14a None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:07.239847 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e6b20-f663-4887-a361-30d442f7f14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:07.302312 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-0d4e6b20-f663-4887-a361-30d442f7f14a None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:51:07.303499 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-0d4e6b20-f663-4887-a361-30d442f7f14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:07.396607 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 648/1312] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:51:07.448028 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd8439-8d2d-47f2-bfb6-d776ad30c4a0 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:07.448314 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd8439-8d2d-47f2-bfb6-d776ad30c4a0 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:07.448599 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd8439-8d2d-47f2-bfb6-d776ad30c4a0 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:07.450385 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 665/1313] 10.222.0.30 () {54 vars in 964 bytes} [Wed Jan 5 14:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:51:07.456095 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939c521-6d5f-42fb-9d1f-54a89a23cb1b None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:07.456380 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939c521-6d5f-42fb-9d1f-54a89a23cb1b None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:07.456655 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939c521-6d5f-42fb-9d1f-54a89a23cb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:07.528756 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-a939c521-6d5f-42fb-9d1f-54a89a23cb1b None None] MFA Rules not processed for user `a6234d716a014808a8a4eb22b903bbc9`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:51:07.529960 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-a939c521-6d5f-42fb-9d1f-54a89a23cb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:07.600905 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 649/1314] 10.222.0.30 () {58 vars in 1061 bytes} [Wed Jan 5 14:51:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:51:07.610589 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd8439-8d2d-47f2-bfb6-d776ad30c4a0 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:51:07.612063 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-09dd8439-8d2d-47f2-bfb6-d776ad30c4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:07.711521 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd8439-8d2d-47f2-bfb6-d776ad30c4a0 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:51:07.784535 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b3c24-0e94-4c1f-b6bb-9688e2e85aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:51:07.785137 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b3c24-0e94-4c1f-b6bb-9688e2e85aba service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:07.785424 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b3c24-0e94-4c1f-b6bb-9688e2e85aba service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:07.785701 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b3c24-0e94-4c1f-b6bb-9688e2e85aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:07.787332 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-1a1b3c24-0e94-4c1f-b6bb-9688e2e85aba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:07.888662 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b3c24-0e94-4c1f-b6bb-9688e2e85aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:51:07.890126 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b3c24-0e94-4c1f-b6bb-9688e2e85aba service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:51:07.908194 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 666/1315] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:51:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:51:10.567881 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068689c5-a195-4cfe-91a8-72e4c435874c None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:10.568496 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068689c5-a195-4cfe-91a8-72e4c435874c None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:10.568496 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068689c5-a195-4cfe-91a8-72e4c435874c None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:10.570332 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 650/1316] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:51:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:51:10.575533 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cdd75-a00c-4bd3-b3f6-d572c2c96b84 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:10.575937 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cdd75-a00c-4bd3-b3f6-d572c2c96b84 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:10.576096 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cdd75-a00c-4bd3-b3f6-d572c2c96b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:10.637799 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-ed8cdd75-a00c-4bd3-b3f6-d572c2c96b84 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:51:10.638987 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-ed8cdd75-a00c-4bd3-b3f6-d572c2c96b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:10.735290 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 667/1317] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:51:10.770067 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068689c5-a195-4cfe-91a8-72e4c435874c None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:51:10.771511 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-068689c5-a195-4cfe-91a8-72e4c435874c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:10.890747 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068689c5-a195-4cfe-91a8-72e4c435874c None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:51:10.979451 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef402c17-132c-4c82-813f-3cc39dfb3fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:51:10.980301 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef402c17-132c-4c82-813f-3cc39dfb3fdb admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:10.980583 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef402c17-132c-4c82-813f-3cc39dfb3fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:10.980856 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef402c17-132c-4c82-813f-3cc39dfb3fdb admin admin] PATH_INFO: `/v3/projects/df4f5a399f0847ef9e872ee655a1354c` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:10.981800 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef402c17-132c-4c82-813f-3cc39dfb3fdb admin admin] RBAC: Authorizing `identity:get_project(project_id=df4f5a399f0847ef9e872ee655a1354c)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:51:10.983601 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef402c17-132c-4c82-813f-3cc39dfb3fdb admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:51:10.985312 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 651/1318] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:51:10 2022] GET /identity/v3/projects/df4f5a399f0847ef9e872ee655a1354c => generated 344 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:51:10.996915 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cdd75-a00c-4bd3-b3f6-d572c2c96b84 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:51:10.999692 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-ed8cdd75-a00c-4bd3-b3f6-d572c2c96b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:11.085103 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cdd75-a00c-4bd3-b3f6-d572c2c96b84 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:51:11.153055 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0d724-1e99-40f6-a810-64ee14014fae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:51:11.153710 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0d724-1e99-40f6-a810-64ee14014fae service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:11.153986 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0d724-1e99-40f6-a810-64ee14014fae service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:11.154257 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0d724-1e99-40f6-a810-64ee14014fae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:11.155840 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-6fd0d724-1e99-40f6-a810-64ee14014fae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:11.256965 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0d724-1e99-40f6-a810-64ee14014fae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:51:11.258412 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0d724-1e99-40f6-a810-64ee14014fae service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:51:11.276016 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 668/1319] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:51:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:51:14.220680 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4dccb-7298-4eb5-8b1c-0e5bbb269d1b None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:14.221306 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4dccb-7298-4eb5-8b1c-0e5bbb269d1b None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:14.221306 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4dccb-7298-4eb5-8b1c-0e5bbb269d1b None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:14.223030 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 652/1320] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:51:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:51:14.228359 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5285f-df41-447c-87ab-2b766248bd61 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:14.228780 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5285f-df41-447c-87ab-2b766248bd61 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:14.228911 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5285f-df41-447c-87ab-2b766248bd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:14.290600 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-fdb5285f-df41-447c-87ab-2b766248bd61 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:51:14.292190 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-fdb5285f-df41-447c-87ab-2b766248bd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:14.383769 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 669/1321] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:51:14.421613 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4dccb-7298-4eb5-8b1c-0e5bbb269d1b None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:51:14.423229 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-1af4dccb-7298-4eb5-8b1c-0e5bbb269d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:14.544439 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4dccb-7298-4eb5-8b1c-0e5bbb269d1b None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:51:14.633648 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e04923-3653-46d0-b75a-72cfa44d8239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:51:14.634508 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e04923-3653-46d0-b75a-72cfa44d8239 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:14.634792 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e04923-3653-46d0-b75a-72cfa44d8239 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:14.635070 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e04923-3653-46d0-b75a-72cfa44d8239 admin admin] PATH_INFO: `/v3/projects/0c3d9801ad754740ae4b7891d05c103f` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:14.645051 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e04923-3653-46d0-b75a-72cfa44d8239 admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3d9801ad754740ae4b7891d05c103f)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:51:14.647174 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e04923-3653-46d0-b75a-72cfa44d8239 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:51:14.648845 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 653/1322] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:51:14 2022] GET /identity/v3/projects/0c3d9801ad754740ae4b7891d05c103f => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:51:14.661179 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5285f-df41-447c-87ab-2b766248bd61 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:51:14.662401 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-fdb5285f-df41-447c-87ab-2b766248bd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:14.748986 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5285f-df41-447c-87ab-2b766248bd61 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:51:14.818811 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd30efe-ce00-4547-ba64-1df58138f131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:51:14.819450 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd30efe-ce00-4547-ba64-1df58138f131 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:14.819729 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd30efe-ce00-4547-ba64-1df58138f131 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:14.820000 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd30efe-ce00-4547-ba64-1df58138f131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:14.821628 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-3fd30efe-ce00-4547-ba64-1df58138f131 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:14.922543 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd30efe-ce00-4547-ba64-1df58138f131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:51:14.923961 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd30efe-ce00-4547-ba64-1df58138f131 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:51:14.942020 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 670/1323] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:51:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:51:18.017009 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0c6f7-f13d-466d-afac-8fe2dfb96505 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:18.017590 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0c6f7-f13d-466d-afac-8fe2dfb96505 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:18.017590 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0c6f7-f13d-466d-afac-8fe2dfb96505 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:18.019459 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 654/1324] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:51:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:51:18.024491 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da81f0-c541-4fb5-91a8-f79eaaf1730f None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:18.024861 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da81f0-c541-4fb5-91a8-f79eaaf1730f None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:18.025048 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da81f0-c541-4fb5-91a8-f79eaaf1730f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:18.086434 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-69da81f0-c541-4fb5-91a8-f79eaaf1730f None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:51:18.087616 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-69da81f0-c541-4fb5-91a8-f79eaaf1730f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:18.177731 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 671/1325] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:51:18.212713 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0c6f7-f13d-466d-afac-8fe2dfb96505 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:51:18.214249 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-a5f0c6f7-f13d-466d-afac-8fe2dfb96505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:18.332195 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0c6f7-f13d-466d-afac-8fe2dfb96505 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:51:18.420089 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4859fa9-df32-466a-8a67-baebc95a553a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:51:18.420934 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4859fa9-df32-466a-8a67-baebc95a553a admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:18.421244 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4859fa9-df32-466a-8a67-baebc95a553a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:18.421517 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4859fa9-df32-466a-8a67-baebc95a553a admin admin] PATH_INFO: `/v3/projects/0c3d9801ad754740ae4b7891d05c103f` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:18.431362 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4859fa9-df32-466a-8a67-baebc95a553a admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3d9801ad754740ae4b7891d05c103f)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:51:18.437172 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4859fa9-df32-466a-8a67-baebc95a553a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:51:18.437172 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 655/1326] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:51:18 2022] GET /identity/v3/projects/0c3d9801ad754740ae4b7891d05c103f => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:51:18.447281 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da81f0-c541-4fb5-91a8-f79eaaf1730f None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:51:18.448524 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-69da81f0-c541-4fb5-91a8-f79eaaf1730f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:18.536010 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da81f0-c541-4fb5-91a8-f79eaaf1730f None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:51:18.605688 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029fc3f-87e8-4df8-adff-2c9eb004dc81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:51:18.606269 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029fc3f-87e8-4df8-adff-2c9eb004dc81 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:18.606554 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029fc3f-87e8-4df8-adff-2c9eb004dc81 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:18.606833 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029fc3f-87e8-4df8-adff-2c9eb004dc81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:18.608454 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-c029fc3f-87e8-4df8-adff-2c9eb004dc81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:18.712155 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029fc3f-87e8-4df8-adff-2c9eb004dc81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:51:18.713883 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029fc3f-87e8-4df8-adff-2c9eb004dc81 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:51:18.735926 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 672/1327] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:51:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:51:22.104786 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45778d82-a052-4754-9cb7-e8f8802c5c44 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:22.105385 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45778d82-a052-4754-9cb7-e8f8802c5c44 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:22.105385 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45778d82-a052-4754-9cb7-e8f8802c5c44 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:22.107203 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 656/1328] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:51:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:51:22.113141 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b6815-b88a-40d4-9574-e08ac48b8d7e None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:22.113566 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b6815-b88a-40d4-9574-e08ac48b8d7e None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:22.113830 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b6815-b88a-40d4-9574-e08ac48b8d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:22.176305 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-a06b6815-b88a-40d4-9574-e08ac48b8d7e None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:51:22.177547 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-a06b6815-b88a-40d4-9574-e08ac48b8d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:22.268421 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 673/1329] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:51:22.307083 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45778d82-a052-4754-9cb7-e8f8802c5c44 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:51:22.308596 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-45778d82-a052-4754-9cb7-e8f8802c5c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:22.409554 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45778d82-a052-4754-9cb7-e8f8802c5c44 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:51:22.480904 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573e6bb-03c4-465d-a588-e10c9720a2aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:51:22.481609 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573e6bb-03c4-465d-a588-e10c9720a2aa service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:22.481892 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573e6bb-03c4-465d-a588-e10c9720a2aa service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:22.482172 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573e6bb-03c4-465d-a588-e10c9720a2aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:22.483902 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-b573e6bb-03c4-465d-a588-e10c9720a2aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:22.595693 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573e6bb-03c4-465d-a588-e10c9720a2aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:51:22.597171 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573e6bb-03c4-465d-a588-e10c9720a2aa service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:51:22.614583 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 657/1330] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:51:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:51:25.081783 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b6a6a-df9e-48db-83a0-ee0c18c4511a None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:25.082276 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b6a6a-df9e-48db-83a0-ee0c18c4511a None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:25.082276 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b6a6a-df9e-48db-83a0-ee0c18c4511a None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:25.084199 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 674/1331] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:51:25.089080 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d47e37-5809-4320-a086-72ea3dfd5494 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:25.089488 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d47e37-5809-4320-a086-72ea3dfd5494 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:25.089795 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d47e37-5809-4320-a086-72ea3dfd5494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:25.153967 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-77d47e37-5809-4320-a086-72ea3dfd5494 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:51:25.155156 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-77d47e37-5809-4320-a086-72ea3dfd5494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:25.247036 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 658/1332] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:51:25.284986 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b6a6a-df9e-48db-83a0-ee0c18c4511a None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:51:25.286579 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-549b6a6a-df9e-48db-83a0-ee0c18c4511a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:25.385936 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b6a6a-df9e-48db-83a0-ee0c18c4511a None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:51:25.455765 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279fecc-ee11-4b7d-b8e4-8a085b53dac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:51:25.456421 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279fecc-ee11-4b7d-b8e4-8a085b53dac5 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:25.456703 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279fecc-ee11-4b7d-b8e4-8a085b53dac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:25.456979 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279fecc-ee11-4b7d-b8e4-8a085b53dac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:25.458716 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-c279fecc-ee11-4b7d-b8e4-8a085b53dac5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:25.566654 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279fecc-ee11-4b7d-b8e4-8a085b53dac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:51:25.568092 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279fecc-ee11-4b7d-b8e4-8a085b53dac5 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:51:25.585480 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 675/1333] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:51:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:51:28.052373 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ee419-b25d-4cf0-bf26-898b682b428c None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:28.053344 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ee419-b25d-4cf0-bf26-898b682b428c None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:28.053836 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ee419-b25d-4cf0-bf26-898b682b428c None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:28.055883 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 659/1334] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:51:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:51:28.061241 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2a4e9-3eac-4ad8-b04f-ee0fca0e0a6f None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:28.061777 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2a4e9-3eac-4ad8-b04f-ee0fca0e0a6f None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:28.061859 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2a4e9-3eac-4ad8-b04f-ee0fca0e0a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:28.143020 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-eee2a4e9-3eac-4ad8-b04f-ee0fca0e0a6f None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:51:28.144259 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-eee2a4e9-3eac-4ad8-b04f-ee0fca0e0a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:28.237659 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 676/1335] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:51:28.271858 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ee419-b25d-4cf0-bf26-898b682b428c None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:51:28.273449 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-3b0ee419-b25d-4cf0-bf26-898b682b428c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:28.398515 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ee419-b25d-4cf0-bf26-898b682b428c None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:51:28.502298 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80889c01-e1b1-4800-b959-8e184a6d7d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:51:28.503168 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80889c01-e1b1-4800-b959-8e184a6d7d6c admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:28.503453 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80889c01-e1b1-4800-b959-8e184a6d7d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:28.503732 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80889c01-e1b1-4800-b959-8e184a6d7d6c admin admin] PATH_INFO: `/v3/projects/0c3d9801ad754740ae4b7891d05c103f` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:28.513861 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80889c01-e1b1-4800-b959-8e184a6d7d6c admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3d9801ad754740ae4b7891d05c103f)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:51:28.516139 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80889c01-e1b1-4800-b959-8e184a6d7d6c admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:51:28.522976 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 660/1336] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:51:28 2022] GET /identity/v3/projects/0c3d9801ad754740ae4b7891d05c103f => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:51:28.529285 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2a4e9-3eac-4ad8-b04f-ee0fca0e0a6f None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:51:28.530484 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-eee2a4e9-3eac-4ad8-b04f-ee0fca0e0a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:28.619612 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2a4e9-3eac-4ad8-b04f-ee0fca0e0a6f None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:51:28.695255 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aac40a-48ba-45fe-b4f9-ee2168c165db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:51:28.695832 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aac40a-48ba-45fe-b4f9-ee2168c165db service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:28.696107 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aac40a-48ba-45fe-b4f9-ee2168c165db service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:28.696374 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aac40a-48ba-45fe-b4f9-ee2168c165db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:28.698053 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-53aac40a-48ba-45fe-b4f9-ee2168c165db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:28.810815 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aac40a-48ba-45fe-b4f9-ee2168c165db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:51:28.812881 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aac40a-48ba-45fe-b4f9-ee2168c165db service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:51:28.830100 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 677/1337] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:51:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:51:31.688135 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb94422-d8b3-4543-805a-af69729bfb0c None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:31.688724 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb94422-d8b3-4543-805a-af69729bfb0c None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:31.688724 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb94422-d8b3-4543-805a-af69729bfb0c None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:31.690489 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 661/1338] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:51:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:51:31.695759 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cd0da-b9a4-4555-908b-66381fa2483e None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:31.696178 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cd0da-b9a4-4555-908b-66381fa2483e None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:31.696319 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cd0da-b9a4-4555-908b-66381fa2483e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:31.773311 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-678cd0da-b9a4-4555-908b-66381fa2483e None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:51:31.774487 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-678cd0da-b9a4-4555-908b-66381fa2483e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:31.882938 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 678/1339] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:51:31.936438 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd78b9-75a8-4e00-a23b-c22fe72c50fc None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:31.936810 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd78b9-75a8-4e00-a23b-c22fe72c50fc None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:31.937817 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd78b9-75a8-4e00-a23b-c22fe72c50fc None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:31.939791 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 662/1340] 10.222.0.30 () {54 vars in 964 bytes} [Wed Jan 5 14:51:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:51:31.946052 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089126dd-e019-476f-a18c-3bc19c986eef None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:31.946343 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089126dd-e019-476f-a18c-3bc19c986eef None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:31.946622 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089126dd-e019-476f-a18c-3bc19c986eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:32.015115 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-089126dd-e019-476f-a18c-3bc19c986eef None None] MFA Rules not processed for user `a6234d716a014808a8a4eb22b903bbc9`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:51:32.016310 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-089126dd-e019-476f-a18c-3bc19c986eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:32.099831 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 679/1341] 10.222.0.30 () {58 vars in 1061 bytes} [Wed Jan 5 14:51:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:51:32.108777 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd78b9-75a8-4e00-a23b-c22fe72c50fc None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:51:32.121115 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd78b9-75a8-4e00-a23b-c22fe72c50fc None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:51:32.125235 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fe8a0-c6d2-436b-8e70-9ec57773e5f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:51:32.125885 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fe8a0-c6d2-436b-8e70-9ec57773e5f0 service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:32.126169 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fe8a0-c6d2-436b-8e70-9ec57773e5f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:32.126444 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fe8a0-c6d2-436b-8e70-9ec57773e5f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:32.136005 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fe8a0-c6d2-436b-8e70-9ec57773e5f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:51:32.137506 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fe8a0-c6d2-436b-8e70-9ec57773e5f0 service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:51:32.147870 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 663/1342] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:51:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:51:34.826971 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3bc1b-c0c4-469f-adb0-3c6d87e31339 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:34.827415 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3bc1b-c0c4-469f-adb0-3c6d87e31339 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:34.827563 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3bc1b-c0c4-469f-adb0-3c6d87e31339 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:34.829398 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 680/1343] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:51:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:51:34.834545 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca5a43-7050-4e53-b401-f9089197e754 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:34.834956 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca5a43-7050-4e53-b401-f9089197e754 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:34.835096 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca5a43-7050-4e53-b401-f9089197e754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:34.852508 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-0bca5a43-7050-4e53-b401-f9089197e754 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:51:34.853704 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-0bca5a43-7050-4e53-b401-f9089197e754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:34.861821 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 664/1344] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:51:34.898864 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3bc1b-c0c4-469f-adb0-3c6d87e31339 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:51:34.910964 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3bc1b-c0c4-469f-adb0-3c6d87e31339 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:51:34.915323 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d4ca3-6be8-4f6b-91cd-ea1211c023bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:51:34.916186 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d4ca3-6be8-4f6b-91cd-ea1211c023bc admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:34.916469 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d4ca3-6be8-4f6b-91cd-ea1211c023bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:34.916743 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d4ca3-6be8-4f6b-91cd-ea1211c023bc admin admin] PATH_INFO: `/v3/projects/df4f5a399f0847ef9e872ee655a1354c` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:34.917971 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d4ca3-6be8-4f6b-91cd-ea1211c023bc admin admin] RBAC: Authorizing `identity:get_project(project_id=df4f5a399f0847ef9e872ee655a1354c)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:51:34.919774 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d4ca3-6be8-4f6b-91cd-ea1211c023bc admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:51:34.921941 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 681/1345] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:51:34 2022] GET /identity/v3/projects/df4f5a399f0847ef9e872ee655a1354c => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:51:34.933159 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca5a43-7050-4e53-b401-f9089197e754 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:51:34.934555 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-0bca5a43-7050-4e53-b401-f9089197e754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:34.946657 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca5a43-7050-4e53-b401-f9089197e754 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:51:34.950211 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c645903-e769-46dc-9f88-78b1179beb40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:51:34.950838 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c645903-e769-46dc-9f88-78b1179beb40 service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:34.951117 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c645903-e769-46dc-9f88-78b1179beb40 service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:34.951388 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c645903-e769-46dc-9f88-78b1179beb40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:34.960131 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c645903-e769-46dc-9f88-78b1179beb40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:51:34.961586 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c645903-e769-46dc-9f88-78b1179beb40 service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:51:34.970491 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 665/1346] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:51:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:51:37.913364 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c01ec-3db0-469e-a833-5bd6f2d0a124 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:37.913894 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c01ec-3db0-469e-a833-5bd6f2d0a124 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:37.913894 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c01ec-3db0-469e-a833-5bd6f2d0a124 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:37.915675 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 682/1347] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:51:37.920770 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d18a2-063b-494a-8e33-e47b97b170da None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:37.921171 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d18a2-063b-494a-8e33-e47b97b170da None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:37.921864 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d18a2-063b-494a-8e33-e47b97b170da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:37.940887 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-000d18a2-063b-494a-8e33-e47b97b170da None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:51:37.942104 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-000d18a2-063b-494a-8e33-e47b97b170da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:37.949814 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 666/1348] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:51:37.986691 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c01ec-3db0-469e-a833-5bd6f2d0a124 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:51:37.997269 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c01ec-3db0-469e-a833-5bd6f2d0a124 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:51:38.001378 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab91d4d-d27a-4e85-bbeb-8a073d1b6e60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:51:38.002002 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab91d4d-d27a-4e85-bbeb-8a073d1b6e60 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:38.002288 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab91d4d-d27a-4e85-bbeb-8a073d1b6e60 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:38.002562 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab91d4d-d27a-4e85-bbeb-8a073d1b6e60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:38.011093 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab91d4d-d27a-4e85-bbeb-8a073d1b6e60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:51:38.012525 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab91d4d-d27a-4e85-bbeb-8a073d1b6e60 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:51:38.021511 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 683/1349] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:51:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:51:42.533975 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747e7dd-1d00-43a0-8969-f23610c5d9bf None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:42.534465 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747e7dd-1d00-43a0-8969-f23610c5d9bf None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:42.534570 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747e7dd-1d00-43a0-8969-f23610c5d9bf None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:42.536275 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 667/1350] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:51:42.542741 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a783f59-6189-46d1-9192-4a0e2c53ad97 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:42.543206 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a783f59-6189-46d1-9192-4a0e2c53ad97 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:42.543316 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a783f59-6189-46d1-9192-4a0e2c53ad97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:42.561459 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-3a783f59-6189-46d1-9192-4a0e2c53ad97 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:51:42.562697 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-3a783f59-6189-46d1-9192-4a0e2c53ad97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:42.570418 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 684/1351] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:51:42.592807 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747e7dd-1d00-43a0-8969-f23610c5d9bf None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:51:42.605203 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747e7dd-1d00-43a0-8969-f23610c5d9bf None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:51:42.609585 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9dd12a-3ea3-418f-914e-52ff75c63fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:51:42.610208 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dd12a-3ea3-418f-914e-52ff75c63fca admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:42.610490 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dd12a-3ea3-418f-914e-52ff75c63fca admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:42.610759 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dd12a-3ea3-418f-914e-52ff75c63fca admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:42.611484 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9dd12a-3ea3-418f-914e-52ff75c63fca admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:51:42.613343 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9dd12a-3ea3-418f-914e-52ff75c63fca admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:51:42.627181 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 668/1352] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jan 5 14:51:42 2022] GET /identity/v3/projects => generated 2553 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:51:45.083266 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd26c88-080e-4142-b91c-095fe874047a None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:45.083821 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd26c88-080e-4142-b91c-095fe874047a None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:45.083821 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd26c88-080e-4142-b91c-095fe874047a None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:45.085553 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 685/1353] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:51:45.090613 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765597e5-3f8c-4c01-947a-076e74cc5e4b None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:45.091056 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765597e5-3f8c-4c01-947a-076e74cc5e4b None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:45.091305 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765597e5-3f8c-4c01-947a-076e74cc5e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:45.108781 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-765597e5-3f8c-4c01-947a-076e74cc5e4b None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:51:45.110017 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-765597e5-3f8c-4c01-947a-076e74cc5e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:45.117958 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 669/1354] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:51:45.153494 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd26c88-080e-4142-b91c-095fe874047a None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:51:45.165598 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd26c88-080e-4142-b91c-095fe874047a None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:51:45.169996 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1767f-2c30-400e-865d-ddc2efb7740a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:51:45.170826 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1767f-2c30-400e-865d-ddc2efb7740a admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:45.171706 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1767f-2c30-400e-865d-ddc2efb7740a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:45.172005 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1767f-2c30-400e-865d-ddc2efb7740a admin admin] PATH_INFO: `/v3/projects/df4f5a399f0847ef9e872ee655a1354c` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:45.173240 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1767f-2c30-400e-865d-ddc2efb7740a admin admin] RBAC: Authorizing `identity:get_project(project_id=df4f5a399f0847ef9e872ee655a1354c)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:51:45.175022 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1767f-2c30-400e-865d-ddc2efb7740a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:51:45.176807 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 686/1355] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:51:45 2022] GET /identity/v3/projects/df4f5a399f0847ef9e872ee655a1354c => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:51:45.188418 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765597e5-3f8c-4c01-947a-076e74cc5e4b None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:51:45.197774 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765597e5-3f8c-4c01-947a-076e74cc5e4b None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:51:45.201322 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f38b5-0a56-418d-bdd3-f8a2dfa733bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:51:45.201951 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f38b5-0a56-418d-bdd3-f8a2dfa733bc service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:45.202229 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f38b5-0a56-418d-bdd3-f8a2dfa733bc service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:45.202499 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f38b5-0a56-418d-bdd3-f8a2dfa733bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:45.211109 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f38b5-0a56-418d-bdd3-f8a2dfa733bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:51:45.212530 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f38b5-0a56-418d-bdd3-f8a2dfa733bc service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:51:45.222245 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 670/1356] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:51:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 14:51:48.606369 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d97dc-0808-4e68-b1a5-3f6e17fe80eb None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:48.607246 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d97dc-0808-4e68-b1a5-3f6e17fe80eb None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:48.607738 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d97dc-0808-4e68-b1a5-3f6e17fe80eb None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:48.617222 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 687/1357] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:51:48 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:51:48.617378 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68031af9-a8f6-411e-8c8c-3bcfa8922028 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:48.617378 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68031af9-a8f6-411e-8c8c-3bcfa8922028 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:48.617378 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68031af9-a8f6-411e-8c8c-3bcfa8922028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:48.636479 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-68031af9-a8f6-411e-8c8c-3bcfa8922028 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:51:48.637692 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-68031af9-a8f6-411e-8c8c-3bcfa8922028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:48.646416 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 671/1358] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:51:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:51:48.686072 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d97dc-0808-4e68-b1a5-3f6e17fe80eb None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:51:48.697314 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d97dc-0808-4e68-b1a5-3f6e17fe80eb None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:51:48.700845 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe8088-37f2-4a64-8c70-f62177d21c08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:51:48.701533 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe8088-37f2-4a64-8c70-f62177d21c08 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:48.701817 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe8088-37f2-4a64-8c70-f62177d21c08 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:48.702091 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe8088-37f2-4a64-8c70-f62177d21c08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:48.712641 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe8088-37f2-4a64-8c70-f62177d21c08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:51:48.714126 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe8088-37f2-4a64-8c70-f62177d21c08 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:51:48.728694 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 688/1359] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:51:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:51:53.309773 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be427687-35ab-456c-82fc-c13bc329c98c None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:53.311847 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be427687-35ab-456c-82fc-c13bc329c98c None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:53.311847 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be427687-35ab-456c-82fc-c13bc329c98c None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:53.312212 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 672/1360] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:51:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:51:53.317255 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22741c09-e73c-4c79-ba56-295fed2f6645 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:53.317635 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22741c09-e73c-4c79-ba56-295fed2f6645 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:53.317805 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22741c09-e73c-4c79-ba56-295fed2f6645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:53.335950 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-22741c09-e73c-4c79-ba56-295fed2f6645 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:51:53.339848 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-22741c09-e73c-4c79-ba56-295fed2f6645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:53.345570 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 689/1361] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:51:53.385038 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be427687-35ab-456c-82fc-c13bc329c98c None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:51:53.396122 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be427687-35ab-456c-82fc-c13bc329c98c None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:51:53.399569 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2872ecb-846b-4061-a926-588393f309f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:51:53.400182 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2872ecb-846b-4061-a926-588393f309f7 service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:53.400459 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2872ecb-846b-4061-a926-588393f309f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:53.400728 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2872ecb-846b-4061-a926-588393f309f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:53.409812 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2872ecb-846b-4061-a926-588393f309f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:51:53.411248 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2872ecb-846b-4061-a926-588393f309f7 service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:51:53.420511 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 673/1362] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:51:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:51:58.479021 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774fe49-c2f6-41ee-adfe-9083f4d4df02 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:58.479489 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774fe49-c2f6-41ee-adfe-9083f4d4df02 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:58.479573 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774fe49-c2f6-41ee-adfe-9083f4d4df02 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:58.481391 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 690/1363] 10.222.0.30 () {54 vars in 921 bytes} [Wed Jan 5 14:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:51:58.486487 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7475797-a3f5-44bb-b093-17873ca811ef None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:51:58.486909 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7475797-a3f5-44bb-b093-17873ca811ef None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:51:58.487060 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7475797-a3f5-44bb-b093-17873ca811ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:51:58.604841 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-f7475797-a3f5-44bb-b093-17873ca811ef None None] MFA Rules not processed for user `8847b97a7089420a8b8b817f3059c660`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:51:58.607119 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-f7475797-a3f5-44bb-b093-17873ca811ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:51:58.684894 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 674/1364] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Jan 5 14:51:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:52:02.823499 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ef0bc-2090-4ecb-b532-fb0fc3848bef None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:02.824040 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ef0bc-2090-4ecb-b532-fb0fc3848bef None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:02.824122 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ef0bc-2090-4ecb-b532-fb0fc3848bef None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:02.826146 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 691/1365] 10.222.0.30 () {54 vars in 921 bytes} [Wed Jan 5 14:52:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:52:02.833003 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510992a-3716-41e6-9c42-fc7464392ded None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:02.833413 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510992a-3716-41e6-9c42-fc7464392ded None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:02.833626 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510992a-3716-41e6-9c42-fc7464392ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:02.851781 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-8510992a-3716-41e6-9c42-fc7464392ded None None] MFA Rules not processed for user `8847b97a7089420a8b8b817f3059c660`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:52:02.852964 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-8510992a-3716-41e6-9c42-fc7464392ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:52:02.861689 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 675/1366] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Jan 5 14:52:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:52:04.504402 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0c829-52f6-4a23-b1be-153f48c380b5 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:04.504924 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0c829-52f6-4a23-b1be-153f48c380b5 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:04.505050 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0c829-52f6-4a23-b1be-153f48c380b5 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:04.508699 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 692/1367] 10.222.0.30 () {54 vars in 921 bytes} [Wed Jan 5 14:52:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:52:04.513656 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e85f8-30de-4bb1-8c5e-d053cc9e503b None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:04.514121 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e85f8-30de-4bb1-8c5e-d053cc9e503b None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:04.514394 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e85f8-30de-4bb1-8c5e-d053cc9e503b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:04.532940 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-820e85f8-30de-4bb1-8c5e-d053cc9e503b None None] MFA Rules not processed for user `8847b97a7089420a8b8b817f3059c660`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:52:04.534161 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-820e85f8-30de-4bb1-8c5e-d053cc9e503b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:52:04.542685 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 676/1368] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Jan 5 14:52:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:52:08.434529 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71add2-3da8-4eb0-a001-f18ded98cade None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:08.435090 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71add2-3da8-4eb0-a001-f18ded98cade None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:08.435350 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71add2-3da8-4eb0-a001-f18ded98cade None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:08.437362 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 693/1369] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:52:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:52:08.444094 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a826be7-5077-4485-b952-89462aedb6ec None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:08.444514 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a826be7-5077-4485-b952-89462aedb6ec None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:08.444656 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a826be7-5077-4485-b952-89462aedb6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:08.463695 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-3a826be7-5077-4485-b952-89462aedb6ec None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:52:08.464964 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-3a826be7-5077-4485-b952-89462aedb6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:52:08.473779 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 677/1370] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:52:08.522360 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667827e2-8a5a-411e-96aa-907c01a62ae7 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:08.522852 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667827e2-8a5a-411e-96aa-907c01a62ae7 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:08.523320 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667827e2-8a5a-411e-96aa-907c01a62ae7 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:08.525524 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 694/1371] 10.222.0.30 () {54 vars in 961 bytes} [Wed Jan 5 14:52:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:52:08.530644 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d670cf8-1f2c-4e38-b301-156a49863948 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:08.530941 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d670cf8-1f2c-4e38-b301-156a49863948 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:08.531223 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d670cf8-1f2c-4e38-b301-156a49863948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:08.584694 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-7d670cf8-1f2c-4e38-b301-156a49863948 None None] MFA Rules not processed for user `77db235e2f7046e4bdbad7f31b5e3ebc`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:52:08.586038 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-7d670cf8-1f2c-4e38-b301-156a49863948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:52:08.673782 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 678/1372] 10.222.0.30 () {58 vars in 1058 bytes} [Wed Jan 5 14:52:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:52:08.681753 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667827e2-8a5a-411e-96aa-907c01a62ae7 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:52:08.696972 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667827e2-8a5a-411e-96aa-907c01a62ae7 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:52:08.703307 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759526a3-3904-4a4c-9576-ebc66531d5af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:52:08.703939 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759526a3-3904-4a4c-9576-ebc66531d5af service nova] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:08.704224 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759526a3-3904-4a4c-9576-ebc66531d5af service nova] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:08.704501 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759526a3-3904-4a4c-9576-ebc66531d5af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:08.713208 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759526a3-3904-4a4c-9576-ebc66531d5af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:52:08.714842 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759526a3-3904-4a4c-9576-ebc66531d5af service nova] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:52:08.725501 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 695/1373] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:52:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 14:52:11.379976 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd19fca-0639-4fa5-9ed4-869ade06e2c7 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:11.380493 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd19fca-0639-4fa5-9ed4-869ade06e2c7 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:11.380587 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd19fca-0639-4fa5-9ed4-869ade06e2c7 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:11.382565 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 679/1374] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:52:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:52:11.387468 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c531c5-a23f-4021-bb9b-79898eae6825 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:11.387886 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c531c5-a23f-4021-bb9b-79898eae6825 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:11.388029 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c531c5-a23f-4021-bb9b-79898eae6825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:11.406162 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-63c531c5-a23f-4021-bb9b-79898eae6825 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:52:11.407878 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-63c531c5-a23f-4021-bb9b-79898eae6825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:52:11.421491 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 696/1375] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:52:11.463553 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd19fca-0639-4fa5-9ed4-869ade06e2c7 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:52:11.478811 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd19fca-0639-4fa5-9ed4-869ade06e2c7 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:52:11.485282 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c68d7-fb82-4176-9bb3-b21e588ab770 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:52:11.485916 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c68d7-fb82-4176-9bb3-b21e588ab770 service nova] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:11.486198 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c68d7-fb82-4176-9bb3-b21e588ab770 service nova] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:11.486472 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c68d7-fb82-4176-9bb3-b21e588ab770 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:11.496624 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c68d7-fb82-4176-9bb3-b21e588ab770 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:52:11.498299 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c68d7-fb82-4176-9bb3-b21e588ab770 service nova] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:52:11.511768 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 680/1376] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:52:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:52:14.395155 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af0cbd-edbc-4d6b-a5a9-cee2890dd926 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:14.395822 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af0cbd-edbc-4d6b-a5a9-cee2890dd926 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:14.395822 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af0cbd-edbc-4d6b-a5a9-cee2890dd926 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:14.397513 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 697/1377] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:52:14.403241 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9ed1a-22a5-46e5-8eba-761698083cd0 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:14.404053 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9ed1a-22a5-46e5-8eba-761698083cd0 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:14.404336 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9ed1a-22a5-46e5-8eba-761698083cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:14.428763 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-7fb9ed1a-22a5-46e5-8eba-761698083cd0 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:52:14.430245 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-7fb9ed1a-22a5-46e5-8eba-761698083cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:52:14.438737 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 681/1378] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:52:14.489398 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72040a2-adde-4461-9bc6-4fb54be63722 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:14.491961 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72040a2-adde-4461-9bc6-4fb54be63722 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:14.491961 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72040a2-adde-4461-9bc6-4fb54be63722 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:14.493223 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 698/1379] 10.222.0.30 () {54 vars in 961 bytes} [Wed Jan 5 14:52:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:52:14.500502 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15adc3e-9b4e-498d-8753-e2ed6fa0b75c None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:14.500928 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15adc3e-9b4e-498d-8753-e2ed6fa0b75c None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:14.501334 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15adc3e-9b4e-498d-8753-e2ed6fa0b75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:14.524646 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-a15adc3e-9b4e-498d-8753-e2ed6fa0b75c None None] MFA Rules not processed for user `77db235e2f7046e4bdbad7f31b5e3ebc`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:52:14.526165 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-a15adc3e-9b4e-498d-8753-e2ed6fa0b75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:52:14.536201 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 682/1380] 10.222.0.30 () {58 vars in 1058 bytes} [Wed Jan 5 14:52:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:52:14.544796 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72040a2-adde-4461-9bc6-4fb54be63722 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:52:14.559973 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72040a2-adde-4461-9bc6-4fb54be63722 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:52:14.565609 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440fd7c-12b2-46bd-a5e8-5c8072e095a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:52:14.566322 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440fd7c-12b2-46bd-a5e8-5c8072e095a9 service nova] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:14.566675 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440fd7c-12b2-46bd-a5e8-5c8072e095a9 service nova] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:14.567024 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440fd7c-12b2-46bd-a5e8-5c8072e095a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:14.575628 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440fd7c-12b2-46bd-a5e8-5c8072e095a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:52:14.577886 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440fd7c-12b2-46bd-a5e8-5c8072e095a9 service nova] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:52:14.589473 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 699/1381] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:52:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 14:52:16.465114 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d8425-29f9-4c88-91c0-f6d8c61dbddb None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:16.465669 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d8425-29f9-4c88-91c0-f6d8c61dbddb None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:16.465669 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d8425-29f9-4c88-91c0-f6d8c61dbddb None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:16.467462 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 683/1382] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:52:16.473980 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafaffe-0c25-4d49-b44c-db6ee4b71c80 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:16.474398 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafaffe-0c25-4d49-b44c-db6ee4b71c80 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:16.474524 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafaffe-0c25-4d49-b44c-db6ee4b71c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:16.493672 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-cbafaffe-0c25-4d49-b44c-db6ee4b71c80 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:52:16.495036 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-cbafaffe-0c25-4d49-b44c-db6ee4b71c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:52:16.504260 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 700/1383] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:52:16.559251 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f24041-6649-4eca-ae8c-0c36b2666663 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:16.559670 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f24041-6649-4eca-ae8c-0c36b2666663 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:16.560047 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f24041-6649-4eca-ae8c-0c36b2666663 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:16.562706 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 684/1384] 10.222.0.30 () {54 vars in 963 bytes} [Wed Jan 5 14:52:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:52:16.568106 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69538db2-3e2c-4df9-9c8c-55c299d224f3 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:16.568520 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69538db2-3e2c-4df9-9c8c-55c299d224f3 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:16.568919 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69538db2-3e2c-4df9-9c8c-55c299d224f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:16.617461 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-69538db2-3e2c-4df9-9c8c-55c299d224f3 None None] MFA Rules not processed for user `541bd71b355d4b7ca35372e11be54be3`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:52:16.618648 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-69538db2-3e2c-4df9-9c8c-55c299d224f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:52:16.676459 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 701/1385] 10.222.0.30 () {58 vars in 1060 bytes} [Wed Jan 5 14:52:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:52:16.683801 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f24041-6649-4eca-ae8c-0c36b2666663 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:52:16.695628 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f24041-6649-4eca-ae8c-0c36b2666663 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:52:16.699406 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7b8ae-e0b0-42c3-afa9-e91d372a3b70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:52:16.703423 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7b8ae-e0b0-42c3-afa9-e91d372a3b70 service cinder] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:16.704020 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7b8ae-e0b0-42c3-afa9-e91d372a3b70 service cinder] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:16.704584 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7b8ae-e0b0-42c3-afa9-e91d372a3b70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:16.715585 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7b8ae-e0b0-42c3-afa9-e91d372a3b70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:52:16.717097 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7b8ae-e0b0-42c3-afa9-e91d372a3b70 service cinder] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:52:16.727513 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 685/1386] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:52:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 14:52:17.215745 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a79bbe-09b8-4d7a-a0cb-04eac4dc478b None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:17.216109 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a79bbe-09b8-4d7a-a0cb-04eac4dc478b None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:17.216396 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a79bbe-09b8-4d7a-a0cb-04eac4dc478b None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:17.218840 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 702/1387] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:52:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:52:17.224807 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239b9e2-df83-40a6-83d3-f44103c53587 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:17.225210 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239b9e2-df83-40a6-83d3-f44103c53587 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:17.225561 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239b9e2-df83-40a6-83d3-f44103c53587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:17.247047 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-e239b9e2-df83-40a6-83d3-f44103c53587 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:52:17.248469 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-e239b9e2-df83-40a6-83d3-f44103c53587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:52:17.256524 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 686/1388] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:52:17.303520 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a79bbe-09b8-4d7a-a0cb-04eac4dc478b None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:52:17.317963 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a79bbe-09b8-4d7a-a0cb-04eac4dc478b None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:52:17.323439 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935a00b-b752-4e97-9f7e-cf0dab4810a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:52:17.328228 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935a00b-b752-4e97-9f7e-cf0dab4810a3 service nova] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:17.328228 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935a00b-b752-4e97-9f7e-cf0dab4810a3 service nova] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:17.328228 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935a00b-b752-4e97-9f7e-cf0dab4810a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:17.332949 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4935a00b-b752-4e97-9f7e-cf0dab4810a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:52:17.334737 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4935a00b-b752-4e97-9f7e-cf0dab4810a3 service nova] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:52:17.349792 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 703/1389] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:52:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:52:19.962785 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119980e-3251-4671-8fdb-121c896170a7 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:19.963617 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119980e-3251-4671-8fdb-121c896170a7 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:19.963905 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119980e-3251-4671-8fdb-121c896170a7 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:19.972401 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc1a71-f988-4632-a591-1f98f8a7f7ed None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:19.972860 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc1a71-f988-4632-a591-1f98f8a7f7ed None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:19.973175 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc1a71-f988-4632-a591-1f98f8a7f7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:19.976742 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 687/1390] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:52:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:52:20.000737 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-cdbc1a71-f988-4632-a591-1f98f8a7f7ed None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:52:20.003234 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-cdbc1a71-f988-4632-a591-1f98f8a7f7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:52:20.022426 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 704/1391] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:52:20.074059 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119980e-3251-4671-8fdb-121c896170a7 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:52:20.094225 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119980e-3251-4671-8fdb-121c896170a7 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:52:20.098847 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897a3a5-a897-4377-b4fd-1fa655f4d7a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:52:20.099587 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897a3a5-a897-4377-b4fd-1fa655f4d7a3 service nova] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:20.099972 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897a3a5-a897-4377-b4fd-1fa655f4d7a3 service nova] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:20.100348 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897a3a5-a897-4377-b4fd-1fa655f4d7a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:20.108670 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897a3a5-a897-4377-b4fd-1fa655f4d7a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:52:20.110411 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897a3a5-a897-4377-b4fd-1fa655f4d7a3 service nova] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:52:20.120211 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 688/1392] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:52:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:52:22.701274 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856c985-f9a8-4e71-b0b4-bad37d402501 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:22.701827 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856c985-f9a8-4e71-b0b4-bad37d402501 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:22.701827 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856c985-f9a8-4e71-b0b4-bad37d402501 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:22.703895 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 705/1393] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:52:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:52:22.708999 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50949e-4895-4ec0-89fa-fe8f594b7b47 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:22.709492 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50949e-4895-4ec0-89fa-fe8f594b7b47 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:22.709595 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50949e-4895-4ec0-89fa-fe8f594b7b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:22.727321 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-3a50949e-4895-4ec0-89fa-fe8f594b7b47 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:52:22.728515 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-3a50949e-4895-4ec0-89fa-fe8f594b7b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:52:22.737580 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 689/1394] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:52:22.783072 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856c985-f9a8-4e71-b0b4-bad37d402501 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:52:22.798368 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856c985-f9a8-4e71-b0b4-bad37d402501 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:52:22.804130 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c1a31-f020-43b5-a9c5-0a1c1f4df13d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:52:22.804997 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c1a31-f020-43b5-a9c5-0a1c1f4df13d service nova] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:22.805415 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c1a31-f020-43b5-a9c5-0a1c1f4df13d service nova] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:22.805850 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c1a31-f020-43b5-a9c5-0a1c1f4df13d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:22.815756 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c1a31-f020-43b5-a9c5-0a1c1f4df13d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:52:22.817632 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c1a31-f020-43b5-a9c5-0a1c1f4df13d service nova] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:52:22.829015 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 706/1395] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:52:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:52:25.403627 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6b01e-c3ba-4d60-8fd6-a81ad208b613 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:25.404843 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6b01e-c3ba-4d60-8fd6-a81ad208b613 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:25.404843 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6b01e-c3ba-4d60-8fd6-a81ad208b613 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:25.406568 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 690/1396] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:52:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:52:25.414024 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8fe22-19aa-40e0-a2ff-d21b42cf9ee6 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:25.414508 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8fe22-19aa-40e0-a2ff-d21b42cf9ee6 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:25.414751 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8fe22-19aa-40e0-a2ff-d21b42cf9ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:25.433560 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-dcc8fe22-19aa-40e0-a2ff-d21b42cf9ee6 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:52:25.434746 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-dcc8fe22-19aa-40e0-a2ff-d21b42cf9ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:52:25.442698 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 707/1397] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:52:25.487114 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6b01e-c3ba-4d60-8fd6-a81ad208b613 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:52:25.503813 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6b01e-c3ba-4d60-8fd6-a81ad208b613 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:52:25.510872 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525acf7-21b8-4401-82c7-5d53ffc4e9f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:52:25.511510 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525acf7-21b8-4401-82c7-5d53ffc4e9f3 service nova] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:25.511812 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525acf7-21b8-4401-82c7-5d53ffc4e9f3 service nova] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:25.512086 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525acf7-21b8-4401-82c7-5d53ffc4e9f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:25.520523 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525acf7-21b8-4401-82c7-5d53ffc4e9f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:52:25.522131 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525acf7-21b8-4401-82c7-5d53ffc4e9f3 service nova] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:52:25.532393 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 691/1398] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:52:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:52:28.427526 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ec887-6c51-452f-a38e-821061a6691f None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:28.428029 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ec887-6c51-452f-a38e-821061a6691f None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:28.428169 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ec887-6c51-452f-a38e-821061a6691f None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:28.430519 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 708/1399] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:52:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:52:28.437531 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ee55a-39d6-4d5c-b984-88b4b82221f4 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:28.437937 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ee55a-39d6-4d5c-b984-88b4b82221f4 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:28.438085 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ee55a-39d6-4d5c-b984-88b4b82221f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:28.456498 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-d38ee55a-39d6-4d5c-b984-88b4b82221f4 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:52:28.457714 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-d38ee55a-39d6-4d5c-b984-88b4b82221f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:52:28.465521 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 692/1400] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:52:28.513102 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ec887-6c51-452f-a38e-821061a6691f None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:52:28.531269 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ec887-6c51-452f-a38e-821061a6691f None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:52:28.538125 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8e46e-9606-4013-8494-f049d6acc7e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:52:28.538893 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8e46e-9606-4013-8494-f049d6acc7e7 service nova] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:28.539253 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8e46e-9606-4013-8494-f049d6acc7e7 service nova] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:28.539611 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8e46e-9606-4013-8494-f049d6acc7e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:28.549810 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8e46e-9606-4013-8494-f049d6acc7e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:52:28.551858 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8e46e-9606-4013-8494-f049d6acc7e7 service nova] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:52:28.564529 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 709/1401] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:52:31.164794 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89470da-d6de-4ed8-aa0e-4dc6e8c369fd None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:31.165381 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89470da-d6de-4ed8-aa0e-4dc6e8c369fd None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:31.165381 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89470da-d6de-4ed8-aa0e-4dc6e8c369fd None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:31.167158 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 693/1402] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:52:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:52:31.173553 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacad55-dc06-4ff7-b51f-6520133d30e6 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:31.173993 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacad55-dc06-4ff7-b51f-6520133d30e6 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:31.174086 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacad55-dc06-4ff7-b51f-6520133d30e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:31.192010 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-aaacad55-dc06-4ff7-b51f-6520133d30e6 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:52:31.193210 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-aaacad55-dc06-4ff7-b51f-6520133d30e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:52:31.201282 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 710/1403] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:52:31.247516 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89470da-d6de-4ed8-aa0e-4dc6e8c369fd None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:52:31.262172 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89470da-d6de-4ed8-aa0e-4dc6e8c369fd None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:52:31.267541 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62047b8d-ffbf-4e2b-bb1b-57c0f49672a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:52:31.268164 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62047b8d-ffbf-4e2b-bb1b-57c0f49672a8 service nova] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:31.268449 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62047b8d-ffbf-4e2b-bb1b-57c0f49672a8 service nova] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:31.268729 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62047b8d-ffbf-4e2b-bb1b-57c0f49672a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:31.276739 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62047b8d-ffbf-4e2b-bb1b-57c0f49672a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:52:31.278364 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62047b8d-ffbf-4e2b-bb1b-57c0f49672a8 service nova] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:52:31.288385 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 694/1404] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:52:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:52:32.194312 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd543e-6cfa-44a1-b37f-fcb107d67f08 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:32.194885 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd543e-6cfa-44a1-b37f-fcb107d67f08 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:32.194885 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd543e-6cfa-44a1-b37f-fcb107d67f08 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:32.196616 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 711/1405] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:52:32.202286 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ec95b-c1b2-4de6-8ee8-2ac22fe6cbb0 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:32.202694 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ec95b-c1b2-4de6-8ee8-2ac22fe6cbb0 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:32.202833 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ec95b-c1b2-4de6-8ee8-2ac22fe6cbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:32.220837 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-736ec95b-c1b2-4de6-8ee8-2ac22fe6cbb0 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:52:32.222035 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-736ec95b-c1b2-4de6-8ee8-2ac22fe6cbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:52:32.229603 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 695/1406] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:52:32.291047 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee8d8d-6696-448c-88fa-c8d349ffc96f None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:32.291336 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee8d8d-6696-448c-88fa-c8d349ffc96f None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:32.291616 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee8d8d-6696-448c-88fa-c8d349ffc96f None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:32.293508 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 712/1407] 10.222.0.30 () {54 vars in 962 bytes} [Wed Jan 5 14:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:52:32.299124 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e879d6-83de-4985-bec1-104aaca5c099 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:32.299509 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e879d6-83de-4985-bec1-104aaca5c099 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:32.299888 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e879d6-83de-4985-bec1-104aaca5c099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:32.348546 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-66e879d6-83de-4985-bec1-104aaca5c099 None None] MFA Rules not processed for user `935ad716e4624c25bc34308f05eb1526`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:52:32.349787 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-66e879d6-83de-4985-bec1-104aaca5c099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:52:32.408826 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 696/1408] 10.222.0.30 () {58 vars in 1059 bytes} [Wed Jan 5 14:52:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:52:32.416506 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee8d8d-6696-448c-88fa-c8d349ffc96f None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:52:32.427681 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee8d8d-6696-448c-88fa-c8d349ffc96f None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:52:32.431220 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8c95c-8a64-4a46-a656-6230760a939d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935ad716e4624c25bc34308f05eb1526', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:52:32.431846 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8c95c-8a64-4a46-a656-6230760a939d service glance] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:32.432129 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8c95c-8a64-4a46-a656-6230760a939d service glance] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:32.432410 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8c95c-8a64-4a46-a656-6230760a939d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:32.441962 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8c95c-8a64-4a46-a656-6230760a939d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:52:32.443400 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8c95c-8a64-4a46-a656-6230760a939d service glance] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:52:32.452719 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 713/1409] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:52:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:52:33.028845 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5e025-0938-48e3-b632-3d1b1743c6e8 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:33.036801 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5e025-0938-48e3-b632-3d1b1743c6e8 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:33.036801 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5e025-0938-48e3-b632-3d1b1743c6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:33.076859 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-b4f5e025-0938-48e3-b632-3d1b1743c6e8 None None] MFA Rules not processed for user `29314b0be6534c79b36f31402d51d17b`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:52:33.078077 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-b4f5e025-0938-48e3-b632-3d1b1743c6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:52:33.140097 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 697/1410] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Jan 5 14:52:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:52:33.184453 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf1139-d2ef-4622-aa40-ba55b7db70b0 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:33.184739 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf1139-d2ef-4622-aa40-ba55b7db70b0 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:33.185038 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf1139-d2ef-4622-aa40-ba55b7db70b0 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:33.186903 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 714/1411] 10.222.0.30 () {54 vars in 942 bytes} [Wed Jan 5 14:52:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:52:33.193502 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8b616-8a12-427e-9ca9-e677eb9eec9a None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:33.193798 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8b616-8a12-427e-9ca9-e677eb9eec9a None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:33.194082 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8b616-8a12-427e-9ca9-e677eb9eec9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:33.242787 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-2fd8b616-8a12-427e-9ca9-e677eb9eec9a None None] MFA Rules not processed for user `c6ea13fd3e704b16aad5a38606ddc049`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:52:33.243970 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-2fd8b616-8a12-427e-9ca9-e677eb9eec9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:52:33.319118 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 698/1412] 10.222.0.30 () {58 vars in 1039 bytes} [Wed Jan 5 14:52:33 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:52:33.329013 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf1139-d2ef-4622-aa40-ba55b7db70b0 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:52:33.342830 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf1139-d2ef-4622-aa40-ba55b7db70b0 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:52:33.347796 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c446dc7-9d9c-4ae4-82fd-f22f901821ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ea13fd3e704b16aad5a38606ddc049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:52:33.348694 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c446dc7-9d9c-4ae4-82fd-f22f901821ef service swift] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:33.348989 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c446dc7-9d9c-4ae4-82fd-f22f901821ef service swift] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:33.349302 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c446dc7-9d9c-4ae4-82fd-f22f901821ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:33.357346 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c446dc7-9d9c-4ae4-82fd-f22f901821ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:52:33.358935 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c446dc7-9d9c-4ae4-82fd-f22f901821ef service swift] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:52:33.367096 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 715/1413] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jan 5 14:52:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:52:33.849906 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59c627-fbc2-40eb-bfdf-57ea867b1d9a None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:33.850190 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59c627-fbc2-40eb-bfdf-57ea867b1d9a None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:33.850464 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59c627-fbc2-40eb-bfdf-57ea867b1d9a None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:33.852236 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 699/1414] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:52:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:52:33.857713 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd1d81-336f-4e60-8da3-185a24aa3cc8 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:33.857997 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd1d81-336f-4e60-8da3-185a24aa3cc8 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:33.858294 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd1d81-336f-4e60-8da3-185a24aa3cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:33.880473 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-bddd1d81-336f-4e60-8da3-185a24aa3cc8 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:52:33.881809 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-bddd1d81-336f-4e60-8da3-185a24aa3cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:52:33.890804 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 716/1415] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:52:33.940571 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59c627-fbc2-40eb-bfdf-57ea867b1d9a None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:52:33.955490 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59c627-fbc2-40eb-bfdf-57ea867b1d9a None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:52:33.960907 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2be89-50ac-403a-aab6-86b8fd458304 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:52:33.961550 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2be89-50ac-403a-aab6-86b8fd458304 service nova] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:33.961831 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2be89-50ac-403a-aab6-86b8fd458304 service nova] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:33.962106 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2be89-50ac-403a-aab6-86b8fd458304 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:33.970771 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2be89-50ac-403a-aab6-86b8fd458304 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:52:33.972365 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2be89-50ac-403a-aab6-86b8fd458304 service nova] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:52:33.982752 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 700/1416] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:52:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:52:36.606824 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542e5c5-16cd-4139-9cff-86d1611fca1c None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:36.607479 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542e5c5-16cd-4139-9cff-86d1611fca1c None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:36.607479 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542e5c5-16cd-4139-9cff-86d1611fca1c None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:36.610755 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 717/1417] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:52:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:52:36.615020 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fe416-b468-4b0c-a537-818e1571c976 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:36.616220 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fe416-b468-4b0c-a537-818e1571c976 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:36.616512 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fe416-b468-4b0c-a537-818e1571c976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:36.635278 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-5b6fe416-b468-4b0c-a537-818e1571c976 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:52:36.636629 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-5b6fe416-b468-4b0c-a537-818e1571c976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:52:36.644929 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 701/1418] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:52:36.690864 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542e5c5-16cd-4139-9cff-86d1611fca1c None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:52:36.705879 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542e5c5-16cd-4139-9cff-86d1611fca1c None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:52:36.716819 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180f4c9-8416-44ba-9606-b09e149941be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:52:36.717600 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180f4c9-8416-44ba-9606-b09e149941be service nova] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:36.717879 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180f4c9-8416-44ba-9606-b09e149941be service nova] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:36.718159 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180f4c9-8416-44ba-9606-b09e149941be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:36.726775 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180f4c9-8416-44ba-9606-b09e149941be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:52:36.728349 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180f4c9-8416-44ba-9606-b09e149941be service nova] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:52:36.738388 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 718/1419] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:52:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:52:39.325733 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093d93d-57ae-483d-b223-6bb80acaa282 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:39.326294 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093d93d-57ae-483d-b223-6bb80acaa282 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:39.326294 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093d93d-57ae-483d-b223-6bb80acaa282 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:39.328058 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 702/1420] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:52:39.335063 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de54ee-4613-427b-a77d-85337036e6a1 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:39.335063 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de54ee-4613-427b-a77d-85337036e6a1 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:39.335063 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de54ee-4613-427b-a77d-85337036e6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:39.356076 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-56de54ee-4613-427b-a77d-85337036e6a1 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:52:39.357831 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-56de54ee-4613-427b-a77d-85337036e6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:52:39.366372 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 719/1421] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:52:39.412017 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093d93d-57ae-483d-b223-6bb80acaa282 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:52:39.427052 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093d93d-57ae-483d-b223-6bb80acaa282 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:52:39.432940 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25d712-7fef-4ca8-8218-d7217a4d5177 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:52:39.433598 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25d712-7fef-4ca8-8218-d7217a4d5177 service nova] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:39.433881 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25d712-7fef-4ca8-8218-d7217a4d5177 service nova] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:39.434158 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25d712-7fef-4ca8-8218-d7217a4d5177 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:39.445793 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25d712-7fef-4ca8-8218-d7217a4d5177 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:52:39.447516 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25d712-7fef-4ca8-8218-d7217a4d5177 service nova] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:52:39.461574 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 703/1422] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:52:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:52:57.664009 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97af66-832a-48b3-a8c8-e73dd73db025 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:57.664598 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97af66-832a-48b3-a8c8-e73dd73db025 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:57.664598 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97af66-832a-48b3-a8c8-e73dd73db025 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:57.666410 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 720/1423] 10.222.0.30 () {54 vars in 918 bytes} [Wed Jan 5 14:52:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:52:57.671692 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f2e8b-2bc4-4207-9e1e-633639cb3bb8 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:57.672126 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f2e8b-2bc4-4207-9e1e-633639cb3bb8 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:57.672230 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f2e8b-2bc4-4207-9e1e-633639cb3bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:57.691488 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-7a6f2e8b-2bc4-4207-9e1e-633639cb3bb8 None None] MFA Rules not processed for user `8847b97a7089420a8b8b817f3059c660`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:52:57.692678 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-7a6f2e8b-2bc4-4207-9e1e-633639cb3bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:52:57.701739 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 704/1424] 10.222.0.30 () {58 vars in 1015 bytes} [Wed Jan 5 14:52:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:52:57.716101 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124bdbf-6961-4c6f-a388-c40fa4ef712f None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:57.716405 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124bdbf-6961-4c6f-a388-c40fa4ef712f None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:57.716671 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124bdbf-6961-4c6f-a388-c40fa4ef712f None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:57.718538 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 721/1425] 10.222.0.30 () {54 vars in 918 bytes} [Wed Jan 5 14:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:52:57.723013 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a831f3-a6f4-4ec5-a0c5-968992bbbb4a None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:52:57.723300 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a831f3-a6f4-4ec5-a0c5-968992bbbb4a None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:52:57.723604 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a831f3-a6f4-4ec5-a0c5-968992bbbb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:52:57.741503 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-02a831f3-a6f4-4ec5-a0c5-968992bbbb4a None None] MFA Rules not processed for user `77db235e2f7046e4bdbad7f31b5e3ebc`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:52:57.742670 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-02a831f3-a6f4-4ec5-a0c5-968992bbbb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:52:57.752125 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 705/1426] 10.222.0.30 () {58 vars in 1015 bytes} [Wed Jan 5 14:52:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:53:00.525691 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a4dae-6fec-40ab-bbd2-33d5f2b075c1 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:00.526150 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a4dae-6fec-40ab-bbd2-33d5f2b075c1 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:00.526276 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a4dae-6fec-40ab-bbd2-33d5f2b075c1 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:00.528236 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 722/1427] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jan 5 14:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:53:00.534519 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d70bf9-c24e-417b-957a-253390626240 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:00.534922 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d70bf9-c24e-417b-957a-253390626240 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:00.535081 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d70bf9-c24e-417b-957a-253390626240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:00.552438 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-b5d70bf9-c24e-417b-957a-253390626240 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:53:00.553655 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-b5d70bf9-c24e-417b-957a-253390626240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:53:00.561875 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 706/1428] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jan 5 14:53:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:53:00.603157 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a4dae-6fec-40ab-bbd2-33d5f2b075c1 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:53:00.617373 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a4dae-6fec-40ab-bbd2-33d5f2b075c1 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:53:00.623372 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2fe13-aa92-4710-af0e-da8aded9b56c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:53:00.623996 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2fe13-aa92-4710-af0e-da8aded9b56c service nova] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:00.624275 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2fe13-aa92-4710-af0e-da8aded9b56c service nova] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:00.624564 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2fe13-aa92-4710-af0e-da8aded9b56c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:00.632538 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2fe13-aa92-4710-af0e-da8aded9b56c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:53:00.634098 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2fe13-aa92-4710-af0e-da8aded9b56c service nova] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:53:00.643742 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 723/1429] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:53:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:53:02.289827 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f7d06-1641-476b-a222-ff3b3953be5c None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:02.290369 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f7d06-1641-476b-a222-ff3b3953be5c None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:02.290369 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f7d06-1641-476b-a222-ff3b3953be5c None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:02.292152 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 707/1430] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jan 5 14:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:53:02.297086 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7ab3a-083a-4885-a9d5-cd54a5913d70 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:02.303893 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7ab3a-083a-4885-a9d5-cd54a5913d70 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:02.303893 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7ab3a-083a-4885-a9d5-cd54a5913d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:02.315870 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-d4e7ab3a-083a-4885-a9d5-cd54a5913d70 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:53:02.317091 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-d4e7ab3a-083a-4885-a9d5-cd54a5913d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:53:02.325590 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 724/1431] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jan 5 14:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:53:02.475405 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f7d06-1641-476b-a222-ff3b3953be5c None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:53:02.490083 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f7d06-1641-476b-a222-ff3b3953be5c None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:53:02.495401 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5958dc-e9f4-478e-9256-eef31d9f149b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:53:02.496024 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5958dc-e9f4-478e-9256-eef31d9f149b service nova] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:02.496305 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5958dc-e9f4-478e-9256-eef31d9f149b service nova] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:02.496580 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5958dc-e9f4-478e-9256-eef31d9f149b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:02.505309 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5958dc-e9f4-478e-9256-eef31d9f149b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:53:02.506894 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5958dc-e9f4-478e-9256-eef31d9f149b service nova] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:53:02.516059 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 708/1432] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:53:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:53:04.080490 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a41e5-a170-4ae5-8adc-b34416a001b2 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:04.081124 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a41e5-a170-4ae5-8adc-b34416a001b2 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:04.081423 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a41e5-a170-4ae5-8adc-b34416a001b2 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:04.083673 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 725/1433] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jan 5 14:53:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 14:53:04.089379 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced768b-64a9-4dc6-ba85-497bc8d9ee32 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:04.089832 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced768b-64a9-4dc6-ba85-497bc8d9ee32 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:04.089942 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced768b-64a9-4dc6-ba85-497bc8d9ee32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:04.108575 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-6ced768b-64a9-4dc6-ba85-497bc8d9ee32 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:53:04.109848 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-6ced768b-64a9-4dc6-ba85-497bc8d9ee32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:53:04.119466 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 709/1434] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jan 5 14:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:53:04.272604 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a41e5-a170-4ae5-8adc-b34416a001b2 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:53:04.286770 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a41e5-a170-4ae5-8adc-b34416a001b2 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:53:04.292202 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52681926-c6e6-4b61-a77a-76978d2e8a1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:53:04.292828 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52681926-c6e6-4b61-a77a-76978d2e8a1b service nova] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:04.293145 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52681926-c6e6-4b61-a77a-76978d2e8a1b service nova] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:04.293535 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52681926-c6e6-4b61-a77a-76978d2e8a1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:04.302976 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52681926-c6e6-4b61-a77a-76978d2e8a1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:53:04.304566 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52681926-c6e6-4b61-a77a-76978d2e8a1b service nova] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:53:04.314865 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 726/1435] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:53:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:53:05.894761 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42342b0b-7d15-4bd0-acbf-23ef185c3324 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:05.895301 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42342b0b-7d15-4bd0-acbf-23ef185c3324 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:05.895301 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42342b0b-7d15-4bd0-acbf-23ef185c3324 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:05.897085 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 710/1436] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jan 5 14:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:53:05.901837 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367f0d9-a5b9-4e16-b6b3-63356f37624f None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:05.902256 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367f0d9-a5b9-4e16-b6b3-63356f37624f None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:05.902359 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367f0d9-a5b9-4e16-b6b3-63356f37624f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:05.919671 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-f367f0d9-a5b9-4e16-b6b3-63356f37624f None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:53:05.920951 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-f367f0d9-a5b9-4e16-b6b3-63356f37624f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:53:05.928511 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 727/1437] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jan 5 14:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:53:06.078637 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42342b0b-7d15-4bd0-acbf-23ef185c3324 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:53:06.092528 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42342b0b-7d15-4bd0-acbf-23ef185c3324 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:53:06.097857 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a9b22-7efc-4267-9438-eb59a11153b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:53:06.098478 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a9b22-7efc-4267-9438-eb59a11153b1 service nova] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:06.098761 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a9b22-7efc-4267-9438-eb59a11153b1 service nova] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:06.099035 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a9b22-7efc-4267-9438-eb59a11153b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:06.106934 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a9b22-7efc-4267-9438-eb59a11153b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:53:06.108511 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a9b22-7efc-4267-9438-eb59a11153b1 service nova] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:53:06.117843 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 711/1438] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:53:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:53:07.671883 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d6488-f9e9-44d3-b7f1-08a29a58b268 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:07.672445 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d6488-f9e9-44d3-b7f1-08a29a58b268 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:07.672445 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d6488-f9e9-44d3-b7f1-08a29a58b268 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:07.674287 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 728/1439] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jan 5 14:53:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:53:07.679187 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10457a7-8cc8-4438-9cd6-930f1c2d305a None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:07.679584 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10457a7-8cc8-4438-9cd6-930f1c2d305a None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:07.679775 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10457a7-8cc8-4438-9cd6-930f1c2d305a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:07.698116 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-f10457a7-8cc8-4438-9cd6-930f1c2d305a None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:53:07.699297 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-f10457a7-8cc8-4438-9cd6-930f1c2d305a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:53:07.706929 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 712/1440] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jan 5 14:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:53:07.855268 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d6488-f9e9-44d3-b7f1-08a29a58b268 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:53:07.869686 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d6488-f9e9-44d3-b7f1-08a29a58b268 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:53:07.875558 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b15124-4912-401a-854d-1868926d2a1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:53:07.876177 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b15124-4912-401a-854d-1868926d2a1f service nova] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:07.876455 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b15124-4912-401a-854d-1868926d2a1f service nova] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:07.876727 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b15124-4912-401a-854d-1868926d2a1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:07.884425 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b15124-4912-401a-854d-1868926d2a1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:53:07.886010 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b15124-4912-401a-854d-1868926d2a1f service nova] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:53:07.895014 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 729/1441] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:53:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:53:09.493899 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d435a-60ef-4472-ac8d-f092c88d6f1e None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:09.494430 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d435a-60ef-4472-ac8d-f092c88d6f1e None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:09.494430 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d435a-60ef-4472-ac8d-f092c88d6f1e None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:09.496219 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 713/1442] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jan 5 14:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:53:09.501667 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fba936-3ebf-4c60-852c-5250bc7088ab None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:09.502215 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fba936-3ebf-4c60-852c-5250bc7088ab None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:09.502215 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fba936-3ebf-4c60-852c-5250bc7088ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:09.520663 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-a0fba936-3ebf-4c60-852c-5250bc7088ab None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:53:09.521878 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-a0fba936-3ebf-4c60-852c-5250bc7088ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:53:09.529651 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 730/1443] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jan 5 14:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:53:09.678934 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d435a-60ef-4472-ac8d-f092c88d6f1e None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:53:09.693278 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d435a-60ef-4472-ac8d-f092c88d6f1e None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:53:09.698550 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23829a-1ceb-4f64-89c5-e340ab07fc63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:53:09.699162 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23829a-1ceb-4f64-89c5-e340ab07fc63 service nova] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:09.699440 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23829a-1ceb-4f64-89c5-e340ab07fc63 service nova] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:09.700279 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23829a-1ceb-4f64-89c5-e340ab07fc63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:09.708092 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23829a-1ceb-4f64-89c5-e340ab07fc63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:53:09.709699 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23829a-1ceb-4f64-89c5-e340ab07fc63 service nova] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:53:09.718676 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 714/1444] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:53:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:53:11.339141 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051e147-6451-4a40-a74c-f68f1f4726fc None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:11.339746 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051e147-6451-4a40-a74c-f68f1f4726fc None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:11.339746 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051e147-6451-4a40-a74c-f68f1f4726fc None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:11.341441 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 731/1445] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jan 5 14:53:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:53:11.346248 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a93397-95a6-421e-87bd-49922fae3974 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:11.346701 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a93397-95a6-421e-87bd-49922fae3974 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:11.346817 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a93397-95a6-421e-87bd-49922fae3974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:11.364697 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-68a93397-95a6-421e-87bd-49922fae3974 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:53:11.365924 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-68a93397-95a6-421e-87bd-49922fae3974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:53:11.374308 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 715/1446] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jan 5 14:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:53:11.534533 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051e147-6451-4a40-a74c-f68f1f4726fc None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:53:11.548904 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051e147-6451-4a40-a74c-f68f1f4726fc None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:53:11.554218 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399fad7e-6918-4d11-8749-a515df35f761 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:53:11.554839 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399fad7e-6918-4d11-8749-a515df35f761 service nova] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:11.555121 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399fad7e-6918-4d11-8749-a515df35f761 service nova] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:11.555397 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399fad7e-6918-4d11-8749-a515df35f761 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:11.564134 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399fad7e-6918-4d11-8749-a515df35f761 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:53:11.565756 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399fad7e-6918-4d11-8749-a515df35f761 service nova] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:53:11.574757 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 732/1447] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:53:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:53:13.126298 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e6681-3557-4801-a416-ed4bc89004bb None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:13.126817 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e6681-3557-4801-a416-ed4bc89004bb None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:13.126817 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e6681-3557-4801-a416-ed4bc89004bb None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:13.128530 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 716/1448] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jan 5 14:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:53:13.133326 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b33d3e-6625-495b-9682-21904892cdb7 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:13.133740 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b33d3e-6625-495b-9682-21904892cdb7 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:13.133876 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b33d3e-6625-495b-9682-21904892cdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:13.151395 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-25b33d3e-6625-495b-9682-21904892cdb7 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:53:13.152533 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-25b33d3e-6625-495b-9682-21904892cdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:53:13.160094 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 733/1449] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jan 5 14:53:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:53:13.316733 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e6681-3557-4801-a416-ed4bc89004bb None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:53:13.330843 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e6681-3557-4801-a416-ed4bc89004bb None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:53:13.336251 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b2517-8e5d-444a-9d60-dfc3d2f4155e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:53:13.336869 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b2517-8e5d-444a-9d60-dfc3d2f4155e service nova] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:13.337183 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b2517-8e5d-444a-9d60-dfc3d2f4155e service nova] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:13.337463 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b2517-8e5d-444a-9d60-dfc3d2f4155e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:13.345904 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b2517-8e5d-444a-9d60-dfc3d2f4155e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:53:13.347485 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b2517-8e5d-444a-9d60-dfc3d2f4155e service nova] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:53:13.357242 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 717/1450] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:53:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:53:14.924564 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39defdda-f9ec-4b65-984a-010ec1dbff12 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:14.925043 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39defdda-f9ec-4b65-984a-010ec1dbff12 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:14.925182 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39defdda-f9ec-4b65-984a-010ec1dbff12 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:14.926903 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 734/1451] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jan 5 14:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:53:14.931738 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402484b-2436-4a80-a36b-3aa660c7064f None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:14.932175 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402484b-2436-4a80-a36b-3aa660c7064f None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:14.932285 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402484b-2436-4a80-a36b-3aa660c7064f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:14.951140 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-2402484b-2436-4a80-a36b-3aa660c7064f None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:53:14.952327 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-2402484b-2436-4a80-a36b-3aa660c7064f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:53:14.960012 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 718/1452] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jan 5 14:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:53:15.109171 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39defdda-f9ec-4b65-984a-010ec1dbff12 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:53:15.123875 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39defdda-f9ec-4b65-984a-010ec1dbff12 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:53:15.129198 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780cb57e-8e68-4b63-9025-430c48509b18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:53:15.129925 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cb57e-8e68-4b63-9025-430c48509b18 service nova] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:15.130209 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cb57e-8e68-4b63-9025-430c48509b18 service nova] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:15.130482 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cb57e-8e68-4b63-9025-430c48509b18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:15.138837 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780cb57e-8e68-4b63-9025-430c48509b18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:53:15.140395 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780cb57e-8e68-4b63-9025-430c48509b18 service nova] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:53:15.149391 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 735/1453] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:53:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:53:17.429309 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fb00e-0c30-4ee7-969b-683b662e141e None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:17.429848 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fb00e-0c30-4ee7-969b-683b662e141e None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:17.429965 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fb00e-0c30-4ee7-969b-683b662e141e None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:17.431753 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 719/1454] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jan 5 14:53:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:53:17.438953 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3612f-9b78-417c-b3f3-0dd6f8d37662 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:17.439396 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3612f-9b78-417c-b3f3-0dd6f8d37662 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:17.439515 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3612f-9b78-417c-b3f3-0dd6f8d37662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:17.457621 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-6da3612f-9b78-417c-b3f3-0dd6f8d37662 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:53:17.458812 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-6da3612f-9b78-417c-b3f3-0dd6f8d37662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:53:17.467319 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 736/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jan 5 14:53:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:53:17.505707 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1fb00e-0c30-4ee7-969b-683b662e141e None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:53:17.516679 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1fb00e-0c30-4ee7-969b-683b662e141e None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:53:17.520221 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624f204-d695-49a9-9d19-64e1339f094e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:53:17.520842 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624f204-d695-49a9-9d19-64e1339f094e service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:17.521157 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624f204-d695-49a9-9d19-64e1339f094e service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:17.521436 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624f204-d695-49a9-9d19-64e1339f094e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:17.534355 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624f204-d695-49a9-9d19-64e1339f094e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:53:17.535772 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624f204-d695-49a9-9d19-64e1339f094e service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:53:17.545607 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 720/1456] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:53:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:53:20.097913 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648307d-56fc-4bf3-a29e-f88dd08d62ea None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:20.098552 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648307d-56fc-4bf3-a29e-f88dd08d62ea None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:20.098552 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648307d-56fc-4bf3-a29e-f88dd08d62ea None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:20.100318 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 737/1457] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jan 5 14:53:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 14:53:20.106018 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb68c2-dced-4534-a1b5-151bc7ad3a22 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:20.106463 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb68c2-dced-4534-a1b5-151bc7ad3a22 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:20.106577 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb68c2-dced-4534-a1b5-151bc7ad3a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:20.125302 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-17cb68c2-dced-4534-a1b5-151bc7ad3a22 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:53:20.133792 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-17cb68c2-dced-4534-a1b5-151bc7ad3a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:53:20.134174 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 721/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jan 5 14:53:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:53:20.173557 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648307d-56fc-4bf3-a29e-f88dd08d62ea None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:53:20.184788 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648307d-56fc-4bf3-a29e-f88dd08d62ea None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:53:20.188343 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02412be5-9e15-43d2-9431-dc80aeecad5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:53:20.188965 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02412be5-9e15-43d2-9431-dc80aeecad5a service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:20.189289 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02412be5-9e15-43d2-9431-dc80aeecad5a service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:20.189563 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02412be5-9e15-43d2-9431-dc80aeecad5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:20.198276 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02412be5-9e15-43d2-9431-dc80aeecad5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:53:20.200372 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02412be5-9e15-43d2-9431-dc80aeecad5a service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:53:20.209352 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 738/1459] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:53:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:53:23.051905 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c5db8-5bb1-480b-a90e-326444f347c2 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:23.052460 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c5db8-5bb1-480b-a90e-326444f347c2 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:23.052460 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c5db8-5bb1-480b-a90e-326444f347c2 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:23.054256 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 722/1460] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jan 5 14:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:53:23.061225 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bb18f-77cd-4f3f-9560-299f644bcc51 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:23.061688 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bb18f-77cd-4f3f-9560-299f644bcc51 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:23.061821 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bb18f-77cd-4f3f-9560-299f644bcc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:23.079915 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-694bb18f-77cd-4f3f-9560-299f644bcc51 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:53:23.081124 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-694bb18f-77cd-4f3f-9560-299f644bcc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:53:23.088765 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 739/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jan 5 14:53:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:53:23.127133 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c5db8-5bb1-480b-a90e-326444f347c2 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:53:23.138342 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c5db8-5bb1-480b-a90e-326444f347c2 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:53:23.141926 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110cea4-1b39-4993-8fbb-5330c8763c4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:53:23.142581 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110cea4-1b39-4993-8fbb-5330c8763c4d service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:23.142863 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110cea4-1b39-4993-8fbb-5330c8763c4d service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:23.143138 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110cea4-1b39-4993-8fbb-5330c8763c4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:23.151858 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110cea4-1b39-4993-8fbb-5330c8763c4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:53:23.153351 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110cea4-1b39-4993-8fbb-5330c8763c4d service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:53:23.162399 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 723/1462] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:53:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:53:25.690204 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b93455-9105-44c2-a95b-4576fb96b91f None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:25.690752 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b93455-9105-44c2-a95b-4576fb96b91f None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:25.690864 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b93455-9105-44c2-a95b-4576fb96b91f None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:25.692611 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 740/1463] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jan 5 14:53:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:53:25.699179 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2caf938-707a-4d5f-8c2b-7dd0fb2a0c4c None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:25.699599 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2caf938-707a-4d5f-8c2b-7dd0fb2a0c4c None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:25.699747 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2caf938-707a-4d5f-8c2b-7dd0fb2a0c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:25.718527 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-c2caf938-707a-4d5f-8c2b-7dd0fb2a0c4c None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:53:25.719722 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-c2caf938-707a-4d5f-8c2b-7dd0fb2a0c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:53:25.727816 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 724/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jan 5 14:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:53:25.766950 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b93455-9105-44c2-a95b-4576fb96b91f None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:53:25.777445 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b93455-9105-44c2-a95b-4576fb96b91f None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:53:25.780921 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277a877-6653-4bea-9465-345c9cdf0c59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:53:25.781572 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277a877-6653-4bea-9465-345c9cdf0c59 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:25.781855 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277a877-6653-4bea-9465-345c9cdf0c59 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:25.782128 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277a877-6653-4bea-9465-345c9cdf0c59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:25.790707 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277a877-6653-4bea-9465-345c9cdf0c59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:53:25.792135 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277a877-6653-4bea-9465-345c9cdf0c59 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:53:25.801696 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 741/1465] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:53:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:53:28.258836 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea531d-2d78-4e87-af11-c7c44e1e7c03 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:28.259389 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea531d-2d78-4e87-af11-c7c44e1e7c03 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:28.259389 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea531d-2d78-4e87-af11-c7c44e1e7c03 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:28.261171 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 725/1466] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jan 5 14:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:53:28.268162 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff33e4-23c0-4818-b860-db658e0fe83f None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:28.268570 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff33e4-23c0-4818-b860-db658e0fe83f None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:28.268765 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff33e4-23c0-4818-b860-db658e0fe83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:28.286100 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-c3ff33e4-23c0-4818-b860-db658e0fe83f None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:53:28.287269 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-c3ff33e4-23c0-4818-b860-db658e0fe83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:53:28.294843 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 742/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jan 5 14:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:53:28.333693 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea531d-2d78-4e87-af11-c7c44e1e7c03 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:53:28.344675 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea531d-2d78-4e87-af11-c7c44e1e7c03 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:53:28.348189 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec1e6e-2594-468a-9c63-18501a674d30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:53:28.348806 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec1e6e-2594-468a-9c63-18501a674d30 service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:28.349106 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec1e6e-2594-468a-9c63-18501a674d30 service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:28.349386 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec1e6e-2594-468a-9c63-18501a674d30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:28.358319 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec1e6e-2594-468a-9c63-18501a674d30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:53:28.359928 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec1e6e-2594-468a-9c63-18501a674d30 service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:53:28.369378 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 726/1468] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:53:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 14:53:30.874464 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514d704-5c53-4abc-ab72-2eaf19b2a672 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:30.874977 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514d704-5c53-4abc-ab72-2eaf19b2a672 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:30.875097 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514d704-5c53-4abc-ab72-2eaf19b2a672 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:30.877126 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 743/1469] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jan 5 14:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:53:30.883300 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca31ae-78e5-40d2-9ee6-03a6a6364a04 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:30.883730 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca31ae-78e5-40d2-9ee6-03a6a6364a04 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:30.883862 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca31ae-78e5-40d2-9ee6-03a6a6364a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:30.901940 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-f1ca31ae-78e5-40d2-9ee6-03a6a6364a04 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:53:30.903693 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-f1ca31ae-78e5-40d2-9ee6-03a6a6364a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:53:30.911428 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 727/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jan 5 14:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:53:30.948392 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514d704-5c53-4abc-ab72-2eaf19b2a672 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:53:30.959223 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514d704-5c53-4abc-ab72-2eaf19b2a672 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:53:30.962711 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a84f45-090e-46ed-9510-94bd37925adc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:53:30.963334 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a84f45-090e-46ed-9510-94bd37925adc service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:30.963615 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a84f45-090e-46ed-9510-94bd37925adc service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:30.963892 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a84f45-090e-46ed-9510-94bd37925adc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:30.973132 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a84f45-090e-46ed-9510-94bd37925adc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:53:30.974593 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a84f45-090e-46ed-9510-94bd37925adc service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:53:30.983576 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 744/1471] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:53:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:53:33.439867 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305cdd6-5239-4538-a66a-43b066b5d10a None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:33.440450 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305cdd6-5239-4538-a66a-43b066b5d10a None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:33.440450 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305cdd6-5239-4538-a66a-43b066b5d10a None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:33.442228 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 728/1472] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jan 5 14:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:53:33.448577 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870bb63-bf9a-416c-b8bc-18196cac9c80 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:33.449590 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870bb63-bf9a-416c-b8bc-18196cac9c80 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:33.449696 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870bb63-bf9a-416c-b8bc-18196cac9c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:33.468200 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-2870bb63-bf9a-416c-b8bc-18196cac9c80 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:53:33.469407 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-2870bb63-bf9a-416c-b8bc-18196cac9c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:53:33.476938 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 745/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jan 5 14:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:53:33.514820 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305cdd6-5239-4538-a66a-43b066b5d10a None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:53:33.525290 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305cdd6-5239-4538-a66a-43b066b5d10a None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:53:33.528834 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae911978-d21c-42e4-b526-fcfee0338b0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:53:33.529484 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae911978-d21c-42e4-b526-fcfee0338b0f service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:33.529779 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae911978-d21c-42e4-b526-fcfee0338b0f service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:33.530036 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae911978-d21c-42e4-b526-fcfee0338b0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:33.538747 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae911978-d21c-42e4-b526-fcfee0338b0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:53:33.540169 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae911978-d21c-42e4-b526-fcfee0338b0f service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:53:33.549377 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 729/1474] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:53:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:53:35.989811 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e9c73-c00e-4eeb-a6e0-e5ef217969a2 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:35.990378 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e9c73-c00e-4eeb-a6e0-e5ef217969a2 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:35.990378 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e9c73-c00e-4eeb-a6e0-e5ef217969a2 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:35.992093 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 746/1475] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jan 5 14:53:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:53:35.998601 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0fdb8-e24e-4f16-b7d7-e8f0236a7a64 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:35.998980 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0fdb8-e24e-4f16-b7d7-e8f0236a7a64 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:35.999189 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0fdb8-e24e-4f16-b7d7-e8f0236a7a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:36.016599 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-fcd0fdb8-e24e-4f16-b7d7-e8f0236a7a64 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:53:36.017817 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-fcd0fdb8-e24e-4f16-b7d7-e8f0236a7a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:53:36.025543 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 730/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jan 5 14:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:53:36.063993 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e9c73-c00e-4eeb-a6e0-e5ef217969a2 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:53:36.078044 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e9c73-c00e-4eeb-a6e0-e5ef217969a2 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:53:36.082338 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc828a-2e44-4725-aade-1763806c4a68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:53:36.083437 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc828a-2e44-4725-aade-1763806c4a68 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:36.083944 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc828a-2e44-4725-aade-1763806c4a68 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:36.084436 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc828a-2e44-4725-aade-1763806c4a68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:36.098035 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc828a-2e44-4725-aade-1763806c4a68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:53:36.100337 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc828a-2e44-4725-aade-1763806c4a68 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:53:36.112108 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 747/1477] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:53:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:53:38.514442 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a37841-0df4-456e-a37a-eeff7d8c47ce None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:38.514878 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a37841-0df4-456e-a37a-eeff7d8c47ce None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:38.515001 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a37841-0df4-456e-a37a-eeff7d8c47ce None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:38.516777 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 731/1478] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jan 5 14:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:53:38.523724 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e56dc-d52c-408c-b0a2-958b0eba3eef None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:38.524165 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e56dc-d52c-408c-b0a2-958b0eba3eef None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:38.524274 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e56dc-d52c-408c-b0a2-958b0eba3eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:38.542176 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-1b4e56dc-d52c-408c-b0a2-958b0eba3eef None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:53:38.543400 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-1b4e56dc-d52c-408c-b0a2-958b0eba3eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:53:38.551055 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 748/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jan 5 14:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:53:38.588104 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a37841-0df4-456e-a37a-eeff7d8c47ce None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:53:38.599671 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a37841-0df4-456e-a37a-eeff7d8c47ce None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:53:38.603349 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57796248-f911-4a64-9aed-49c7b465e57e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:53:38.603974 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57796248-f911-4a64-9aed-49c7b465e57e service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:38.604250 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57796248-f911-4a64-9aed-49c7b465e57e service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:38.604521 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57796248-f911-4a64-9aed-49c7b465e57e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:38.613386 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57796248-f911-4a64-9aed-49c7b465e57e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:53:38.615089 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57796248-f911-4a64-9aed-49c7b465e57e service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:53:38.624052 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 732/1480] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:53:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:53:41.013680 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff86d1-d581-4314-943a-ce5475c35a8c None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:41.014275 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff86d1-d581-4314-943a-ce5475c35a8c None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:41.014275 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff86d1-d581-4314-943a-ce5475c35a8c None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:41.016012 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 749/1481] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jan 5 14:53:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:53:41.022407 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf2e9f-7573-444a-a4a3-43d947548091 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:41.022821 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf2e9f-7573-444a-a4a3-43d947548091 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:41.022960 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf2e9f-7573-444a-a4a3-43d947548091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:41.041129 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-0ccf2e9f-7573-444a-a4a3-43d947548091 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:53:41.042933 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-0ccf2e9f-7573-444a-a4a3-43d947548091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:53:41.050675 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 733/1482] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jan 5 14:53:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:53:41.086463 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff86d1-d581-4314-943a-ce5475c35a8c None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:53:41.097256 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff86d1-d581-4314-943a-ce5475c35a8c None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:53:41.100694 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225b894-4db1-4c35-97c1-fdc8e131e93e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:53:41.101346 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225b894-4db1-4c35-97c1-fdc8e131e93e service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:41.101626 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225b894-4db1-4c35-97c1-fdc8e131e93e service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:41.101900 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225b894-4db1-4c35-97c1-fdc8e131e93e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:41.111187 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225b894-4db1-4c35-97c1-fdc8e131e93e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:53:41.112663 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225b894-4db1-4c35-97c1-fdc8e131e93e service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:53:41.122299 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 750/1483] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:53:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:53:58.517917 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0d5bb-742b-4036-a7e5-be5ab41ba3a3 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:58.518396 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0d5bb-742b-4036-a7e5-be5ab41ba3a3 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:58.518512 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0d5bb-742b-4036-a7e5-be5ab41ba3a3 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:58.520277 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 734/1484] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:53:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:53:58.526661 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef5f79-18fb-4c36-a235-c178b24af4fc None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:58.527106 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef5f79-18fb-4c36-a235-c178b24af4fc None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:58.527208 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef5f79-18fb-4c36-a235-c178b24af4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:58.544324 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-53ef5f79-18fb-4c36-a235-c178b24af4fc None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:53:58.545533 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-53ef5f79-18fb-4c36-a235-c178b24af4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:53:58.553575 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 751/1485] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:53:58.600654 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3ea37-0a83-4684-b9cd-82b31cf2784a None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:58.600944 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3ea37-0a83-4684-b9cd-82b31cf2784a None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:58.601258 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3ea37-0a83-4684-b9cd-82b31cf2784a None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:58.603089 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 735/1486] 10.222.0.30 () {54 vars in 962 bytes} [Wed Jan 5 14:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:53:58.608070 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dfa62-d18f-489f-85f3-9fe31a5a34ad None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:58.608357 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dfa62-d18f-489f-85f3-9fe31a5a34ad None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:58.608899 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dfa62-d18f-489f-85f3-9fe31a5a34ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:58.627729 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-b21dfa62-d18f-489f-85f3-9fe31a5a34ad None None] MFA Rules not processed for user `935ad716e4624c25bc34308f05eb1526`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:53:58.628916 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-b21dfa62-d18f-489f-85f3-9fe31a5a34ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:53:58.635388 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 752/1487] 10.222.0.30 () {58 vars in 1059 bytes} [Wed Jan 5 14:53:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:53:58.643286 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3ea37-0a83-4684-b9cd-82b31cf2784a None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:53:58.653751 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3ea37-0a83-4684-b9cd-82b31cf2784a None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:53:58.657310 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d90e08-6a34-480a-bbf1-cff34db4361e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935ad716e4624c25bc34308f05eb1526', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:53:58.660248 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d90e08-6a34-480a-bbf1-cff34db4361e service glance] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:53:58.660248 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d90e08-6a34-480a-bbf1-cff34db4361e service glance] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:53:58.660248 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d90e08-6a34-480a-bbf1-cff34db4361e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:53:58.668393 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d90e08-6a34-480a-bbf1-cff34db4361e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:53:58.669854 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d90e08-6a34-480a-bbf1-cff34db4361e service glance] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:53:58.678895 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 736/1488] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:53:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 14:54:01.146456 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf19b65-fe1d-410c-ae1c-12b1fabefc08 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:54:01.146984 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf19b65-fe1d-410c-ae1c-12b1fabefc08 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:54:01.146984 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf19b65-fe1d-410c-ae1c-12b1fabefc08 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:54:01.148759 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 753/1489] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:54:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:54:01.155784 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e7a2d-89ad-4554-ade4-54c61239c087 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:54:01.156200 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e7a2d-89ad-4554-ade4-54c61239c087 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:54:01.156339 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e7a2d-89ad-4554-ade4-54c61239c087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:54:01.173828 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-668e7a2d-89ad-4554-ade4-54c61239c087 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:54:01.175012 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-668e7a2d-89ad-4554-ade4-54c61239c087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:54:01.182711 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 737/1490] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:54:01.206790 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf19b65-fe1d-410c-ae1c-12b1fabefc08 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:54:01.220529 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf19b65-fe1d-410c-ae1c-12b1fabefc08 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:54:01.224899 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8e854-a408-44fc-80d1-9252b5bad36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:54:01.225560 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8e854-a408-44fc-80d1-9252b5bad36e admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:54:01.225836 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8e854-a408-44fc-80d1-9252b5bad36e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:54:01.226107 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8e854-a408-44fc-80d1-9252b5bad36e admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:54:01.226840 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8e854-a408-44fc-80d1-9252b5bad36e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:54:01.228673 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8e854-a408-44fc-80d1-9252b5bad36e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:54:01.242153 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 754/1491] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jan 5 14:54:01 2022] GET /identity/v3/projects => generated 2553 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:54:03.643748 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bc816-89d7-4c8a-867b-f6c5fc1db826 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:54:03.644293 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bc816-89d7-4c8a-867b-f6c5fc1db826 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:54:03.644293 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bc816-89d7-4c8a-867b-f6c5fc1db826 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:54:03.646088 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 738/1492] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:54:03.652886 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0369d8-a45a-4b78-a1fb-577586e85664 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:54:03.653324 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0369d8-a45a-4b78-a1fb-577586e85664 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:54:03.653488 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0369d8-a45a-4b78-a1fb-577586e85664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:54:03.671597 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-1d0369d8-a45a-4b78-a1fb-577586e85664 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:54:03.672768 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-1d0369d8-a45a-4b78-a1fb-577586e85664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:54:03.680389 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 755/1493] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:54:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:54:03.721490 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bc816-89d7-4c8a-867b-f6c5fc1db826 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:54:03.736059 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bc816-89d7-4c8a-867b-f6c5fc1db826 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:54:03.741598 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c63d7d-7c27-4606-8fad-e4ca6968e002 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:54:03.742211 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c63d7d-7c27-4606-8fad-e4ca6968e002 service nova] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:54:03.742491 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c63d7d-7c27-4606-8fad-e4ca6968e002 service nova] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:54:03.742765 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c63d7d-7c27-4606-8fad-e4ca6968e002 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:54:03.750925 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c63d7d-7c27-4606-8fad-e4ca6968e002 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:54:03.752772 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c63d7d-7c27-4606-8fad-e4ca6968e002 service nova] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:54:03.763117 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 739/1494] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:54:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:54:06.328243 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e2707-cbef-4ad4-8574-de2762951923 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:54:06.328815 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e2707-cbef-4ad4-8574-de2762951923 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:54:06.328815 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e2707-cbef-4ad4-8574-de2762951923 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:54:06.330639 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 756/1495] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:54:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:54:06.335892 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55268e7-b3fb-4d4a-bd69-ea57121090e7 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:54:06.336336 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55268e7-b3fb-4d4a-bd69-ea57121090e7 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:54:06.336487 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55268e7-b3fb-4d4a-bd69-ea57121090e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:54:06.354834 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-c55268e7-b3fb-4d4a-bd69-ea57121090e7 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:54:06.356006 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-c55268e7-b3fb-4d4a-bd69-ea57121090e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:54:06.364010 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 740/1496] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:54:06.402313 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e2707-cbef-4ad4-8574-de2762951923 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:54:06.413017 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e2707-cbef-4ad4-8574-de2762951923 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:54:06.416530 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50542756-3a24-42d7-817b-13550c8057be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:54:06.417190 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50542756-3a24-42d7-817b-13550c8057be service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:54:06.417475 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50542756-3a24-42d7-817b-13550c8057be service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:54:06.417779 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50542756-3a24-42d7-817b-13550c8057be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:54:06.432219 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50542756-3a24-42d7-817b-13550c8057be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:54:06.436937 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50542756-3a24-42d7-817b-13550c8057be service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:54:06.447657 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 757/1497] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:54:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:54:08.883532 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28976bba-5db1-437f-94b0-ee87e7b72e3a None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:54:08.884073 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28976bba-5db1-437f-94b0-ee87e7b72e3a None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:54:08.884073 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28976bba-5db1-437f-94b0-ee87e7b72e3a None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:54:08.885926 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 741/1498] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:54:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:54:08.891160 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3647f-1e02-41ee-b4fa-83ef31e6229a None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:54:08.891602 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3647f-1e02-41ee-b4fa-83ef31e6229a None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:54:08.891705 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3647f-1e02-41ee-b4fa-83ef31e6229a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:54:08.909612 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-3be3647f-1e02-41ee-b4fa-83ef31e6229a None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:54:08.910790 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-3be3647f-1e02-41ee-b4fa-83ef31e6229a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:54:08.919026 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 758/1499] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:54:08.957976 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28976bba-5db1-437f-94b0-ee87e7b72e3a None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:54:08.968959 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28976bba-5db1-437f-94b0-ee87e7b72e3a None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:54:08.972490 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01573e-3bcb-4a7e-8131-3dab3ca47253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:54:08.973141 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01573e-3bcb-4a7e-8131-3dab3ca47253 service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:54:08.973435 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01573e-3bcb-4a7e-8131-3dab3ca47253 service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:54:08.973712 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01573e-3bcb-4a7e-8131-3dab3ca47253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:54:08.982934 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01573e-3bcb-4a7e-8131-3dab3ca47253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:54:08.984369 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01573e-3bcb-4a7e-8131-3dab3ca47253 service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:54:08.993669 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 742/1500] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:54:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:54:11.532230 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b10a8-9e1f-46e8-8a30-a7f2fe7c5cea None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:54:11.532701 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b10a8-9e1f-46e8-8a30-a7f2fe7c5cea None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:54:11.532810 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b10a8-9e1f-46e8-8a30-a7f2fe7c5cea None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:54:11.534642 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 759/1501] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:54:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:54:11.539912 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f065a9-d00b-459f-a45b-e046c1fdcdf4 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:54:11.540323 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f065a9-d00b-459f-a45b-e046c1fdcdf4 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:54:11.540462 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f065a9-d00b-459f-a45b-e046c1fdcdf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:54:11.558915 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-58f065a9-d00b-459f-a45b-e046c1fdcdf4 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:54:11.560087 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-58f065a9-d00b-459f-a45b-e046c1fdcdf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:54:11.568144 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 743/1502] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:54:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:54:11.604879 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b10a8-9e1f-46e8-8a30-a7f2fe7c5cea None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:54:11.617296 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b10a8-9e1f-46e8-8a30-a7f2fe7c5cea None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:54:11.622317 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fca8f-7d7f-482f-b165-ab9e18bc920d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:54:11.623151 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fca8f-7d7f-482f-b165-ab9e18bc920d admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:54:11.623431 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fca8f-7d7f-482f-b165-ab9e18bc920d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:54:11.623708 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fca8f-7d7f-482f-b165-ab9e18bc920d admin admin] PATH_INFO: `/v3/projects/df4f5a399f0847ef9e872ee655a1354c` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:54:11.624876 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5fca8f-7d7f-482f-b165-ab9e18bc920d admin admin] RBAC: Authorizing `identity:get_project(project_id=df4f5a399f0847ef9e872ee655a1354c)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:54:11.626697 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5fca8f-7d7f-482f-b165-ab9e18bc920d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:54:11.628312 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 760/1503] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:54:11 2022] GET /identity/v3/projects/df4f5a399f0847ef9e872ee655a1354c => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:54:11.639779 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f065a9-d00b-459f-a45b-e046c1fdcdf4 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:54:11.648882 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f065a9-d00b-459f-a45b-e046c1fdcdf4 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:54:11.652427 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc08180-7cc9-471a-b2b9-2c178db2c647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:54:11.653049 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc08180-7cc9-471a-b2b9-2c178db2c647 service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:54:11.653358 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc08180-7cc9-471a-b2b9-2c178db2c647 service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:54:11.653633 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc08180-7cc9-471a-b2b9-2c178db2c647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:54:11.662191 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc08180-7cc9-471a-b2b9-2c178db2c647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:54:11.663610 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc08180-7cc9-471a-b2b9-2c178db2c647 service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:54:11.673039 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 744/1504] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:54:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 14:54:14.426225 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd8c81-ad9a-46cb-969e-9f10d0b5e096 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:54:14.426827 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd8c81-ad9a-46cb-969e-9f10d0b5e096 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:54:14.426827 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd8c81-ad9a-46cb-969e-9f10d0b5e096 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:54:14.428596 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 761/1505] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jan 5 14:54:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:54:14.433922 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d871be-6b5c-4a84-b0fb-3637be200945 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:54:14.434341 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d871be-6b5c-4a84-b0fb-3637be200945 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:54:14.434480 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d871be-6b5c-4a84-b0fb-3637be200945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:54:14.452256 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-d4d871be-6b5c-4a84-b0fb-3637be200945 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:54:14.453476 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-d4d871be-6b5c-4a84-b0fb-3637be200945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:54:14.461204 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 745/1506] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jan 5 14:54:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:54:14.496939 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd8c81-ad9a-46cb-969e-9f10d0b5e096 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:54:14.509714 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd8c81-ad9a-46cb-969e-9f10d0b5e096 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:54:14.515082 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd113c-1161-48a2-ac63-3b91ff4150bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:54:14.515922 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd113c-1161-48a2-ac63-3b91ff4150bd admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:54:14.516200 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd113c-1161-48a2-ac63-3b91ff4150bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:54:14.516470 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd113c-1161-48a2-ac63-3b91ff4150bd admin admin] PATH_INFO: `/v3/projects/df4f5a399f0847ef9e872ee655a1354c` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:54:14.517676 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd113c-1161-48a2-ac63-3b91ff4150bd admin admin] RBAC: Authorizing `identity:get_project(project_id=df4f5a399f0847ef9e872ee655a1354c)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:54:14.519436 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd113c-1161-48a2-ac63-3b91ff4150bd admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:54:14.521175 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 762/1507] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jan 5 14:54:14 2022] GET /identity/v3/projects/df4f5a399f0847ef9e872ee655a1354c => generated 344 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:54:14.533266 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d871be-6b5c-4a84-b0fb-3637be200945 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:54:14.542526 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d871be-6b5c-4a84-b0fb-3637be200945 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:54:14.546046 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98994713-574c-47aa-b252-30c091b6651e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:54:14.546670 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98994713-574c-47aa-b252-30c091b6651e service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:54:14.546951 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98994713-574c-47aa-b252-30c091b6651e service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:54:14.547225 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98994713-574c-47aa-b252-30c091b6651e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:54:14.555858 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98994713-574c-47aa-b252-30c091b6651e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:54:14.557313 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98994713-574c-47aa-b252-30c091b6651e service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:54:14.566744 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 746/1508] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:54:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:55:56.080612 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32318bf9-ab7d-43fe-8183-969904236b72 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:55:56.081261 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32318bf9-ab7d-43fe-8183-969904236b72 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:55:56.081261 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32318bf9-ab7d-43fe-8183-969904236b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:55:56.099050 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-32318bf9-ab7d-43fe-8183-969904236b72 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:55:56.100194 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-32318bf9-ab7d-43fe-8183-969904236b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:55:56.108430 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 763/1509] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:55:56.117557 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3020933-fd91-4ce7-b104-bd25105f5818 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:55:56.118068 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3020933-fd91-4ce7-b104-bd25105f5818 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:55:56.118171 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3020933-fd91-4ce7-b104-bd25105f5818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:55:56.135408 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-c3020933-fd91-4ce7-b104-bd25105f5818 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:55:56.136577 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-c3020933-fd91-4ce7-b104-bd25105f5818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:55:56.144307 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 747/1510] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:55:56.149344 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32318bf9-ab7d-43fe-8183-969904236b72 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:55:56.158908 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32318bf9-ab7d-43fe-8183-969904236b72 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:55:56.164030 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12408c0-bef9-4afa-a1bc-ec4760e2e915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:55:56.164675 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12408c0-bef9-4afa-a1bc-ec4760e2e915 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:55:56.164957 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12408c0-bef9-4afa-a1bc-ec4760e2e915 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:55:56.165261 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12408c0-bef9-4afa-a1bc-ec4760e2e915 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:55:56.166026 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12408c0-bef9-4afa-a1bc-ec4760e2e915 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:55:56.166327 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12408c0-bef9-4afa-a1bc-ec4760e2e915 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:55:56.167906 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12408c0-bef9-4afa-a1bc-ec4760e2e915 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:55:56.178868 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 764/1511] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 14:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:55:56.186754 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3020933-fd91-4ce7-b104-bd25105f5818 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:55:56.195759 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3020933-fd91-4ce7-b104-bd25105f5818 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:55:56.200874 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18c51a-c10c-4ab2-b32a-d480efdde15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:55:56.201558 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18c51a-c10c-4ab2-b32a-d480efdde15c admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:55:56.201845 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18c51a-c10c-4ab2-b32a-d480efdde15c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:55:56.202125 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18c51a-c10c-4ab2-b32a-d480efdde15c admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:55:56.202826 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18c51a-c10c-4ab2-b32a-d480efdde15c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:55:56.204793 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18c51a-c10c-4ab2-b32a-d480efdde15c admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:55:56.341931 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 748/1512] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 14:55:56 2022] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:55:56.345834 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12408c0-bef9-4afa-a1bc-ec4760e2e915 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:55:56.356284 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12408c0-bef9-4afa-a1bc-ec4760e2e915 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:55:56.411548 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e52cf-c2d4-4c31-9d3c-6cfccf4ccb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:55:56.412211 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e52cf-c2d4-4c31-9d3c-6cfccf4ccb85 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:55:56.412497 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e52cf-c2d4-4c31-9d3c-6cfccf4ccb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:55:56.412774 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e52cf-c2d4-4c31-9d3c-6cfccf4ccb85 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:55:56.413521 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e52cf-c2d4-4c31-9d3c-6cfccf4ccb85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:55:56.415930 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e52cf-c2d4-4c31-9d3c-6cfccf4ccb85 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:55:56.506854 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 765/1513] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 14:55:56 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:55:56.510904 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18c51a-c10c-4ab2-b32a-d480efdde15c admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:55:56.520965 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18c51a-c10c-4ab2-b32a-d480efdde15c admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:55:56.525533 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d9dc6-2569-4ee5-9021-c10f43eb0a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:55:56.526182 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d9dc6-2569-4ee5-9021-c10f43eb0a37 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:55:56.526463 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d9dc6-2569-4ee5-9021-c10f43eb0a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:55:56.526737 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d9dc6-2569-4ee5-9021-c10f43eb0a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:55:56.527465 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d9dc6-2569-4ee5-9021-c10f43eb0a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:55:56.529128 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d9dc6-2569-4ee5-9021-c10f43eb0a37 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:55:56.542561 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 749/1514] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:55:56.546648 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e52cf-c2d4-4c31-9d3c-6cfccf4ccb85 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:55:56.557086 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e52cf-c2d4-4c31-9d3c-6cfccf4ccb85 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:55:56.561666 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06affeb0-c7a3-4d47-81fd-fdef62cd05cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:55:56.562420 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06affeb0-c7a3-4d47-81fd-fdef62cd05cb admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:55:56.562729 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06affeb0-c7a3-4d47-81fd-fdef62cd05cb admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:55:56.563004 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06affeb0-c7a3-4d47-81fd-fdef62cd05cb admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:55:56.563739 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06affeb0-c7a3-4d47-81fd-fdef62cd05cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:55:56.565355 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06affeb0-c7a3-4d47-81fd-fdef62cd05cb admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:55:56.578209 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 766/1515] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:55:56.582148 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d9dc6-2569-4ee5-9021-c10f43eb0a37 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:55:56.591639 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d9dc6-2569-4ee5-9021-c10f43eb0a37 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:55:56.596188 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6524caa-40d3-4008-ae28-8efc2fe4dd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:55:56.596987 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6524caa-40d3-4008-ae28-8efc2fe4dd88 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:55:56.597303 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6524caa-40d3-4008-ae28-8efc2fe4dd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:55:56.597581 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6524caa-40d3-4008-ae28-8efc2fe4dd88 admin admin] PATH_INFO: `/v3/projects/0b62a90c843e4378a0fdf44ad995b78e/users/274b0006a3cd4a778cc4a8398d24c329/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:55:56.612364 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6524caa-40d3-4008-ae28-8efc2fe4dd88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b62a90c843e4378a0fdf44ad995b78e, user_id=274b0006a3cd4a778cc4a8398d24c329, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:55:56.615113 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6524caa-40d3-4008-ae28-8efc2fe4dd88 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:55:56.709291 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 750/1516] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 14:55:56 2022] PUT /identity/v3/projects/0b62a90c843e4378a0fdf44ad995b78e/users/274b0006a3cd4a778cc4a8398d24c329/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:55:56.720857 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b61591-8343-47ce-b512-86b48e2ab7e5 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:55:56.722695 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b61591-8343-47ce-b512-86b48e2ab7e5 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:55:56.722695 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b61591-8343-47ce-b512-86b48e2ab7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:55:56.748133 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-f0b61591-8343-47ce-b512-86b48e2ab7e5 None None] MFA Rules not processed for user `274b0006a3cd4a778cc4a8398d24c329`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:55:56.751434 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-f0b61591-8343-47ce-b512-86b48e2ab7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:55:56.809015 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 767/1517] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:55:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:55:56.819930 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6524caa-40d3-4008-ae28-8efc2fe4dd88 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:55:56.887648 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6524caa-40d3-4008-ae28-8efc2fe4dd88 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:55:56.893127 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cecac3-7190-4e88-b73b-a38b6f6303a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:55:56.893769 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cecac3-7190-4e88-b73b-a38b6f6303a7 service nova] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:55:56.894052 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cecac3-7190-4e88-b73b-a38b6f6303a7 service nova] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:55:56.894503 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cecac3-7190-4e88-b73b-a38b6f6303a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:55:56.903287 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cecac3-7190-4e88-b73b-a38b6f6303a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:55:56.904869 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cecac3-7190-4e88-b73b-a38b6f6303a7 service nova] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:55:56.913399 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 751/1518] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:55:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:55:56.980147 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee757a-972a-4e0e-9049-a3ee73efaf6a None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:55:56.980438 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee757a-972a-4e0e-9049-a3ee73efaf6a None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:55:56.980715 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee757a-972a-4e0e-9049-a3ee73efaf6a None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:55:56.982438 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 768/1519] 10.222.0.30 () {52 vars in 829 bytes} [Wed Jan 5 14:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:55:56.986355 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cecac3-7190-4e88-b73b-a38b6f6303a7 service nova] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:55:57.044531 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cecac3-7190-4e88-b73b-a38b6f6303a7 service nova] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:55:57.049016 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f689c-8fa0-402f-9035-edb7cbd8c657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:55:57.049899 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f689c-8fa0-402f-9035-edb7cbd8c657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:55:57.050179 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f689c-8fa0-402f-9035-edb7cbd8c657 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:55:57.050451 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f689c-8fa0-402f-9035-edb7cbd8c657 admin admin] PATH_INFO: `/v3/users/274b0006a3cd4a778cc4a8398d24c329` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:55:57.051621 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f689c-8fa0-402f-9035-edb7cbd8c657 admin admin] RBAC: Authorizing `identity:delete_user(user_id=274b0006a3cd4a778cc4a8398d24c329)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:55:57.052644 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING py.warnings [None req-622f689c-8fa0-402f-9035-edb7cbd8c657 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:55:57.052644 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: warnings.warn(msg) Jan 05 14:55:57.052644 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: Jan 05 14:55:57.053912 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f689c-8fa0-402f-9035-edb7cbd8c657 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:55:57.272196 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-622f689c-8fa0-402f-9035-edb7cbd8c657 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '274b0006a3cd4a778cc4a8398d24c329'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:55:57.284553 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-622f689c-8fa0-402f-9035-edb7cbd8c657 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '274b0006a3cd4a778cc4a8398d24c329'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:55:57.285305 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-622f689c-8fa0-402f-9035-edb7cbd8c657 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '274b0006a3cd4a778cc4a8398d24c329'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:55:57.285908 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-622f689c-8fa0-402f-9035-edb7cbd8c657 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '274b0006a3cd4a778cc4a8398d24c329'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:55:57.377730 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-622f689c-8fa0-402f-9035-edb7cbd8c657 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '274b0006a3cd4a778cc4a8398d24c329'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:55:57.403396 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 752/1520] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 14:55:56 2022] DELETE /identity/v3/users/274b0006a3cd4a778cc4a8398d24c329 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:55:57.407926 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4406cd9-38dc-4bd8-8fd7-a33aed2ebc9b None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:55:57.408397 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4406cd9-38dc-4bd8-8fd7-a33aed2ebc9b None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:55:57.408518 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4406cd9-38dc-4bd8-8fd7-a33aed2ebc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:55:57.425394 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-b4406cd9-38dc-4bd8-8fd7-a33aed2ebc9b None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:55:57.426550 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-b4406cd9-38dc-4bd8-8fd7-a33aed2ebc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:55:57.482038 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 769/1521] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:55:57.491799 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f689c-8fa0-402f-9035-edb7cbd8c657 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:55:57.493272 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-622f689c-8fa0-402f-9035-edb7cbd8c657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:55:57.548268 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f689c-8fa0-402f-9035-edb7cbd8c657 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:55:57.551783 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4ae30-6f45-4644-9e70-90fa5f93cf77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:55:57.552416 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4ae30-6f45-4644-9e70-90fa5f93cf77 service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:55:57.552697 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4ae30-6f45-4644-9e70-90fa5f93cf77 service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:55:57.552971 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4ae30-6f45-4644-9e70-90fa5f93cf77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:55:57.562202 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4ae30-6f45-4644-9e70-90fa5f93cf77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:55:57.563637 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4ae30-6f45-4644-9e70-90fa5f93cf77 service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:55:57.573457 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 753/1522] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:55:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:55:58.022375 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4406cd9-38dc-4bd8-8fd7-a33aed2ebc9b None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:55:58.023975 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-b4406cd9-38dc-4bd8-8fd7-a33aed2ebc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:55:58.035604 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4406cd9-38dc-4bd8-8fd7-a33aed2ebc9b None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:55:58.040766 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3281c5-da10-4178-a6a5-1a5270650530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:55:58.041691 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3281c5-da10-4178-a6a5-1a5270650530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:55:58.041956 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3281c5-da10-4178-a6a5-1a5270650530 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:55:58.042226 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3281c5-da10-4178-a6a5-1a5270650530 admin admin] PATH_INFO: `/v3/projects/0b62a90c843e4378a0fdf44ad995b78e` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:55:58.043409 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3281c5-da10-4178-a6a5-1a5270650530 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b62a90c843e4378a0fdf44ad995b78e)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:55:58.044424 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING py.warnings [None req-3d3281c5-da10-4178-a6a5-1a5270650530 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:55:58.044424 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: warnings.warn(msg) Jan 05 14:55:58.044424 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: Jan 05 14:55:58.045641 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3281c5-da10-4178-a6a5-1a5270650530 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:55:58.167132 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-3d3281c5-da10-4178-a6a5-1a5270650530 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b62a90c843e4378a0fdf44ad995b78e', 'request_id': 'req-3d3281c5-da10-4178-a6a5-1a5270650530'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:55:58.179817 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-3d3281c5-da10-4178-a6a5-1a5270650530 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b62a90c843e4378a0fdf44ad995b78e', 'request_id': 'req-3d3281c5-da10-4178-a6a5-1a5270650530'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:55:58.186136 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-3d3281c5-da10-4178-a6a5-1a5270650530 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b62a90c843e4378a0fdf44ad995b78e', 'request_id': 'req-3d3281c5-da10-4178-a6a5-1a5270650530'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:55:58.280699 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-3d3281c5-da10-4178-a6a5-1a5270650530 admin admin] The token cache is being invalidate because project 0b62a90c843e4378a0fdf44ad995b78e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 14:55:58.280983 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-3d3281c5-da10-4178-a6a5-1a5270650530 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:55:58.281725 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-3d3281c5-da10-4178-a6a5-1a5270650530 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:55:58.283275 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 770/1523] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 14:55:58 2022] DELETE /identity/v3/projects/0b62a90c843e4378a0fdf44ad995b78e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:57:28.113483 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6ce59-0f04-4738-a3d9-12b4ab59fb24 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:57:28.114070 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6ce59-0f04-4738-a3d9-12b4ab59fb24 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:57:28.114070 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6ce59-0f04-4738-a3d9-12b4ab59fb24 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:57:28.115834 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 754/1524] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jan 5 14:57:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:57:28.121312 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20137637-1272-42d9-8943-39afa3587065 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:57:28.121757 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20137637-1272-42d9-8943-39afa3587065 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:57:28.121913 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20137637-1272-42d9-8943-39afa3587065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:57:28.142921 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-20137637-1272-42d9-8943-39afa3587065 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:57:28.144323 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-20137637-1272-42d9-8943-39afa3587065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:57:28.168785 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4e0b0-f8f4-4453-a602-2cbfa5825d33 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:57:28.169101 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4e0b0-f8f4-4453-a602-2cbfa5825d33 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:57:28.169382 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4e0b0-f8f4-4453-a602-2cbfa5825d33 None None] PATH_INFO: `/v3` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:57:28.170703 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 755/1525] 10.222.0.13 () {54 vars in 925 bytes} [Wed Jan 5 14:57:28 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 14:57:28.176703 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f73c4-72f1-4ab5-ad75-75dd7ad700c5 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:57:28.176992 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f73c4-72f1-4ab5-ad75-75dd7ad700c5 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:57:28.177367 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f73c4-72f1-4ab5-ad75-75dd7ad700c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:57:28.195322 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-e10f73c4-72f1-4ab5-ad75-75dd7ad700c5 None None] MFA Rules not processed for user `8847b97a7089420a8b8b817f3059c660`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:57:28.196547 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-e10f73c4-72f1-4ab5-ad75-75dd7ad700c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:57:28.201654 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 771/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jan 5 14:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:57:28.258140 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 756/1527] 10.222.0.13 () {58 vars in 1015 bytes} [Wed Jan 5 14:57:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:57:28.354672 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20137637-1272-42d9-8943-39afa3587065 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:57:28.356527 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-20137637-1272-42d9-8943-39afa3587065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:57:28.425333 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20137637-1272-42d9-8943-39afa3587065 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:57:28.430723 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30fa49-9fc8-4c7b-b87e-5f3ec34515b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:57:28.431357 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30fa49-9fc8-4c7b-b87e-5f3ec34515b7 service nova] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:57:28.431641 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30fa49-9fc8-4c7b-b87e-5f3ec34515b7 service nova] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:57:28.431918 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30fa49-9fc8-4c7b-b87e-5f3ec34515b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:57:28.440468 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad30fa49-9fc8-4c7b-b87e-5f3ec34515b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:57:28.442086 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad30fa49-9fc8-4c7b-b87e-5f3ec34515b7 service nova] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:57:28.451416 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 772/1528] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:57:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:57:29.996479 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116a04f-f6d2-407c-8ab7-fda6ca5b1498 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:57:29.997058 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116a04f-f6d2-407c-8ab7-fda6ca5b1498 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:57:29.997058 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116a04f-f6d2-407c-8ab7-fda6ca5b1498 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:57:29.998858 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 757/1529] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jan 5 14:57:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:57:30.003532 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3438ae-fcf9-47b0-acb7-18598ab9f2a1 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:57:30.003931 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3438ae-fcf9-47b0-acb7-18598ab9f2a1 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:57:30.004095 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3438ae-fcf9-47b0-acb7-18598ab9f2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:57:30.021576 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-ab3438ae-fcf9-47b0-acb7-18598ab9f2a1 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:57:30.022742 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-ab3438ae-fcf9-47b0-acb7-18598ab9f2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:57:30.031045 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 773/1530] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jan 5 14:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:57:30.184408 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116a04f-f6d2-407c-8ab7-fda6ca5b1498 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:57:30.198322 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116a04f-f6d2-407c-8ab7-fda6ca5b1498 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:57:30.203932 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc24da4-03e2-48ab-8e0b-7f6c26dc2d8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:57:30.204591 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc24da4-03e2-48ab-8e0b-7f6c26dc2d8f service nova] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:57:30.204871 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc24da4-03e2-48ab-8e0b-7f6c26dc2d8f service nova] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:57:30.205175 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc24da4-03e2-48ab-8e0b-7f6c26dc2d8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:57:30.213344 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc24da4-03e2-48ab-8e0b-7f6c26dc2d8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:57:30.216719 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc24da4-03e2-48ab-8e0b-7f6c26dc2d8f service nova] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:57:30.224545 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 758/1531] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:57:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:57:36.648998 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e904489-6d36-47d5-a202-2773d0e86fd3 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:57:36.649447 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e904489-6d36-47d5-a202-2773d0e86fd3 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:57:36.649627 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e904489-6d36-47d5-a202-2773d0e86fd3 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:57:36.651411 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 774/1532] 10.222.0.30 () {54 vars in 960 bytes} [Wed Jan 5 14:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:57:36.656830 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c8658-33aa-431a-a9e4-44061258f6ad None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:57:36.657270 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c8658-33aa-431a-a9e4-44061258f6ad None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:57:36.657421 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c8658-33aa-431a-a9e4-44061258f6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:57:36.675053 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-811c8658-33aa-431a-a9e4-44061258f6ad None None] MFA Rules not processed for user `8847b97a7089420a8b8b817f3059c660`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:57:36.676244 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-811c8658-33aa-431a-a9e4-44061258f6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:57:36.684518 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 759/1533] 10.222.0.30 () {58 vars in 1057 bytes} [Wed Jan 5 14:57:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:57:36.692126 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e904489-6d36-47d5-a202-2773d0e86fd3 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:57:36.705553 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e904489-6d36-47d5-a202-2773d0e86fd3 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:57:36.710460 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b5aa7-7412-479d-8427-20ab398d1408 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8847b97a7089420a8b8b817f3059c660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:57:36.712379 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b5aa7-7412-479d-8427-20ab398d1408 service placement] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:57:36.712379 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b5aa7-7412-479d-8427-20ab398d1408 service placement] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:57:36.712379 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b5aa7-7412-479d-8427-20ab398d1408 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:57:36.720040 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b5aa7-7412-479d-8427-20ab398d1408 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:57:36.721687 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b5aa7-7412-479d-8427-20ab398d1408 service placement] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:57:36.731050 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 775/1534] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:57:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:57:42.167598 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5717f9b-b488-45d2-bf8d-2d69cbe82ece None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:57:42.168146 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5717f9b-b488-45d2-bf8d-2d69cbe82ece None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:57:42.168244 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5717f9b-b488-45d2-bf8d-2d69cbe82ece None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:57:42.170025 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 760/1535] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jan 5 14:57:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:57:42.175544 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a2b0a-bc7e-4a3b-9658-258df7d145ce None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:57:42.175970 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a2b0a-bc7e-4a3b-9658-258df7d145ce None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:57:42.176098 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a2b0a-bc7e-4a3b-9658-258df7d145ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:57:42.193406 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-176a2b0a-bc7e-4a3b-9658-258df7d145ce None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:57:42.194561 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-176a2b0a-bc7e-4a3b-9658-258df7d145ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:57:42.202208 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 776/1536] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jan 5 14:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:57:42.362766 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5717f9b-b488-45d2-bf8d-2d69cbe82ece None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:57:42.377024 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5717f9b-b488-45d2-bf8d-2d69cbe82ece None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:57:42.382412 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537e97c-1aa0-4928-9d1f-54832e23d379 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:57:42.383041 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537e97c-1aa0-4928-9d1f-54832e23d379 service nova] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:57:42.383321 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537e97c-1aa0-4928-9d1f-54832e23d379 service nova] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:57:42.383602 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537e97c-1aa0-4928-9d1f-54832e23d379 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:57:42.392045 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537e97c-1aa0-4928-9d1f-54832e23d379 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:57:42.393685 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537e97c-1aa0-4928-9d1f-54832e23d379 service nova] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:57:42.402834 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 761/1537] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:57:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:57:43.960931 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e73ba-cf72-4401-b869-ff6452ded160 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:57:43.961534 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e73ba-cf72-4401-b869-ff6452ded160 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:57:43.961534 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e73ba-cf72-4401-b869-ff6452ded160 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:57:43.963321 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 777/1538] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jan 5 14:57:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:57:43.968628 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b263a-798c-4ad2-aaeb-957f09471034 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:57:43.969024 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b263a-798c-4ad2-aaeb-957f09471034 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:57:43.969235 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b263a-798c-4ad2-aaeb-957f09471034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:57:43.989055 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-3c1b263a-798c-4ad2-aaeb-957f09471034 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:57:43.990283 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-3c1b263a-798c-4ad2-aaeb-957f09471034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:57:43.998062 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 762/1539] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jan 5 14:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:57:44.151117 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e73ba-cf72-4401-b869-ff6452ded160 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:57:44.164853 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e73ba-cf72-4401-b869-ff6452ded160 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:57:44.170101 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0d1e4-0279-47fe-a26c-0dc0664e6809 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:57:44.170724 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0d1e4-0279-47fe-a26c-0dc0664e6809 service nova] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:57:44.171001 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0d1e4-0279-47fe-a26c-0dc0664e6809 service nova] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:57:44.171273 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0d1e4-0279-47fe-a26c-0dc0664e6809 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:57:44.179009 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0d1e4-0279-47fe-a26c-0dc0664e6809 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:57:44.180579 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0d1e4-0279-47fe-a26c-0dc0664e6809 service nova] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:57:44.190074 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 778/1540] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:57:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:57:48.634923 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0334f3-2868-45f6-95ed-060453b8223d None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:57:48.635469 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0334f3-2868-45f6-95ed-060453b8223d None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:57:48.635469 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0334f3-2868-45f6-95ed-060453b8223d None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:57:48.637272 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 763/1541] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jan 5 14:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:57:48.643159 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c8074-99ad-4afd-9db2-aedeecb6b47f None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:57:48.649336 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c8074-99ad-4afd-9db2-aedeecb6b47f None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:57:48.649336 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c8074-99ad-4afd-9db2-aedeecb6b47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:57:48.661707 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-633c8074-99ad-4afd-9db2-aedeecb6b47f None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:57:48.662899 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-633c8074-99ad-4afd-9db2-aedeecb6b47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:57:48.670958 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 779/1542] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jan 5 14:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:57:48.709619 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0334f3-2868-45f6-95ed-060453b8223d None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:57:48.711365 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-0d0334f3-2868-45f6-95ed-060453b8223d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:57:48.769399 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0334f3-2868-45f6-95ed-060453b8223d None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:57:48.772945 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a576515-fdaf-4da4-8a20-6881ecc1d4dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:57:48.773810 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a576515-fdaf-4da4-8a20-6881ecc1d4dc service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:57:48.774091 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a576515-fdaf-4da4-8a20-6881ecc1d4dc service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:57:48.774362 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a576515-fdaf-4da4-8a20-6881ecc1d4dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:57:48.783324 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a576515-fdaf-4da4-8a20-6881ecc1d4dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:57:48.784764 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a576515-fdaf-4da4-8a20-6881ecc1d4dc service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:57:48.794109 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 764/1543] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:57:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:57:51.168380 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f704b-611a-4f1e-90cb-8b1d79cab9f8 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:57:51.168903 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f704b-611a-4f1e-90cb-8b1d79cab9f8 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:57:51.168992 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f704b-611a-4f1e-90cb-8b1d79cab9f8 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:57:51.171350 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 780/1544] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jan 5 14:57:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:57:51.176431 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615abad-af35-4e95-b35b-bc0f001e5217 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:57:51.176849 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615abad-af35-4e95-b35b-bc0f001e5217 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:57:51.176986 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615abad-af35-4e95-b35b-bc0f001e5217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:57:51.194220 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-0615abad-af35-4e95-b35b-bc0f001e5217 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:57:51.195385 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-0615abad-af35-4e95-b35b-bc0f001e5217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:57:51.202946 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 765/1545] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jan 5 14:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:57:51.240348 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f704b-611a-4f1e-90cb-8b1d79cab9f8 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:57:51.250717 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f704b-611a-4f1e-90cb-8b1d79cab9f8 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:57:51.254224 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2516c-17ac-458d-ac28-fcf896480705 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:57:51.254786 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2516c-17ac-458d-ac28-fcf896480705 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:57:51.255067 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2516c-17ac-458d-ac28-fcf896480705 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:57:51.255340 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2516c-17ac-458d-ac28-fcf896480705 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:57:51.263903 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2516c-17ac-458d-ac28-fcf896480705 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:57:51.265916 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2516c-17ac-458d-ac28-fcf896480705 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:57:51.274895 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 781/1546] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:57:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:57:55.286852 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d148c7-bba1-48d4-ab19-9687a97c768f None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:57:55.287403 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d148c7-bba1-48d4-ab19-9687a97c768f None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:57:55.287403 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d148c7-bba1-48d4-ab19-9687a97c768f None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:57:55.289071 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 766/1547] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jan 5 14:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:57:55.294114 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8508f-1975-4ce6-aac4-87372572e6d4 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:57:55.294625 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8508f-1975-4ce6-aac4-87372572e6d4 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:57:55.294730 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8508f-1975-4ce6-aac4-87372572e6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:57:55.312044 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-4ee8508f-1975-4ce6-aac4-87372572e6d4 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:57:55.313244 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-4ee8508f-1975-4ce6-aac4-87372572e6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:57:55.320801 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 782/1548] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jan 5 14:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:57:55.371015 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d148c7-bba1-48d4-ab19-9687a97c768f None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:57:55.372671 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-69d148c7-bba1-48d4-ab19-9687a97c768f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:57:55.428227 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d148c7-bba1-48d4-ab19-9687a97c768f None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:57:55.431773 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98a2cb-e3ad-4d5b-a796-aa6e3086efd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:57:55.432399 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98a2cb-e3ad-4d5b-a796-aa6e3086efd4 service cinder] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:57:55.432682 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98a2cb-e3ad-4d5b-a796-aa6e3086efd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:57:55.432957 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98a2cb-e3ad-4d5b-a796-aa6e3086efd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:57:55.442176 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98a2cb-e3ad-4d5b-a796-aa6e3086efd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:57:55.443608 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98a2cb-e3ad-4d5b-a796-aa6e3086efd4 service cinder] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:57:55.453529 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 767/1549] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:57:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:57:57.826154 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed1488-a555-4d78-8313-ba3d26f54152 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:57:57.826713 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed1488-a555-4d78-8313-ba3d26f54152 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:57:57.826713 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed1488-a555-4d78-8313-ba3d26f54152 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:57:57.828408 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 783/1550] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jan 5 14:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:57:57.833504 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc641e2-f2bf-4543-9b65-a06b5d1df22c None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:57:57.833912 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc641e2-f2bf-4543-9b65-a06b5d1df22c None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:57:57.834058 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc641e2-f2bf-4543-9b65-a06b5d1df22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:57:57.851810 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-2fc641e2-f2bf-4543-9b65-a06b5d1df22c None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:57:57.852984 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-2fc641e2-f2bf-4543-9b65-a06b5d1df22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:57:57.861643 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 768/1551] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jan 5 14:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:57:57.911262 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f59345-8be0-44ea-aac7-05b00eac2aa0 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:57:57.911554 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f59345-8be0-44ea-aac7-05b00eac2aa0 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:57:57.911839 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f59345-8be0-44ea-aac7-05b00eac2aa0 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:57:57.913692 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 784/1552] 10.222.0.30 () {54 vars in 963 bytes} [Wed Jan 5 14:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:57:57.918887 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1849d0-eda3-4539-aa38-1b399e893449 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:57:57.925367 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1849d0-eda3-4539-aa38-1b399e893449 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:57:57.925367 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1849d0-eda3-4539-aa38-1b399e893449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:57:57.938922 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-2b1849d0-eda3-4539-aa38-1b399e893449 None None] MFA Rules not processed for user `541bd71b355d4b7ca35372e11be54be3`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:57:57.954034 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-2b1849d0-eda3-4539-aa38-1b399e893449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:57:57.954034 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 769/1553] 10.222.0.30 () {58 vars in 1060 bytes} [Wed Jan 5 14:57:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:57:57.954636 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f59345-8be0-44ea-aac7-05b00eac2aa0 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:57:57.965170 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f59345-8be0-44ea-aac7-05b00eac2aa0 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:57:57.969335 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d9cb6-5889-46a6-94fe-09eab830824c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:57:57.970103 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d9cb6-5889-46a6-94fe-09eab830824c service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:57:57.970346 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d9cb6-5889-46a6-94fe-09eab830824c service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:57:57.970624 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d9cb6-5889-46a6-94fe-09eab830824c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:57:57.979530 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d9cb6-5889-46a6-94fe-09eab830824c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:57:57.983602 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d9cb6-5889-46a6-94fe-09eab830824c service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:57:57.991577 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 785/1554] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:57:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:59:19.473050 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2909075-a9f6-4b36-aafc-2a137953ef98 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:19.479493 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838675b-dba5-4f1f-9120-28a87240d714 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:19.479493 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838675b-dba5-4f1f-9120-28a87240d714 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:19.480289 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2909075-a9f6-4b36-aafc-2a137953ef98 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:19.480374 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838675b-dba5-4f1f-9120-28a87240d714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:19.480463 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2909075-a9f6-4b36-aafc-2a137953ef98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:19.501706 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-b2909075-a9f6-4b36-aafc-2a137953ef98 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:19.502043 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-4838675b-dba5-4f1f-9120-28a87240d714 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:19.506549 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-b2909075-a9f6-4b36-aafc-2a137953ef98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:19.506748 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-4838675b-dba5-4f1f-9120-28a87240d714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:19.516820 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 770/1555] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:19.522529 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 786/1556] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:19.531468 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba4bab-c7e6-4506-87f2-29b0cc62bb0c None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:19.532368 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba4bab-c7e6-4506-87f2-29b0cc62bb0c None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:19.532368 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba4bab-c7e6-4506-87f2-29b0cc62bb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:19.532859 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe167fa-6eb5-4001-bbad-a6e2315367eb None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:19.533175 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe167fa-6eb5-4001-bbad-a6e2315367eb None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:19.533452 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe167fa-6eb5-4001-bbad-a6e2315367eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:19.557841 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-b9ba4bab-c7e6-4506-87f2-29b0cc62bb0c None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:19.561781 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-b9ba4bab-c7e6-4506-87f2-29b0cc62bb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:19.568703 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-bfe167fa-6eb5-4001-bbad-a6e2315367eb None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:19.570523 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-bfe167fa-6eb5-4001-bbad-a6e2315367eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:19.574818 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 771/1557] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:19.581116 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba4bab-c7e6-4506-87f2-29b0cc62bb0c None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:19.591607 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 787/1558] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:59:19.593199 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289dcb5-2829-4861-88e4-f08505e683ab None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:19.594196 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289dcb5-2829-4861-88e4-f08505e683ab None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:19.594629 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289dcb5-2829-4861-88e4-f08505e683ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:19.596324 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba4bab-c7e6-4506-87f2-29b0cc62bb0c None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:19.607776 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec203b-bd96-4d76-bac5-38c671d1021b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:19.608456 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec203b-bd96-4d76-bac5-38c671d1021b admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:19.608738 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec203b-bd96-4d76-bac5-38c671d1021b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:19.609139 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec203b-bd96-4d76-bac5-38c671d1021b admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:19.609845 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec203b-bd96-4d76-bac5-38c671d1021b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:59:19.611452 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec203b-bd96-4d76-bac5-38c671d1021b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:19.613334 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec203b-bd96-4d76-bac5-38c671d1021b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:19.634446 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-8289dcb5-2829-4861-88e4-f08505e683ab None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:19.636569 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-8289dcb5-2829-4861-88e4-f08505e683ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:19.639123 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 772/1559] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 14:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:59:19.639945 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec203b-bd96-4d76-bac5-38c671d1021b admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:19.655119 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 788/1560] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:19.656477 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4f588-1439-41fe-b6cd-42873e76ae2d None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:19.656764 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4f588-1439-41fe-b6cd-42873e76ae2d None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:19.657042 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4f588-1439-41fe-b6cd-42873e76ae2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:19.657589 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec203b-bd96-4d76-bac5-38c671d1021b admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:19.667366 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7e93f-35cf-48a7-b809-b3452070731d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:19.668232 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7e93f-35cf-48a7-b809-b3452070731d admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:19.668683 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7e93f-35cf-48a7-b809-b3452070731d admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:19.669236 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7e93f-35cf-48a7-b809-b3452070731d admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:19.670200 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d7e93f-35cf-48a7-b809-b3452070731d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:59:19.670732 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d7e93f-35cf-48a7-b809-b3452070731d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:19.673433 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d7e93f-35cf-48a7-b809-b3452070731d admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:19.681581 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-fbe4f588-1439-41fe-b6cd-42873e76ae2d None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:19.682781 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-fbe4f588-1439-41fe-b6cd-42873e76ae2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:19.687438 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 773/1561] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 14:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:59:19.689105 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27997332-f392-4b14-80a4-f7c5809a668d None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:19.689628 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27997332-f392-4b14-80a4-f7c5809a668d None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:19.690127 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27997332-f392-4b14-80a4-f7c5809a668d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:19.693713 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 789/1562] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:19.694434 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4f588-1439-41fe-b6cd-42873e76ae2d None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:19.707118 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4f588-1439-41fe-b6cd-42873e76ae2d None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:19.710047 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-27997332-f392-4b14-80a4-f7c5809a668d None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:19.711229 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-27997332-f392-4b14-80a4-f7c5809a668d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:19.711724 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41fa56f-08fb-4ea7-926c-81a59774cd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:19.712533 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fa56f-08fb-4ea7-926c-81a59774cd85 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:19.712822 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fa56f-08fb-4ea7-926c-81a59774cd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:19.713122 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fa56f-08fb-4ea7-926c-81a59774cd85 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:19.713820 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41fa56f-08fb-4ea7-926c-81a59774cd85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:19.715750 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41fa56f-08fb-4ea7-926c-81a59774cd85 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:19.719161 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 774/1563] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:19.720558 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377aeb7d-b0f7-41dd-8758-9de7e1bee5c1 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:19.720847 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377aeb7d-b0f7-41dd-8758-9de7e1bee5c1 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:19.721154 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377aeb7d-b0f7-41dd-8758-9de7e1bee5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:19.746386 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-377aeb7d-b0f7-41dd-8758-9de7e1bee5c1 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:19.746386 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-377aeb7d-b0f7-41dd-8758-9de7e1bee5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:19.749263 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 775/1564] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:19.751102 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9ca8b-7834-4df9-98f6-9090aae47f88 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:19.751384 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9ca8b-7834-4df9-98f6-9090aae47f88 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:19.751684 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9ca8b-7834-4df9-98f6-9090aae47f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:19.768455 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-9fc9ca8b-7834-4df9-98f6-9090aae47f88 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:19.769611 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-9fc9ca8b-7834-4df9-98f6-9090aae47f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:19.777210 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 776/1565] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:19.778339 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac0826-c440-44ad-89ea-50d44affb06b None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:19.778623 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac0826-c440-44ad-89ea-50d44affb06b None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:19.778896 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac0826-c440-44ad-89ea-50d44affb06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:19.795668 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-5dac0826-c440-44ad-89ea-50d44affb06b None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:19.797396 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-5dac0826-c440-44ad-89ea-50d44affb06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:19.804961 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 777/1566] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:19.805753 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac0826-c440-44ad-89ea-50d44affb06b None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:19.814996 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac0826-c440-44ad-89ea-50d44affb06b None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:19.819568 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c45ed-db9a-4bf7-82f5-845049b452b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:19.820195 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c45ed-db9a-4bf7-82f5-845049b452b7 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:19.820477 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c45ed-db9a-4bf7-82f5-845049b452b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:19.820755 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c45ed-db9a-4bf7-82f5-845049b452b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:19.821481 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c45ed-db9a-4bf7-82f5-845049b452b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:19.823375 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c45ed-db9a-4bf7-82f5-845049b452b7 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:19.825590 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 790/1567] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 14:59:19 2022] POST /identity/v3/projects => generated 371 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:19.829225 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68967931-023f-42d3-814a-b8d111ef138b None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:19.829225 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68967931-023f-42d3-814a-b8d111ef138b None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:19.829225 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68967931-023f-42d3-814a-b8d111ef138b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:19.844015 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-68967931-023f-42d3-814a-b8d111ef138b None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:19.845244 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-68967931-023f-42d3-814a-b8d111ef138b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:19.900904 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 791/1568] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:19.902343 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99397423-d4b7-45fa-8029-fbc544c97df2 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:19.907103 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99397423-d4b7-45fa-8029-fbc544c97df2 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:19.907103 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99397423-d4b7-45fa-8029-fbc544c97df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:19.913248 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 778/1569] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 14:59:19 2022] POST /identity/v3/projects => generated 393 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:19.914737 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b7e0f-18ff-449b-b70b-83a58e06dfb7 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:19.915028 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b7e0f-18ff-449b-b70b-83a58e06dfb7 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:19.915342 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b7e0f-18ff-449b-b70b-83a58e06dfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:19.920508 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-99397423-d4b7-45fa-8029-fbc544c97df2 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:19.922288 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-99397423-d4b7-45fa-8029-fbc544c97df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:19.933023 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-488b7e0f-18ff-449b-b70b-83a58e06dfb7 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:19.934216 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-488b7e0f-18ff-449b-b70b-83a58e06dfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:19.980604 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 792/1570] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:19.981457 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99397423-d4b7-45fa-8029-fbc544c97df2 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:19.990743 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99397423-d4b7-45fa-8029-fbc544c97df2 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:19.996620 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 779/1571] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:19.996620 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea83266-b85b-498a-b7de-8166ef4a4915 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:19.996620 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea83266-b85b-498a-b7de-8166ef4a4915 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:19.996620 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea83266-b85b-498a-b7de-8166ef4a4915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:19.996971 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e75f04-d035-4161-af04-0c29854809c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:19.996971 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e75f04-d035-4161-af04-0c29854809c2 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:19.996971 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e75f04-d035-4161-af04-0c29854809c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:19.996971 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e75f04-d035-4161-af04-0c29854809c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:19.997332 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e75f04-d035-4161-af04-0c29854809c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:59:19.997536 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e75f04-d035-4161-af04-0c29854809c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:19.999083 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e75f04-d035-4161-af04-0c29854809c2 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:20.017948 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 793/1572] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 14:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:59:20.017948 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d5978-355d-4cb6-acd5-ddf3be48bae2 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:20.017948 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d5978-355d-4cb6-acd5-ddf3be48bae2 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:20.017948 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d5978-355d-4cb6-acd5-ddf3be48bae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:20.018375 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-8ea83266-b85b-498a-b7de-8166ef4a4915 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:20.018375 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-8ea83266-b85b-498a-b7de-8166ef4a4915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:20.023059 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 780/1573] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:20.023059 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea83266-b85b-498a-b7de-8166ef4a4915 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:20.030196 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-967d5978-355d-4cb6-acd5-ddf3be48bae2 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:20.031876 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-967d5978-355d-4cb6-acd5-ddf3be48bae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:20.033403 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea83266-b85b-498a-b7de-8166ef4a4915 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:20.037845 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b16ba-9626-4fbc-aebe-fa09e60b372f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:20.038478 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b16ba-9626-4fbc-aebe-fa09e60b372f admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:20.038758 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b16ba-9626-4fbc-aebe-fa09e60b372f admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:20.039035 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b16ba-9626-4fbc-aebe-fa09e60b372f admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:20.039718 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b16ba-9626-4fbc-aebe-fa09e60b372f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:20.039828 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 794/1574] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:20.040498 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d5978-355d-4cb6-acd5-ddf3be48bae2 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:20.041656 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b16ba-9626-4fbc-aebe-fa09e60b372f admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:20.049985 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d5978-355d-4cb6-acd5-ddf3be48bae2 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:20.055152 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8e393-d19b-4382-b4c2-154a01d43d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:20.055813 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8e393-d19b-4382-b4c2-154a01d43d63 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:20.056093 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8e393-d19b-4382-b4c2-154a01d43d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:20.056392 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8e393-d19b-4382-b4c2-154a01d43d63 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:20.057163 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8e393-d19b-4382-b4c2-154a01d43d63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:59:20.057471 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8e393-d19b-4382-b4c2-154a01d43d63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:20.059059 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8e393-d19b-4382-b4c2-154a01d43d63 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:20.070893 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 795/1575] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 14:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:59:20.071642 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8e393-d19b-4382-b4c2-154a01d43d63 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:20.081007 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8e393-d19b-4382-b4c2-154a01d43d63 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:20.085619 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45999653-58e6-4e64-aff3-fa65258a5778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:20.086232 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45999653-58e6-4e64-aff3-fa65258a5778 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:20.086514 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45999653-58e6-4e64-aff3-fa65258a5778 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:20.086787 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45999653-58e6-4e64-aff3-fa65258a5778 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:20.087465 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45999653-58e6-4e64-aff3-fa65258a5778 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:20.089341 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45999653-58e6-4e64-aff3-fa65258a5778 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:20.117048 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 781/1576] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 14:59:20 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:20.118405 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e2628-b2a5-4bae-8000-45a36b50562e None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:20.118697 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e2628-b2a5-4bae-8000-45a36b50562e None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:20.118974 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e2628-b2a5-4bae-8000-45a36b50562e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:20.136100 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-075e2628-b2a5-4bae-8000-45a36b50562e None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:20.137318 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-075e2628-b2a5-4bae-8000-45a36b50562e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:20.145253 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 782/1577] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:20.146039 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e2628-b2a5-4bae-8000-45a36b50562e None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:20.155154 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e2628-b2a5-4bae-8000-45a36b50562e None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:20.160234 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd41a90-93c7-497b-97e1-a6216f0e6386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:20.163376 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd41a90-93c7-497b-97e1-a6216f0e6386 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:20.163376 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd41a90-93c7-497b-97e1-a6216f0e6386 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:20.163376 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd41a90-93c7-497b-97e1-a6216f0e6386 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:20.163376 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd41a90-93c7-497b-97e1-a6216f0e6386 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:59:20.163376 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd41a90-93c7-497b-97e1-a6216f0e6386 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:20.163984 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd41a90-93c7-497b-97e1-a6216f0e6386 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:20.175647 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 783/1578] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 14:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:59:20.176373 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd41a90-93c7-497b-97e1-a6216f0e6386 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:20.185583 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd41a90-93c7-497b-97e1-a6216f0e6386 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:20.189750 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 796/1579] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 14:59:20 2022] POST /identity/v3/users => generated 297 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:20.189868 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45999653-58e6-4e64-aff3-fa65258a5778 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:20.190576 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03074248-18f4-42f5-a778-4ac2e3e4c967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:20.191202 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03074248-18f4-42f5-a778-4ac2e3e4c967 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:20.191483 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03074248-18f4-42f5-a778-4ac2e3e4c967 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:20.191765 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03074248-18f4-42f5-a778-4ac2e3e4c967 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:20.192452 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03074248-18f4-42f5-a778-4ac2e3e4c967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:20.194351 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03074248-18f4-42f5-a778-4ac2e3e4c967 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:20.201153 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45999653-58e6-4e64-aff3-fa65258a5778 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:20.206109 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91cf0b-ee63-4a8a-8b6e-5c5d78dda252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:20.206751 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91cf0b-ee63-4a8a-8b6e-5c5d78dda252 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:20.207033 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91cf0b-ee63-4a8a-8b6e-5c5d78dda252 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:20.207309 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91cf0b-ee63-4a8a-8b6e-5c5d78dda252 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:20.208035 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91cf0b-ee63-4a8a-8b6e-5c5d78dda252 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:59:20.208367 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91cf0b-ee63-4a8a-8b6e-5c5d78dda252 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:20.210000 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91cf0b-ee63-4a8a-8b6e-5c5d78dda252 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:20.222075 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 797/1580] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 14:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:59:20.222909 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91cf0b-ee63-4a8a-8b6e-5c5d78dda252 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:20.232270 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91cf0b-ee63-4a8a-8b6e-5c5d78dda252 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:20.237516 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927f0fa-efeb-4da7-bfe7-20025a9fbece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:20.238124 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927f0fa-efeb-4da7-bfe7-20025a9fbece admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:20.238404 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927f0fa-efeb-4da7-bfe7-20025a9fbece admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:20.238675 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927f0fa-efeb-4da7-bfe7-20025a9fbece admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:20.239377 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927f0fa-efeb-4da7-bfe7-20025a9fbece admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:59:20.239676 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927f0fa-efeb-4da7-bfe7-20025a9fbece admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:20.241316 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927f0fa-efeb-4da7-bfe7-20025a9fbece admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:20.252204 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 798/1581] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 14:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:59:20.252933 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927f0fa-efeb-4da7-bfe7-20025a9fbece admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:20.262229 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927f0fa-efeb-4da7-bfe7-20025a9fbece admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:20.266842 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723060d0-bf44-4548-b07d-7b1309d7ad2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:20.267444 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723060d0-bf44-4548-b07d-7b1309d7ad2a admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:20.267726 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723060d0-bf44-4548-b07d-7b1309d7ad2a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:20.268004 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723060d0-bf44-4548-b07d-7b1309d7ad2a admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:20.268681 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723060d0-bf44-4548-b07d-7b1309d7ad2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:20.270591 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723060d0-bf44-4548-b07d-7b1309d7ad2a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:20.273144 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 784/1582] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 14:59:20 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:20.273939 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03074248-18f4-42f5-a778-4ac2e3e4c967 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:20.333333 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03074248-18f4-42f5-a778-4ac2e3e4c967 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:20.338009 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e41e6-1fe5-46f6-bc38-f46273c10ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:20.338665 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e41e6-1fe5-46f6-bc38-f46273c10ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:20.338952 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e41e6-1fe5-46f6-bc38-f46273c10ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:20.339234 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e41e6-1fe5-46f6-bc38-f46273c10ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:20.339967 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e41e6-1fe5-46f6-bc38-f46273c10ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:20.341737 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e41e6-1fe5-46f6-bc38-f46273c10ab6 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:20.352031 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 785/1583] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:20.357376 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e41e6-1fe5-46f6-bc38-f46273c10ab6 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:20.357501 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 799/1584] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 14:59:20 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:20.357501 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723060d0-bf44-4548-b07d-7b1309d7ad2a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:20.363169 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e41e6-1fe5-46f6-bc38-f46273c10ab6 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:20.417793 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723060d0-bf44-4548-b07d-7b1309d7ad2a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:20.418449 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63928fe6-f3aa-4570-a12c-98a259e5cf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:20.419044 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63928fe6-f3aa-4570-a12c-98a259e5cf28 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:20.419333 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63928fe6-f3aa-4570-a12c-98a259e5cf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:20.419613 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63928fe6-f3aa-4570-a12c-98a259e5cf28 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:20.420347 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63928fe6-f3aa-4570-a12c-98a259e5cf28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:59:20.420657 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63928fe6-f3aa-4570-a12c-98a259e5cf28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:20.422850 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63928fe6-f3aa-4570-a12c-98a259e5cf28 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:20.422960 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a1480-6cef-4bb6-a1d7-11b8cfc4d922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:20.423573 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a1480-6cef-4bb6-a1d7-11b8cfc4d922 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:20.423855 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a1480-6cef-4bb6-a1d7-11b8cfc4d922 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:20.424137 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a1480-6cef-4bb6-a1d7-11b8cfc4d922 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:20.424822 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a1480-6cef-4bb6-a1d7-11b8cfc4d922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:20.426755 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a1480-6cef-4bb6-a1d7-11b8cfc4d922 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:20.441792 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 786/1585] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 14:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:59:20.441792 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63928fe6-f3aa-4570-a12c-98a259e5cf28 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:20.450786 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63928fe6-f3aa-4570-a12c-98a259e5cf28 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:20.455429 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752c654-1d91-4390-a4d1-8a3717f0ce6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:20.456070 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752c654-1d91-4390-a4d1-8a3717f0ce6f admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:20.456354 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752c654-1d91-4390-a4d1-8a3717f0ce6f admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:20.456632 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752c654-1d91-4390-a4d1-8a3717f0ce6f admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:20.457391 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752c654-1d91-4390-a4d1-8a3717f0ce6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:20.458984 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752c654-1d91-4390-a4d1-8a3717f0ce6f admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:20.468504 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 787/1586] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:20.469271 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752c654-1d91-4390-a4d1-8a3717f0ce6f admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:20.478247 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752c654-1d91-4390-a4d1-8a3717f0ce6f admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:20.482990 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea617193-6a37-4e1d-88d5-ba23862c391a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:20.483578 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea617193-6a37-4e1d-88d5-ba23862c391a admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:20.483861 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea617193-6a37-4e1d-88d5-ba23862c391a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:20.484685 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea617193-6a37-4e1d-88d5-ba23862c391a admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:20.485398 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea617193-6a37-4e1d-88d5-ba23862c391a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:20.487218 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea617193-6a37-4e1d-88d5-ba23862c391a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:20.508405 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 800/1587] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 14:59:20 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:20.508405 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a1480-6cef-4bb6-a1d7-11b8cfc4d922 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:20.566280 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a1480-6cef-4bb6-a1d7-11b8cfc4d922 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:20.570922 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f56a9-9c38-438d-b13c-3ed826500b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:20.571576 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f56a9-9c38-438d-b13c-3ed826500b9d admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:20.571861 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f56a9-9c38-438d-b13c-3ed826500b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:20.572139 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f56a9-9c38-438d-b13c-3ed826500b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:20.572835 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f56a9-9c38-438d-b13c-3ed826500b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:20.574798 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f56a9-9c38-438d-b13c-3ed826500b9d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:20.578615 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 788/1588] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 14:59:20 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:20.579487 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea617193-6a37-4e1d-88d5-ba23862c391a admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:20.637853 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea617193-6a37-4e1d-88d5-ba23862c391a admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:20.643127 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697ed2d-8556-4502-9412-107625b12996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:20.643785 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697ed2d-8556-4502-9412-107625b12996 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:20.650085 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697ed2d-8556-4502-9412-107625b12996 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:20.650085 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697ed2d-8556-4502-9412-107625b12996 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:20.650085 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697ed2d-8556-4502-9412-107625b12996 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:20.650085 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697ed2d-8556-4502-9412-107625b12996 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:20.676212 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 801/1589] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 14:59:20 2022] POST /identity/v3/projects => generated 387 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:20.676905 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f56a9-9c38-438d-b13c-3ed826500b9d admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:20.735439 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f56a9-9c38-438d-b13c-3ed826500b9d admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:20.740043 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8398cd-c467-4dcc-b0ca-43591fa36a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:20.740702 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8398cd-c467-4dcc-b0ca-43591fa36a87 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:20.740986 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8398cd-c467-4dcc-b0ca-43591fa36a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:20.741295 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8398cd-c467-4dcc-b0ca-43591fa36a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:20.742137 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8398cd-c467-4dcc-b0ca-43591fa36a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:20.743766 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8398cd-c467-4dcc-b0ca-43591fa36a87 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:20.753916 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 802/1590] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:20.754672 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8398cd-c467-4dcc-b0ca-43591fa36a87 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:20.762791 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 789/1591] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 14:59:20 2022] POST /identity/v3/users => generated 283 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:20.763403 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697ed2d-8556-4502-9412-107625b12996 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:20.765653 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8398cd-c467-4dcc-b0ca-43591fa36a87 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:20.770093 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b54415-da3d-413a-bc83-15aa44995975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:20.770747 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b54415-da3d-413a-bc83-15aa44995975 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:20.771027 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b54415-da3d-413a-bc83-15aa44995975 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:20.771301 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b54415-da3d-413a-bc83-15aa44995975 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:20.771985 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b54415-da3d-413a-bc83-15aa44995975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:20.772843 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697ed2d-8556-4502-9412-107625b12996 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:20.774020 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b54415-da3d-413a-bc83-15aa44995975 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:20.777442 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a899fd-1d22-4386-b26a-366605e4a8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:20.778157 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a899fd-1d22-4386-b26a-366605e4a8d7 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:20.778446 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a899fd-1d22-4386-b26a-366605e4a8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:20.778729 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a899fd-1d22-4386-b26a-366605e4a8d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:20.779423 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a899fd-1d22-4386-b26a-366605e4a8d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:20.781882 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a899fd-1d22-4386-b26a-366605e4a8d7 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:20.860200 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 803/1592] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 14:59:20 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:20.861105 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b54415-da3d-413a-bc83-15aa44995975 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:20.870505 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b54415-da3d-413a-bc83-15aa44995975 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:20.872595 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 790/1593] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 14:59:20 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:20.873527 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a899fd-1d22-4386-b26a-366605e4a8d7 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:20.924891 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5e6e4-65a3-4edd-b8cd-e7ddca074e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:20.925586 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5e6e4-65a3-4edd-b8cd-e7ddca074e63 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:20.925871 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5e6e4-65a3-4edd-b8cd-e7ddca074e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:20.926149 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5e6e4-65a3-4edd-b8cd-e7ddca074e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:20.926935 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5e6e4-65a3-4edd-b8cd-e7ddca074e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:20.928536 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5e6e4-65a3-4edd-b8cd-e7ddca074e63 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:20.934223 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a899fd-1d22-4386-b26a-366605e4a8d7 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:20.938306 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 804/1594] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:20.939085 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5e6e4-65a3-4edd-b8cd-e7ddca074e63 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:20.939213 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b5f46-5ad6-458f-9f87-0e00bad8ff6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:20.939828 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b5f46-5ad6-458f-9f87-0e00bad8ff6d admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:20.940116 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b5f46-5ad6-458f-9f87-0e00bad8ff6d admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:20.940393 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b5f46-5ad6-458f-9f87-0e00bad8ff6d admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:20.941113 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b5f46-5ad6-458f-9f87-0e00bad8ff6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:20.943194 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b5f46-5ad6-458f-9f87-0e00bad8ff6d admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:20.950502 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5e6e4-65a3-4edd-b8cd-e7ddca074e63 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:20.955477 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f3a9c-661f-48bd-9d29-8461d0790610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:20.956116 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f3a9c-661f-48bd-9d29-8461d0790610 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:20.956403 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f3a9c-661f-48bd-9d29-8461d0790610 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:20.956682 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f3a9c-661f-48bd-9d29-8461d0790610 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:20.957409 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f3a9c-661f-48bd-9d29-8461d0790610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:20.959297 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f3a9c-661f-48bd-9d29-8461d0790610 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:21.071602 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 791/1595] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 14:59:20 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:21.072880 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b5f46-5ad6-458f-9f87-0e00bad8ff6d admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:21.081659 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b5f46-5ad6-458f-9f87-0e00bad8ff6d admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:21.086376 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1b125-d396-4e40-95c4-457bcfba918d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:21.087003 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1b125-d396-4e40-95c4-457bcfba918d admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:21.087284 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1b125-d396-4e40-95c4-457bcfba918d admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:21.087560 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1b125-d396-4e40-95c4-457bcfba918d admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:21.088246 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1b125-d396-4e40-95c4-457bcfba918d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:21.090195 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1b125-d396-4e40-95c4-457bcfba918d admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:21.091852 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 805/1596] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 14:59:20 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:21.092644 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f3a9c-661f-48bd-9d29-8461d0790610 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:21.105220 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f3a9c-661f-48bd-9d29-8461d0790610 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:21.110543 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04198c8c-8f60-4927-81f7-b128e1c385c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:21.111439 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04198c8c-8f60-4927-81f7-b128e1c385c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:21.111701 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04198c8c-8f60-4927-81f7-b128e1c385c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:21.111973 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04198c8c-8f60-4927-81f7-b128e1c385c0 admin admin] PATH_INFO: `/v3/projects/e08383aa131642f0a2cb2ee9db59eac9/users/a12ac224ada4431bb7f5207afa6a0417/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:21.126159 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04198c8c-8f60-4927-81f7-b128e1c385c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e08383aa131642f0a2cb2ee9db59eac9, user_id=a12ac224ada4431bb7f5207afa6a0417, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:21.128805 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04198c8c-8f60-4927-81f7-b128e1c385c0 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:21.199844 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 792/1597] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 14:59:21 2022] POST /identity/v3/users => generated 294 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:21.199844 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1b125-d396-4e40-95c4-457bcfba918d admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:21.207738 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1b125-d396-4e40-95c4-457bcfba918d admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:21.212265 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f190d40-94e1-4144-bf8b-646cae54fb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:21.212906 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f190d40-94e1-4144-bf8b-646cae54fb55 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:21.213219 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f190d40-94e1-4144-bf8b-646cae54fb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:21.213503 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f190d40-94e1-4144-bf8b-646cae54fb55 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:21.214214 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f190d40-94e1-4144-bf8b-646cae54fb55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:21.215796 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f190d40-94e1-4144-bf8b-646cae54fb55 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:21.226681 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 793/1598] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:21.227588 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f190d40-94e1-4144-bf8b-646cae54fb55 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:21.231511 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 806/1599] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 14:59:21 2022] PUT /identity/v3/projects/e08383aa131642f0a2cb2ee9db59eac9/users/a12ac224ada4431bb7f5207afa6a0417/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:21.233771 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04198c8c-8f60-4927-81f7-b128e1c385c0 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:21.237850 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f190d40-94e1-4144-bf8b-646cae54fb55 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:21.291080 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04198c8c-8f60-4927-81f7-b128e1c385c0 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:21.292272 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b298f0c-aac2-4943-88a2-2fd1356f6be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:21.292960 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b298f0c-aac2-4943-88a2-2fd1356f6be7 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:21.293276 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b298f0c-aac2-4943-88a2-2fd1356f6be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:21.293563 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b298f0c-aac2-4943-88a2-2fd1356f6be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:21.294318 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b298f0c-aac2-4943-88a2-2fd1356f6be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:21.295934 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b298f0c-aac2-4943-88a2-2fd1356f6be7 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:21.296057 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9daa0-6d76-4361-9606-05798ee6b1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:21.296680 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9daa0-6d76-4361-9606-05798ee6b1cd admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:21.296959 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9daa0-6d76-4361-9606-05798ee6b1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:21.297298 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9daa0-6d76-4361-9606-05798ee6b1cd admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:21.298071 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9daa0-6d76-4361-9606-05798ee6b1cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:21.300047 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9daa0-6d76-4361-9606-05798ee6b1cd admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:21.305708 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 794/1600] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:21.306307 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b298f0c-aac2-4943-88a2-2fd1356f6be7 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:21.315452 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b298f0c-aac2-4943-88a2-2fd1356f6be7 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:21.320219 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23c6c5-5400-45eb-bf2e-d2cce5cc269f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:21.326102 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23c6c5-5400-45eb-bf2e-d2cce5cc269f admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:21.326102 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23c6c5-5400-45eb-bf2e-d2cce5cc269f admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:21.326102 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23c6c5-5400-45eb-bf2e-d2cce5cc269f admin admin] PATH_INFO: `/v3/projects/9c7d005c6e9e454fa506907144639917/users/4295ba06618a45988ebeb45a82230bb0/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:21.336056 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23c6c5-5400-45eb-bf2e-d2cce5cc269f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c7d005c6e9e454fa506907144639917, user_id=4295ba06618a45988ebeb45a82230bb0, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:21.338729 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23c6c5-5400-45eb-bf2e-d2cce5cc269f admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:21.425630 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 807/1601] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 14:59:21 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:21.426603 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9daa0-6d76-4361-9606-05798ee6b1cd admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:21.435805 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9daa0-6d76-4361-9606-05798ee6b1cd admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:21.440241 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15df75-3929-4723-a326-567dc4d9add5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:21.440899 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15df75-3929-4723-a326-567dc4d9add5 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:21.441214 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15df75-3929-4723-a326-567dc4d9add5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:21.441488 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15df75-3929-4723-a326-567dc4d9add5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:21.442205 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15df75-3929-4723-a326-567dc4d9add5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:21.443781 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15df75-3929-4723-a326-567dc4d9add5 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:21.453882 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 808/1602] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:21.454840 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15df75-3929-4723-a326-567dc4d9add5 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:21.454968 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 795/1603] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 14:59:21 2022] PUT /identity/v3/projects/9c7d005c6e9e454fa506907144639917/users/4295ba06618a45988ebeb45a82230bb0/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:21.455779 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23c6c5-5400-45eb-bf2e-d2cce5cc269f admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:21.467569 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15df75-3929-4723-a326-567dc4d9add5 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:21.517213 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23c6c5-5400-45eb-bf2e-d2cce5cc269f admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:21.521992 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06904f5-d314-4c17-ad8c-4db524f775a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:21.522218 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d4065-31c7-4077-b8e7-4a492a7738f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:21.522654 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06904f5-d314-4c17-ad8c-4db524f775a2 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:21.522771 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d4065-31c7-4077-b8e7-4a492a7738f7 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:21.522934 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d4065-31c7-4077-b8e7-4a492a7738f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:21.523036 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06904f5-d314-4c17-ad8c-4db524f775a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:21.523207 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06904f5-d314-4c17-ad8c-4db524f775a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:21.523301 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d4065-31c7-4077-b8e7-4a492a7738f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:21.523931 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d4065-31c7-4077-b8e7-4a492a7738f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:21.524038 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06904f5-d314-4c17-ad8c-4db524f775a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:21.525566 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d4065-31c7-4077-b8e7-4a492a7738f7 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:21.525727 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06904f5-d314-4c17-ad8c-4db524f775a2 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:21.537987 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 809/1604] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:21.538178 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 796/1605] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:21.538264 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d4065-31c7-4077-b8e7-4a492a7738f7 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:21.538347 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659fbfa-5d5d-47d2-9c5d-e71bfdc39fbf None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:21.538347 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659fbfa-5d5d-47d2-9c5d-e71bfdc39fbf None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:21.538347 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659fbfa-5d5d-47d2-9c5d-e71bfdc39fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:21.547406 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d4065-31c7-4077-b8e7-4a492a7738f7 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:21.551936 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb260479-fae1-4e62-8809-866502b66cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:21.552510 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb260479-fae1-4e62-8809-866502b66cdb admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:21.552788 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb260479-fae1-4e62-8809-866502b66cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:21.553081 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb260479-fae1-4e62-8809-866502b66cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:21.553825 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb260479-fae1-4e62-8809-866502b66cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:21.555392 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb260479-fae1-4e62-8809-866502b66cdb admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:21.561911 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-3659fbfa-5d5d-47d2-9c5d-e71bfdc39fbf None None] MFA Rules not processed for user `a12ac224ada4431bb7f5207afa6a0417`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:21.563604 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-3659fbfa-5d5d-47d2-9c5d-e71bfdc39fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:21.565369 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 810/1606] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:21.566196 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb260479-fae1-4e62-8809-866502b66cdb admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:21.576803 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb260479-fae1-4e62-8809-866502b66cdb admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:21.581450 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4f2ee-c0b2-4b69-8f0a-e93a3d15165c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:21.582094 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4f2ee-c0b2-4b69-8f0a-e93a3d15165c admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:21.582379 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4f2ee-c0b2-4b69-8f0a-e93a3d15165c admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:21.582660 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4f2ee-c0b2-4b69-8f0a-e93a3d15165c admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:21.583379 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4f2ee-c0b2-4b69-8f0a-e93a3d15165c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:21.584998 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4f2ee-c0b2-4b69-8f0a-e93a3d15165c admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:21.595820 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 811/1607] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:21.596428 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4f2ee-c0b2-4b69-8f0a-e93a3d15165c admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:21.605753 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4f2ee-c0b2-4b69-8f0a-e93a3d15165c admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:21.610977 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b40e50-272d-45e9-9923-febda8796492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:21.611611 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b40e50-272d-45e9-9923-febda8796492 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:21.611914 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b40e50-272d-45e9-9923-febda8796492 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:21.612187 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b40e50-272d-45e9-9923-febda8796492 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:21.612922 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b40e50-272d-45e9-9923-febda8796492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:21.614523 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b40e50-272d-45e9-9923-febda8796492 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:21.623725 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 812/1608] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:21.624481 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b40e50-272d-45e9-9923-febda8796492 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:21.628284 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 797/1609] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:21.629600 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c8560-f5cc-4bc8-b221-db4487774042 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:21.629895 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c8560-f5cc-4bc8-b221-db4487774042 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:21.630174 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c8560-f5cc-4bc8-b221-db4487774042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:21.639138 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b40e50-272d-45e9-9923-febda8796492 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:21.643868 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0cd5f-634c-48c4-94b2-74190ad83371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:21.644521 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0cd5f-634c-48c4-94b2-74190ad83371 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:21.644799 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0cd5f-634c-48c4-94b2-74190ad83371 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:21.645089 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0cd5f-634c-48c4-94b2-74190ad83371 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:21.645879 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0cd5f-634c-48c4-94b2-74190ad83371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:21.647015 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-3c1c8560-f5cc-4bc8-b221-db4487774042 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:21.647509 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0cd5f-634c-48c4-94b2-74190ad83371 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:21.648192 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-3c1c8560-f5cc-4bc8-b221-db4487774042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:21.659933 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 798/1610] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:21.659933 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c8560-f5cc-4bc8-b221-db4487774042 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:21.660204 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 813/1611] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:21.660204 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0cd5f-634c-48c4-94b2-74190ad83371 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:21.670054 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c8560-f5cc-4bc8-b221-db4487774042 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:21.674152 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0cd5f-634c-48c4-94b2-74190ad83371 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:21.675358 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84150ebc-4d41-4e53-93e1-e7af03e957d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:21.676013 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84150ebc-4d41-4e53-93e1-e7af03e957d7 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:21.676352 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84150ebc-4d41-4e53-93e1-e7af03e957d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:21.676566 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84150ebc-4d41-4e53-93e1-e7af03e957d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:21.677338 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84150ebc-4d41-4e53-93e1-e7af03e957d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:21.678732 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9a9d6-c23d-4666-b265-51fc77497fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:21.678929 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84150ebc-4d41-4e53-93e1-e7af03e957d7 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:21.679379 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9a9d6-c23d-4666-b265-51fc77497fea admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:21.679645 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9a9d6-c23d-4666-b265-51fc77497fea admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:21.679916 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9a9d6-c23d-4666-b265-51fc77497fea admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:21.680635 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9a9d6-c23d-4666-b265-51fc77497fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:21.682285 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9a9d6-c23d-4666-b265-51fc77497fea admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:21.688627 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 799/1612] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:21.689474 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84150ebc-4d41-4e53-93e1-e7af03e957d7 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:21.695437 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 814/1613] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:21.695437 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9a9d6-c23d-4666-b265-51fc77497fea admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:21.699531 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84150ebc-4d41-4e53-93e1-e7af03e957d7 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:21.702131 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9a9d6-c23d-4666-b265-51fc77497fea admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:21.704247 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa371d59-a505-42ba-9c5e-85020d6f8c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:21.705122 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa371d59-a505-42ba-9c5e-85020d6f8c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:21.705407 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa371d59-a505-42ba-9c5e-85020d6f8c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:21.705680 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa371d59-a505-42ba-9c5e-85020d6f8c89 admin admin] PATH_INFO: `/v3/projects/ea9610acf168459db6721420c43a17b4/users/3b20ad7c70664d418abfb770a85d8a4a/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:21.706802 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f2ecc-6d13-4bcf-801b-a18c62526e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:21.707666 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f2ecc-6d13-4bcf-801b-a18c62526e37 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:21.707949 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f2ecc-6d13-4bcf-801b-a18c62526e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:21.708224 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f2ecc-6d13-4bcf-801b-a18c62526e37 admin admin] PATH_INFO: `/v3/projects/fc623d81b10e491ab3a65d62b99bf7c7/users/c439b7ebe2d44b4ca60a269bd60520e8/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:21.720300 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa371d59-a505-42ba-9c5e-85020d6f8c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea9610acf168459db6721420c43a17b4, user_id=3b20ad7c70664d418abfb770a85d8a4a, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:21.722874 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f2ecc-6d13-4bcf-801b-a18c62526e37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc623d81b10e491ab3a65d62b99bf7c7, user_id=c439b7ebe2d44b4ca60a269bd60520e8, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:21.723018 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa371d59-a505-42ba-9c5e-85020d6f8c89 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:21.725563 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f2ecc-6d13-4bcf-801b-a18c62526e37 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:21.788228 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 800/1614] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 14:59:21 2022] PUT /identity/v3/projects/ea9610acf168459db6721420c43a17b4/users/3b20ad7c70664d418abfb770a85d8a4a/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:21.789016 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa371d59-a505-42ba-9c5e-85020d6f8c89 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:21.814203 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 815/1615] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 14:59:21 2022] PUT /identity/v3/projects/fc623d81b10e491ab3a65d62b99bf7c7/users/c439b7ebe2d44b4ca60a269bd60520e8/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:21.815461 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22c99b-bb13-4675-a499-08a9e04e501e None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:21.815748 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22c99b-bb13-4675-a499-08a9e04e501e None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:21.816025 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22c99b-bb13-4675-a499-08a9e04e501e None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:21.818098 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 816/1616] 10.222.0.30 () {54 vars in 961 bytes} [Wed Jan 5 14:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:59:21.818441 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22c99b-bb13-4675-a499-08a9e04e501e None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:21.848384 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa371d59-a505-42ba-9c5e-85020d6f8c89 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:21.879450 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22c99b-bb13-4675-a499-08a9e04e501e None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:21.884101 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7f01f-40c6-4919-bfa2-bbda9792b3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:21.884980 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7f01f-40c6-4919-bfa2-bbda9792b3f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:21.885295 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7f01f-40c6-4919-bfa2-bbda9792b3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:21.885570 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7f01f-40c6-4919-bfa2-bbda9792b3f6 admin admin] PATH_INFO: `/v3/projects/06f71d61e6814a3b828958a1728183ae/users/4c76d12d96674432b388fb4c1ed2492e/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:21.899873 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7f01f-40c6-4919-bfa2-bbda9792b3f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06f71d61e6814a3b828958a1728183ae, user_id=4c76d12d96674432b388fb4c1ed2492e, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:21.902675 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7f01f-40c6-4919-bfa2-bbda9792b3f6 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:21.904583 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d132e-0704-4631-90a7-5278cab5073d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:21.904583 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d132e-0704-4631-90a7-5278cab5073d admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:21.904583 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d132e-0704-4631-90a7-5278cab5073d admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:21.904583 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d132e-0704-4631-90a7-5278cab5073d admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:21.904913 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d132e-0704-4631-90a7-5278cab5073d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:21.907105 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d132e-0704-4631-90a7-5278cab5073d admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:21.916772 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 801/1617] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:21.917581 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d132e-0704-4631-90a7-5278cab5073d admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:21.968344 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d132e-0704-4631-90a7-5278cab5073d admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:21.973951 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af61a1f-a577-4414-bbde-ed4697dc9753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:21.974587 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af61a1f-a577-4414-bbde-ed4697dc9753 service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:21.974889 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af61a1f-a577-4414-bbde-ed4697dc9753 service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:21.975169 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af61a1f-a577-4414-bbde-ed4697dc9753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:21.984425 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af61a1f-a577-4414-bbde-ed4697dc9753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:21.992906 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af61a1f-a577-4414-bbde-ed4697dc9753 service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:21.994982 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 802/1618] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:59:21.995730 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af61a1f-a577-4414-bbde-ed4697dc9753 service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:22.004573 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af61a1f-a577-4414-bbde-ed4697dc9753 service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:22.009157 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b54ef-9c53-4c10-af3a-ebedb84436c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:22.010008 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b54ef-9c53-4c10-af3a-ebedb84436c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:22.010313 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b54ef-9c53-4c10-af3a-ebedb84436c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:22.010584 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b54ef-9c53-4c10-af3a-ebedb84436c2 admin admin] PATH_INFO: `/v3/projects/f4a45a70c5d046238abaad07fbe529e9/users/d43400b4646449ce94967ec5bab4eca1/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:22.025285 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b54ef-9c53-4c10-af3a-ebedb84436c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4a45a70c5d046238abaad07fbe529e9, user_id=d43400b4646449ce94967ec5bab4eca1, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:22.027951 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b54ef-9c53-4c10-af3a-ebedb84436c2 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:22.081014 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 817/1619] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 14:59:21 2022] PUT /identity/v3/projects/06f71d61e6814a3b828958a1728183ae/users/4c76d12d96674432b388fb4c1ed2492e/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:22.081777 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7f01f-40c6-4919-bfa2-bbda9792b3f6 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:22.148872 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7f01f-40c6-4919-bfa2-bbda9792b3f6 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:22.153671 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712bd99-a485-410b-b9d0-d44a9adb1f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:22.154556 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712bd99-a485-410b-b9d0-d44a9adb1f80 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:22.154839 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712bd99-a485-410b-b9d0-d44a9adb1f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:22.155118 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712bd99-a485-410b-b9d0-d44a9adb1f80 admin admin] PATH_INFO: `/v3/projects/6ace62f50516457cafc0b284bac70247/users/f8535ecec5054d4fad485bd2bcb800f5/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:22.162898 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 803/1620] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 14:59:21 2022] PUT /identity/v3/projects/f4a45a70c5d046238abaad07fbe529e9/users/d43400b4646449ce94967ec5bab4eca1/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:22.164492 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9a0eb-d9e6-4e66-919b-4a3ce86b5a5d None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:22.164723 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9a0eb-d9e6-4e66-919b-4a3ce86b5a5d None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:22.164964 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9a0eb-d9e6-4e66-919b-4a3ce86b5a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:22.172542 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712bd99-a485-410b-b9d0-d44a9adb1f80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ace62f50516457cafc0b284bac70247, user_id=f8535ecec5054d4fad485bd2bcb800f5, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:22.175247 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712bd99-a485-410b-b9d0-d44a9adb1f80 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:22.195689 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-c4a9a0eb-d9e6-4e66-919b-4a3ce86b5a5d None None] MFA Rules not processed for user `3b20ad7c70664d418abfb770a85d8a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:22.196924 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-c4a9a0eb-d9e6-4e66-919b-4a3ce86b5a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:22.260199 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 804/1621] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:22 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:22.261531 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb488b8-2fc9-44b5-9a06-ec906dfca99f None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:22.268219 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb488b8-2fc9-44b5-9a06-ec906dfca99f None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:22.268219 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb488b8-2fc9-44b5-9a06-ec906dfca99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:22.279343 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 818/1622] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 14:59:22 2022] PUT /identity/v3/projects/6ace62f50516457cafc0b284bac70247/users/f8535ecec5054d4fad485bd2bcb800f5/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:22.280921 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c55e4d-61ca-44f2-8c26-993e692f68ef None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:22.281240 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c55e4d-61ca-44f2-8c26-993e692f68ef None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:22.281519 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c55e4d-61ca-44f2-8c26-993e692f68ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:22.281687 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-1bb488b8-2fc9-44b5-9a06-ec906dfca99f None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:22.282876 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-1bb488b8-2fc9-44b5-9a06-ec906dfca99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:22.299025 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-84c55e4d-61ca-44f2-8c26-993e692f68ef None None] MFA Rules not processed for user `77db235e2f7046e4bdbad7f31b5e3ebc`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:22.300363 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-84c55e4d-61ca-44f2-8c26-993e692f68ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:22.340472 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 805/1623] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:22.341366 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb488b8-2fc9-44b5-9a06-ec906dfca99f None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:22.351395 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb488b8-2fc9-44b5-9a06-ec906dfca99f None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:22.356525 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b173e-3cb7-456a-9d1c-7aadce234bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:22.357438 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b173e-3cb7-456a-9d1c-7aadce234bb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:22.357719 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b173e-3cb7-456a-9d1c-7aadce234bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:22.357995 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b173e-3cb7-456a-9d1c-7aadce234bb2 admin admin] PATH_INFO: `/v3/projects/715006ffd8ba4e5b963511ec759ae152/users/2de1d8ec06134669a4db8ca248feceae/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:22.365538 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 819/1624] 10.222.0.30 () {58 vars in 1058 bytes} [Wed Jan 5 14:59:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:22.366726 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03eee7-93c8-43a5-ba9f-486180b7d580 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:22.366997 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03eee7-93c8-43a5-ba9f-486180b7d580 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:22.367283 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03eee7-93c8-43a5-ba9f-486180b7d580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:22.374365 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b173e-3cb7-456a-9d1c-7aadce234bb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=715006ffd8ba4e5b963511ec759ae152, user_id=2de1d8ec06134669a4db8ca248feceae, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:22.376939 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b173e-3cb7-456a-9d1c-7aadce234bb2 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:22.393978 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-0a03eee7-93c8-43a5-ba9f-486180b7d580 None None] MFA Rules not processed for user `4c76d12d96674432b388fb4c1ed2492e`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:22.395171 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-0a03eee7-93c8-43a5-ba9f-486180b7d580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:22.440327 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 806/1625] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 14:59:22 2022] PUT /identity/v3/projects/715006ffd8ba4e5b963511ec759ae152/users/2de1d8ec06134669a4db8ca248feceae/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:22.441451 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caac4d-f4b7-4ee0-abf3-2a91ada684e3 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:22.441744 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caac4d-f4b7-4ee0-abf3-2a91ada684e3 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:22.442021 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caac4d-f4b7-4ee0-abf3-2a91ada684e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:22.462143 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-28caac4d-f4b7-4ee0-abf3-2a91ada684e3 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:22.463536 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-28caac4d-f4b7-4ee0-abf3-2a91ada684e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:22.467765 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 820/1626] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:22.470080 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03eee7-93c8-43a5-ba9f-486180b7d580 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:22.527675 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03eee7-93c8-43a5-ba9f-486180b7d580 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:22.533756 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 807/1627] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:22.535205 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee73387-2eb6-415f-a733-0658f14e7b31 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:22.535653 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee73387-2eb6-415f-a733-0658f14e7b31 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:22.535994 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee73387-2eb6-415f-a733-0658f14e7b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:22.566770 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-0ee73387-2eb6-415f-a733-0658f14e7b31 None None] MFA Rules not processed for user `f8535ecec5054d4fad485bd2bcb800f5`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:22.567950 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-0ee73387-2eb6-415f-a733-0658f14e7b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:22.575011 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050a3ca-e62a-4a55-b745-ae82070fb2a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:22.575662 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050a3ca-e62a-4a55-b745-ae82070fb2a6 service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:22.575947 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050a3ca-e62a-4a55-b745-ae82070fb2a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:22.576227 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050a3ca-e62a-4a55-b745-ae82070fb2a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:22.635734 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050a3ca-e62a-4a55-b745-ae82070fb2a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:22.636915 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 808/1628] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:22.637789 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee73387-2eb6-415f-a733-0658f14e7b31 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:22.638890 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050a3ca-e62a-4a55-b745-ae82070fb2a6 service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:22.639076 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-0ee73387-2eb6-415f-a733-0658f14e7b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:22.651861 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 821/1629] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:22 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:59:22.653324 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050a3ca-e62a-4a55-b745-ae82070fb2a6 service cinder] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:22.696600 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee73387-2eb6-415f-a733-0658f14e7b31 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:22.700271 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045767c2-dac9-4540-af74-2a734f6ce99b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:22.701100 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045767c2-dac9-4540-af74-2a734f6ce99b service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:22.701501 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045767c2-dac9-4540-af74-2a734f6ce99b service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:22.701879 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045767c2-dac9-4540-af74-2a734f6ce99b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:22.723381 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045767c2-dac9-4540-af74-2a734f6ce99b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:22.725043 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045767c2-dac9-4540-af74-2a734f6ce99b service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:22.739909 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050a3ca-e62a-4a55-b745-ae82070fb2a6 service cinder] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:22.746999 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac23513-2cd0-4935-8f12-28b3cfdedfc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:22.747895 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 809/1630] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:59:22.748194 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac23513-2cd0-4935-8f12-28b3cfdedfc2 service nova] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:22.748639 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac23513-2cd0-4935-8f12-28b3cfdedfc2 service nova] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:22.749135 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac23513-2cd0-4935-8f12-28b3cfdedfc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:22.749944 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27900eb1-c728-424b-b3d9-e986e09440f7 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:22.750252 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27900eb1-c728-424b-b3d9-e986e09440f7 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:22.751740 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27900eb1-c728-424b-b3d9-e986e09440f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:22.784141 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-27900eb1-c728-424b-b3d9-e986e09440f7 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:22.785594 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-27900eb1-c728-424b-b3d9-e986e09440f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:22.794222 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 810/1631] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:22.795828 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e63107-a538-48d2-83e9-ce245cbb9aa2 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:22.796115 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e63107-a538-48d2-83e9-ce245cbb9aa2 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:22.796417 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e63107-a538-48d2-83e9-ce245cbb9aa2 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:22.805264 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 811/1632] 10.222.0.30 () {54 vars in 961 bytes} [Wed Jan 5 14:59:22 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:59:22.805992 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e63107-a538-48d2-83e9-ce245cbb9aa2 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:22.817790 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac23513-2cd0-4935-8f12-28b3cfdedfc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:22.819047 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e63107-a538-48d2-83e9-ce245cbb9aa2 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:22.819410 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac23513-2cd0-4935-8f12-28b3cfdedfc2 service nova] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:22.822802 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef0e3f-9e4f-4341-a061-32f54da5e11b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:22.823430 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef0e3f-9e4f-4341-a061-32f54da5e11b service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:22.823707 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef0e3f-9e4f-4341-a061-32f54da5e11b service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:22.823984 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef0e3f-9e4f-4341-a061-32f54da5e11b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:22.830182 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 822/1633] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:59:22.831143 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac23513-2cd0-4935-8f12-28b3cfdedfc2 service nova] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:22.834785 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef0e3f-9e4f-4341-a061-32f54da5e11b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:22.836257 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef0e3f-9e4f-4341-a061-32f54da5e11b service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:22.839598 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac23513-2cd0-4935-8f12-28b3cfdedfc2 service nova] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:22.844058 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97141a-0ee8-4c40-92f4-12bb1bdefa91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:22.844689 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97141a-0ee8-4c40-92f4-12bb1bdefa91 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:22.845089 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97141a-0ee8-4c40-92f4-12bb1bdefa91 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:22.845448 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97141a-0ee8-4c40-92f4-12bb1bdefa91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:22.846899 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 812/1634] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:59:22.855436 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97141a-0ee8-4c40-92f4-12bb1bdefa91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:22.857003 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97141a-0ee8-4c40-92f4-12bb1bdefa91 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:22.863077 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34a34a-9990-4b6e-9c97-f4186185d701 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:22.863529 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34a34a-9990-4b6e-9c97-f4186185d701 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:22.864017 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34a34a-9990-4b6e-9c97-f4186185d701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:22.868139 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 823/1635] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:59:22.892022 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-ee34a34a-9990-4b6e-9c97-f4186185d701 None None] MFA Rules not processed for user `77db235e2f7046e4bdbad7f31b5e3ebc`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:22.892022 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-ee34a34a-9990-4b6e-9c97-f4186185d701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:22.907501 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 813/1636] 10.222.0.30 () {58 vars in 1058 bytes} [Wed Jan 5 14:59:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:22.916473 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97141a-0ee8-4c40-92f4-12bb1bdefa91 service neutron] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:22.937828 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97141a-0ee8-4c40-92f4-12bb1bdefa91 service neutron] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:22.952095 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277910ff-e65b-4f31-a0dd-309b409b6fee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:22.952934 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277910ff-e65b-4f31-a0dd-309b409b6fee service nova] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:22.953347 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277910ff-e65b-4f31-a0dd-309b409b6fee service nova] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:22.954880 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277910ff-e65b-4f31-a0dd-309b409b6fee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:23.051883 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277910ff-e65b-4f31-a0dd-309b409b6fee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:23.053609 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277910ff-e65b-4f31-a0dd-309b409b6fee service nova] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:23.066874 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 824/1637] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:59:23.131134 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb106d8-f605-4141-9543-5ed9226d0177 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:23.131291 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb106d8-f605-4141-9543-5ed9226d0177 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:23.131572 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb106d8-f605-4141-9543-5ed9226d0177 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:23.133362 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 814/1638] 10.222.0.30 () {54 vars in 912 bytes} [Wed Jan 5 14:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:59:23.141128 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004c863-2fae-4104-a0d1-ff53b4953a9b None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:23.141421 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004c863-2fae-4104-a0d1-ff53b4953a9b None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:23.141712 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004c863-2fae-4104-a0d1-ff53b4953a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:23.162390 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-f004c863-2fae-4104-a0d1-ff53b4953a9b None None] MFA Rules not processed for user `77db235e2f7046e4bdbad7f31b5e3ebc`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:23.163673 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-f004c863-2fae-4104-a0d1-ff53b4953a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:23.178359 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 825/1639] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Jan 5 14:59:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:23.196136 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb106d8-f605-4141-9543-5ed9226d0177 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:23.210328 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb106d8-f605-4141-9543-5ed9226d0177 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:23.215741 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca0e6d-ef74-4a70-874c-90f395f43700 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:23.216548 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca0e6d-ef74-4a70-874c-90f395f43700 service cinder] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:23.217004 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca0e6d-ef74-4a70-874c-90f395f43700 service cinder] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:23.217959 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca0e6d-ef74-4a70-874c-90f395f43700 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:23.230857 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca0e6d-ef74-4a70-874c-90f395f43700 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:23.232716 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca0e6d-ef74-4a70-874c-90f395f43700 service cinder] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:23.260197 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 815/1640] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:59:23.312777 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004c863-2fae-4104-a0d1-ff53b4953a9b None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:23.328812 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004c863-2fae-4104-a0d1-ff53b4953a9b None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:23.338463 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99994743-d21b-4c3e-a711-4840171f1874 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:23.339083 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99994743-d21b-4c3e-a711-4840171f1874 service nova] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:23.339587 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99994743-d21b-4c3e-a711-4840171f1874 service nova] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:23.339714 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99994743-d21b-4c3e-a711-4840171f1874 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:23.351839 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99994743-d21b-4c3e-a711-4840171f1874 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:23.353524 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99994743-d21b-4c3e-a711-4840171f1874 service nova] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:23.376130 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 826/1641] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:59:23.406705 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d97f1-1e97-49a2-81d6-501785122c58 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:23.407079 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d97f1-1e97-49a2-81d6-501785122c58 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:23.407428 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d97f1-1e97-49a2-81d6-501785122c58 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:23.409381 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 816/1642] 10.222.0.30 () {54 vars in 912 bytes} [Wed Jan 5 14:59:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:59:23.417773 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f4ab4-b043-43f7-b09d-8a2368a11c6f None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:23.418737 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f4ab4-b043-43f7-b09d-8a2368a11c6f None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:23.419128 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f4ab4-b043-43f7-b09d-8a2368a11c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:23.444931 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-a64f4ab4-b043-43f7-b09d-8a2368a11c6f None None] MFA Rules not processed for user `77db235e2f7046e4bdbad7f31b5e3ebc`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:23.446402 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-a64f4ab4-b043-43f7-b09d-8a2368a11c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:23.460387 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 827/1643] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Jan 5 14:59:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:59:23.755445 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d97f1-1e97-49a2-81d6-501785122c58 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:23.776924 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d97f1-1e97-49a2-81d6-501785122c58 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:23.781293 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b14e1-f2e9-45fc-91b4-27aa98cddafe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:23.781935 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b14e1-f2e9-45fc-91b4-27aa98cddafe service cinder] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:23.783837 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b14e1-f2e9-45fc-91b4-27aa98cddafe service cinder] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:23.783837 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b14e1-f2e9-45fc-91b4-27aa98cddafe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:23.793342 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b14e1-f2e9-45fc-91b4-27aa98cddafe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:23.794889 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b14e1-f2e9-45fc-91b4-27aa98cddafe service cinder] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:23.809977 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 817/1644] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:59:24.646151 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f4ab4-b043-43f7-b09d-8a2368a11c6f None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:24.664982 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f4ab4-b043-43f7-b09d-8a2368a11c6f None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:24.669985 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc59c9b-8035-4abf-ac12-fa9fe10edcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:24.673682 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc59c9b-8035-4abf-ac12-fa9fe10edcd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:24.673682 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc59c9b-8035-4abf-ac12-fa9fe10edcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:24.673682 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc59c9b-8035-4abf-ac12-fa9fe10edcd1 admin admin] PATH_INFO: `/v3/users/4c76d12d96674432b388fb4c1ed2492e` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:24.673682 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc59c9b-8035-4abf-ac12-fa9fe10edcd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c76d12d96674432b388fb4c1ed2492e)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:24.675458 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: WARNING py.warnings [None req-fdc59c9b-8035-4abf-ac12-fa9fe10edcd1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:24.675458 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: warnings.warn(msg) Jan 05 14:59:24.675458 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: Jan 05 14:59:24.678026 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc59c9b-8035-4abf-ac12-fa9fe10edcd1 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:24.944188 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-fdc59c9b-8035-4abf-ac12-fa9fe10edcd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c76d12d96674432b388fb4c1ed2492e'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:24.963679 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-fdc59c9b-8035-4abf-ac12-fa9fe10edcd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c76d12d96674432b388fb4c1ed2492e'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:24.964572 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-fdc59c9b-8035-4abf-ac12-fa9fe10edcd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c76d12d96674432b388fb4c1ed2492e'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:25.086213 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-fdc59c9b-8035-4abf-ac12-fa9fe10edcd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c76d12d96674432b388fb4c1ed2492e'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:25.108603 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-fdc59c9b-8035-4abf-ac12-fa9fe10edcd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c76d12d96674432b388fb4c1ed2492e'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:25.120035 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 828/1645] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 14:59:24 2022] DELETE /identity/v3/users/4c76d12d96674432b388fb4c1ed2492e => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:25.136140 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d9331-f4bd-45da-9201-93151a1c561a None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:25.136340 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3921ec8-691e-45f2-86e3-564cf9b3297d None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:25.142255 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d9331-f4bd-45da-9201-93151a1c561a None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:25.142399 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3921ec8-691e-45f2-86e3-564cf9b3297d None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:25.142507 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d9331-f4bd-45da-9201-93151a1c561a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:25.142617 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3921ec8-691e-45f2-86e3-564cf9b3297d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:25.155869 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-b45d9331-f4bd-45da-9201-93151a1c561a None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:25.158063 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-b45d9331-f4bd-45da-9201-93151a1c561a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:25.167028 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-d3921ec8-691e-45f2-86e3-564cf9b3297d None None] MFA Rules not processed for user `c439b7ebe2d44b4ca60a269bd60520e8`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:25.168538 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-d3921ec8-691e-45f2-86e3-564cf9b3297d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:25.228215 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 829/1646] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:25.237778 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 818/1647] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:25.243541 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d9331-f4bd-45da-9201-93151a1c561a None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:25.243541 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-b45d9331-f4bd-45da-9201-93151a1c561a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:25.293028 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d03c6-ffd9-4460-843c-ad048db4f83f None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:25.293330 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d03c6-ffd9-4460-843c-ad048db4f83f None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:25.293790 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d03c6-ffd9-4460-843c-ad048db4f83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:25.308024 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d9331-f4bd-45da-9201-93151a1c561a None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:25.312975 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c5896-e925-4a08-9921-d9ba74ddf6b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:25.313655 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-a87d03c6-ffd9-4460-843c-ad048db4f83f None None] MFA Rules not processed for user `c439b7ebe2d44b4ca60a269bd60520e8`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:25.314246 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c5896-e925-4a08-9921-d9ba74ddf6b7 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:25.314766 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c5896-e925-4a08-9921-d9ba74ddf6b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:25.315326 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c5896-e925-4a08-9921-d9ba74ddf6b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:25.315519 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-a87d03c6-ffd9-4460-843c-ad048db4f83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:25.328307 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 819/1648] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:59:25.331365 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c5896-e925-4a08-9921-d9ba74ddf6b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:25.332935 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c5896-e925-4a08-9921-d9ba74ddf6b7 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:25.335386 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d03c6-ffd9-4460-843c-ad048db4f83f None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:25.336738 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-a87d03c6-ffd9-4460-843c-ad048db4f83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:25.374183 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 830/1649] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 14:59:25.471619 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d03c6-ffd9-4460-843c-ad048db4f83f None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:25.484950 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd46811-3c4b-4ce2-aa94-0eda945d9c01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:25.486040 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd46811-3c4b-4ce2-aa94-0eda945d9c01 service nova] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:25.488034 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd46811-3c4b-4ce2-aa94-0eda945d9c01 service nova] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:25.488534 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd46811-3c4b-4ce2-aa94-0eda945d9c01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:25.510992 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd46811-3c4b-4ce2-aa94-0eda945d9c01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:25.519296 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd46811-3c4b-4ce2-aa94-0eda945d9c01 service nova] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:25.538179 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 820/1650] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 14:59:26.437829 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73528e33-e6af-4b82-af29-a69094d2e79f None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:26.438891 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73528e33-e6af-4b82-af29-a69094d2e79f None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:26.439381 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73528e33-e6af-4b82-af29-a69094d2e79f None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:26.441799 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 831/1651] 10.222.0.30 () {54 vars in 912 bytes} [Wed Jan 5 14:59:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:59:26.448847 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536e602-f4f6-4199-b277-d80a351019c8 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:26.449407 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536e602-f4f6-4199-b277-d80a351019c8 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:26.449500 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536e602-f4f6-4199-b277-d80a351019c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:26.468779 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73528e33-e6af-4b82-af29-a69094d2e79f None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:26.477094 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-73528e33-e6af-4b82-af29-a69094d2e79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:26.482127 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-6536e602-f4f6-4199-b277-d80a351019c8 None None] MFA Rules not processed for user `a6234d716a014808a8a4eb22b903bbc9`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:26.484291 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-6536e602-f4f6-4199-b277-d80a351019c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:26.506438 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 821/1652] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Jan 5 14:59:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:59:26.530740 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73528e33-e6af-4b82-af29-a69094d2e79f None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:26.537028 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7318e-99da-48d3-b391-bfa5b6b7a57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:26.538562 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7318e-99da-48d3-b391-bfa5b6b7a57d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:26.539132 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7318e-99da-48d3-b391-bfa5b6b7a57d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:26.539625 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7318e-99da-48d3-b391-bfa5b6b7a57d admin admin] PATH_INFO: `/v3/projects/06f71d61e6814a3b828958a1728183ae` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:26.541786 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536e602-f4f6-4199-b277-d80a351019c8 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:26.542610 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7318e-99da-48d3-b391-bfa5b6b7a57d admin admin] RBAC: Authorizing `identity:delete_project(project_id=06f71d61e6814a3b828958a1728183ae)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:26.545758 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7318e-99da-48d3-b391-bfa5b6b7a57d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:26.553542 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536e602-f4f6-4199-b277-d80a351019c8 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:26.568416 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a482427-7b01-4cef-a66d-d187faf87ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:26.569200 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a482427-7b01-4cef-a66d-d187faf87ecf service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:26.569492 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a482427-7b01-4cef-a66d-d187faf87ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:26.569776 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a482427-7b01-4cef-a66d-d187faf87ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:26.589665 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a482427-7b01-4cef-a66d-d187faf87ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:26.591327 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a482427-7b01-4cef-a66d-d187faf87ecf service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:26.603843 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 822/1653] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 14:59:26.742764 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-3bf7318e-99da-48d3-b391-bfa5b6b7a57d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06f71d61e6814a3b828958a1728183ae', 'request_id': 'req-3bf7318e-99da-48d3-b391-bfa5b6b7a57d'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:26.779048 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-3bf7318e-99da-48d3-b391-bfa5b6b7a57d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06f71d61e6814a3b828958a1728183ae', 'request_id': 'req-3bf7318e-99da-48d3-b391-bfa5b6b7a57d'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:26.796169 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-3bf7318e-99da-48d3-b391-bfa5b6b7a57d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06f71d61e6814a3b828958a1728183ae', 'request_id': 'req-3bf7318e-99da-48d3-b391-bfa5b6b7a57d'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:26.943432 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-3bf7318e-99da-48d3-b391-bfa5b6b7a57d admin admin] The token cache is being invalidate because project 06f71d61e6814a3b828958a1728183ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 14:59:26.944062 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-3bf7318e-99da-48d3-b391-bfa5b6b7a57d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:26.945907 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-3bf7318e-99da-48d3-b391-bfa5b6b7a57d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:26.948151 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 832/1654] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 14:59:26 2022] DELETE /identity/v3/projects/06f71d61e6814a3b828958a1728183ae => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:26.955077 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af31994-8627-4148-8822-dca787748660 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:26.955508 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af31994-8627-4148-8822-dca787748660 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:26.955894 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af31994-8627-4148-8822-dca787748660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:26.976988 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-8af31994-8627-4148-8822-dca787748660 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:26.978635 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-8af31994-8627-4148-8822-dca787748660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:27.110523 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 823/1655] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:27.120960 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdaca7c-219f-4e66-b83c-c6a9eb938e48 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:27.121859 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdaca7c-219f-4e66-b83c-c6a9eb938e48 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:27.122240 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdaca7c-219f-4e66-b83c-c6a9eb938e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:27.167953 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-5cdaca7c-219f-4e66-b83c-c6a9eb938e48 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:27.174056 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-5cdaca7c-219f-4e66-b83c-c6a9eb938e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:27.213711 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af31994-8627-4148-8822-dca787748660 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:27.228084 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af31994-8627-4148-8822-dca787748660 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:27.229872 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 833/1656] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:27.240076 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9b340-757b-46a6-a0b9-00ba6a43e9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:27.241048 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9b340-757b-46a6-a0b9-00ba6a43e9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:27.241542 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9b340-757b-46a6-a0b9-00ba6a43e9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:27.242011 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9b340-757b-46a6-a0b9-00ba6a43e9e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:27.243760 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9b340-757b-46a6-a0b9-00ba6a43e9e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:59:27.247602 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9b340-757b-46a6-a0b9-00ba6a43e9e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:27.258574 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9b340-757b-46a6-a0b9-00ba6a43e9e8 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:27.295678 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 824/1657] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 14:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:59:27.300358 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdaca7c-219f-4e66-b83c-c6a9eb938e48 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:27.314387 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdaca7c-219f-4e66-b83c-c6a9eb938e48 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:27.327287 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b560b-564e-4fd7-bfc5-f10ea62ba0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:27.328657 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b560b-564e-4fd7-bfc5-f10ea62ba0d8 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:27.329041 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b560b-564e-4fd7-bfc5-f10ea62ba0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:27.329466 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b560b-564e-4fd7-bfc5-f10ea62ba0d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:27.332079 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b560b-564e-4fd7-bfc5-f10ea62ba0d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:27.338016 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b560b-564e-4fd7-bfc5-f10ea62ba0d8 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:27.406708 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9b340-757b-46a6-a0b9-00ba6a43e9e8 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:27.408224 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-3cd9b340-757b-46a6-a0b9-00ba6a43e9e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:27.465214 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9b340-757b-46a6-a0b9-00ba6a43e9e8 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:27.469314 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 834/1658] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 14:59:27 2022] POST /identity/v3/projects => generated 403 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:27.473262 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b560b-564e-4fd7-bfc5-f10ea62ba0d8 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:27.667501 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b560b-564e-4fd7-bfc5-f10ea62ba0d8 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:27.668297 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d3972-45cc-40f8-a9bf-d2a62e3da59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:27.668297 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d3972-45cc-40f8-a9bf-d2a62e3da59e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:27.668297 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d3972-45cc-40f8-a9bf-d2a62e3da59e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:27.668297 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d3972-45cc-40f8-a9bf-d2a62e3da59e admin admin] PATH_INFO: `/v3/users/a12ac224ada4431bb7f5207afa6a0417` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:27.671691 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d817c8b-20c4-4dee-9803-814f82741b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:27.671691 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d817c8b-20c4-4dee-9803-814f82741b17 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:27.671691 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d817c8b-20c4-4dee-9803-814f82741b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:27.671691 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d817c8b-20c4-4dee-9803-814f82741b17 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:27.672076 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d817c8b-20c4-4dee-9803-814f82741b17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:27.672076 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d817c8b-20c4-4dee-9803-814f82741b17 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:27.673577 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d3972-45cc-40f8-a9bf-d2a62e3da59e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a12ac224ada4431bb7f5207afa6a0417)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:27.676126 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d3972-45cc-40f8-a9bf-d2a62e3da59e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:27.847119 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 835/1659] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 14:59:27 2022] POST /identity/v3/users => generated 302 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:27.851558 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d817c8b-20c4-4dee-9803-814f82741b17 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:27.882744 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d817c8b-20c4-4dee-9803-814f82741b17 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:27.888455 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd3d92-5dbc-4424-ae57-3546176d1b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:27.889328 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd3d92-5dbc-4424-ae57-3546176d1b76 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:27.889579 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd3d92-5dbc-4424-ae57-3546176d1b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:27.889897 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd3d92-5dbc-4424-ae57-3546176d1b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:27.890666 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd3d92-5dbc-4424-ae57-3546176d1b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:27.892275 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd3d92-5dbc-4424-ae57-3546176d1b76 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:27.905031 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 836/1660] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:27.909170 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd3d92-5dbc-4424-ae57-3546176d1b76 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:27.913234 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-02bd3d92-5dbc-4424-ae57-3546176d1b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:28.041328 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd3d92-5dbc-4424-ae57-3546176d1b76 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:28.051678 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86454b-77b8-4f6a-a3fe-3b69ab8faa5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8847b97a7089420a8b8b817f3059c660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:28.052695 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86454b-77b8-4f6a-a3fe-3b69ab8faa5d service placement] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:28.052695 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86454b-77b8-4f6a-a3fe-3b69ab8faa5d service placement] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:28.053299 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86454b-77b8-4f6a-a3fe-3b69ab8faa5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:28.056156 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-cb86454b-77b8-4f6a-a3fe-3b69ab8faa5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:28.068857 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-664d3972-45cc-40f8-a9bf-d2a62e3da59e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a12ac224ada4431bb7f5207afa6a0417'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:28.085956 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-664d3972-45cc-40f8-a9bf-d2a62e3da59e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a12ac224ada4431bb7f5207afa6a0417'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:28.086505 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86454b-77b8-4f6a-a3fe-3b69ab8faa5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:28.087214 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-664d3972-45cc-40f8-a9bf-d2a62e3da59e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a12ac224ada4431bb7f5207afa6a0417'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:28.088056 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-664d3972-45cc-40f8-a9bf-d2a62e3da59e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a12ac224ada4431bb7f5207afa6a0417'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:28.088184 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86454b-77b8-4f6a-a3fe-3b69ab8faa5d service placement] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:28.118113 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 837/1661] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:59:28.119170 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86454b-77b8-4f6a-a3fe-3b69ab8faa5d service placement] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:28.149362 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86454b-77b8-4f6a-a3fe-3b69ab8faa5d service placement] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:28.163754 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30928c46-4975-4e22-8b0c-cfcdc4073f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:28.164435 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30928c46-4975-4e22-8b0c-cfcdc4073f95 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:28.166486 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-664d3972-45cc-40f8-a9bf-d2a62e3da59e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a12ac224ada4431bb7f5207afa6a0417'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:28.167233 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30928c46-4975-4e22-8b0c-cfcdc4073f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:28.168014 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30928c46-4975-4e22-8b0c-cfcdc4073f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:28.168858 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30928c46-4975-4e22-8b0c-cfcdc4073f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:28.172110 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30928c46-4975-4e22-8b0c-cfcdc4073f95 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:28.196985 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 825/1662] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 14:59:27 2022] DELETE /identity/v3/users/a12ac224ada4431bb7f5207afa6a0417 => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:28.203585 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19739aa-b0a4-420b-81b9-740263387ce9 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:28.203798 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 838/1663] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:28.204370 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19739aa-b0a4-420b-81b9-740263387ce9 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:28.204880 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19739aa-b0a4-420b-81b9-740263387ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:28.205964 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30928c46-4975-4e22-8b0c-cfcdc4073f95 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:28.215716 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-30928c46-4975-4e22-8b0c-cfcdc4073f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:28.237967 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-e19739aa-b0a4-420b-81b9-740263387ce9 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:28.250427 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-e19739aa-b0a4-420b-81b9-740263387ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:28.255021 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30928c46-4975-4e22-8b0c-cfcdc4073f95 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:28.369329 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 826/1664] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:28.392423 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef7dbf-80bf-4ce2-8d26-4dc700574c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:28.394751 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef7dbf-80bf-4ce2-8d26-4dc700574c2a admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:28.399090 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef7dbf-80bf-4ce2-8d26-4dc700574c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:28.399969 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef7dbf-80bf-4ce2-8d26-4dc700574c2a admin admin] PATH_INFO: `/v3/projects/b895d9e0ea654bc0bf2f35a27f097b7e/users/df92a2298df24dc48d182e16f84e3d9a/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:28.406254 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19739aa-b0a4-420b-81b9-740263387ce9 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:28.410153 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-e19739aa-b0a4-420b-81b9-740263387ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:28.443400 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef7dbf-80bf-4ce2-8d26-4dc700574c2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b895d9e0ea654bc0bf2f35a27f097b7e, user_id=df92a2298df24dc48d182e16f84e3d9a, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:28.449520 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef7dbf-80bf-4ce2-8d26-4dc700574c2a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:28.567443 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 839/1665] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 14:59:28 2022] PUT /identity/v3/projects/b895d9e0ea654bc0bf2f35a27f097b7e/users/df92a2298df24dc48d182e16f84e3d9a/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:28.580755 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87f939-210d-4219-8ed4-63dfc352c175 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:28.581303 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87f939-210d-4219-8ed4-63dfc352c175 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:28.581804 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87f939-210d-4219-8ed4-63dfc352c175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:28.644837 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19739aa-b0a4-420b-81b9-740263387ce9 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:28.691319 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-5f87f939-210d-4219-8ed4-63dfc352c175 None None] MFA Rules not processed for user `df92a2298df24dc48d182e16f84e3d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:28.708454 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-5f87f939-210d-4219-8ed4-63dfc352c175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:28.731643 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57c6aa-f423-4963-af4e-95d4c3b33f24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:28.732416 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57c6aa-f423-4963-af4e-95d4c3b33f24 service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:28.732706 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57c6aa-f423-4963-af4e-95d4c3b33f24 service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:28.733555 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57c6aa-f423-4963-af4e-95d4c3b33f24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:28.815694 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57c6aa-f423-4963-af4e-95d4c3b33f24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:28.818062 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57c6aa-f423-4963-af4e-95d4c3b33f24 service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:28.832987 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 827/1666] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:59:28.861543 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 840/1667] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:28 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:28.867343 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57c6aa-f423-4963-af4e-95d4c3b33f24 service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:28.879764 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57c6aa-f423-4963-af4e-95d4c3b33f24 service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:28.886713 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c7694-3f76-453a-b784-068a2544efbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:28.887776 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c7694-3f76-453a-b784-068a2544efbd admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:28.888183 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c7694-3f76-453a-b784-068a2544efbd admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:28.888544 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c7694-3f76-453a-b784-068a2544efbd admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:28.889375 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c7694-3f76-453a-b784-068a2544efbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:28.892134 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c7694-3f76-453a-b784-068a2544efbd admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:29.008912 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 828/1668] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 14:59:28 2022] POST /identity/v3/projects => generated 403 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:29.009120 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87f939-210d-4219-8ed4-63dfc352c175 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:29.018241 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87f939-210d-4219-8ed4-63dfc352c175 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:29.198103 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4d970-b742-4d02-93a6-80c05054982a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:29.198623 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4d970-b742-4d02-93a6-80c05054982a admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:29.200238 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4d970-b742-4d02-93a6-80c05054982a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:29.200238 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4d970-b742-4d02-93a6-80c05054982a admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:29.200238 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4d970-b742-4d02-93a6-80c05054982a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:29.208222 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4d970-b742-4d02-93a6-80c05054982a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:29.315581 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 841/1669] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 14:59:29 2022] POST /identity/v3/users => generated 308 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:29.319095 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c7694-3f76-453a-b784-068a2544efbd admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:29.338010 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c7694-3f76-453a-b784-068a2544efbd admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:29.353547 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fafa7b-4239-41f9-84f5-231e417dc7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:29.354589 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fafa7b-4239-41f9-84f5-231e417dc7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:29.356107 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fafa7b-4239-41f9-84f5-231e417dc7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:29.358623 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fafa7b-4239-41f9-84f5-231e417dc7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:29.359825 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fafa7b-4239-41f9-84f5-231e417dc7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:29.367794 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fafa7b-4239-41f9-84f5-231e417dc7b2 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:29.391168 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 829/1670] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 14:59:29.395718 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4d970-b742-4d02-93a6-80c05054982a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:29.414198 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4d970-b742-4d02-93a6-80c05054982a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:29.429868 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12329112-9df2-444c-84a1-30ebf0732635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:29.430794 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12329112-9df2-444c-84a1-30ebf0732635 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:29.431087 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12329112-9df2-444c-84a1-30ebf0732635 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:29.431381 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12329112-9df2-444c-84a1-30ebf0732635 admin admin] PATH_INFO: `/v3/projects/94e0c100c2dd40cf958e4b1ca8ee33be/users/77ed20259361480283e33a3f4c38be3c/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:29.455718 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12329112-9df2-444c-84a1-30ebf0732635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94e0c100c2dd40cf958e4b1ca8ee33be, user_id=77ed20259361480283e33a3f4c38be3c, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:29.459121 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12329112-9df2-444c-84a1-30ebf0732635 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:29.538961 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 842/1671] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 14:59:29 2022] PUT /identity/v3/projects/94e0c100c2dd40cf958e4b1ca8ee33be/users/77ed20259361480283e33a3f4c38be3c/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:29.543301 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fafa7b-4239-41f9-84f5-231e417dc7b2 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:29.573634 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fafa7b-4239-41f9-84f5-231e417dc7b2 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:29.718151 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428358fc-6346-4cbd-b1f6-580b0bd0781a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:29.721290 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428358fc-6346-4cbd-b1f6-580b0bd0781a admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:29.721635 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428358fc-6346-4cbd-b1f6-580b0bd0781a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:29.721916 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428358fc-6346-4cbd-b1f6-580b0bd0781a admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:29.725936 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428358fc-6346-4cbd-b1f6-580b0bd0781a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:29.729991 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428358fc-6346-4cbd-b1f6-580b0bd0781a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:29.753731 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 830/1672] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:29.758054 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12329112-9df2-444c-84a1-30ebf0732635 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:29.770966 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12329112-9df2-444c-84a1-30ebf0732635 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:29.782861 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091e136-2f52-4b42-9a95-d6dd62a9863e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:29.784035 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091e136-2f52-4b42-9a95-d6dd62a9863e admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:29.785110 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091e136-2f52-4b42-9a95-d6dd62a9863e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:29.785110 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091e136-2f52-4b42-9a95-d6dd62a9863e admin admin] PATH_INFO: `/v3/projects/94e0c100c2dd40cf958e4b1ca8ee33be/users/77ed20259361480283e33a3f4c38be3c/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:29.787002 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b091e136-2f52-4b42-9a95-d6dd62a9863e admin admin] RBAC: Authorizing `identity:create_grant(project_id=94e0c100c2dd40cf958e4b1ca8ee33be, user_id=77ed20259361480283e33a3f4c38be3c, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:29.793207 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b091e136-2f52-4b42-9a95-d6dd62a9863e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:29.810920 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 843/1673] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 14:59:29 2022] PUT /identity/v3/projects/94e0c100c2dd40cf958e4b1ca8ee33be/users/77ed20259361480283e33a3f4c38be3c/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:29.823042 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243472e-942c-49e0-b18d-4824dc6facd2 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:29.823330 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243472e-942c-49e0-b18d-4824dc6facd2 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:29.823611 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243472e-942c-49e0-b18d-4824dc6facd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:29.896477 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-3243472e-942c-49e0-b18d-4824dc6facd2 None None] MFA Rules not processed for user `77ed20259361480283e33a3f4c38be3c`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:29.898036 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-3243472e-942c-49e0-b18d-4824dc6facd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:30.060921 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091e136-2f52-4b42-9a95-d6dd62a9863e admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:30.066567 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-b091e136-2f52-4b42-9a95-d6dd62a9863e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:30.067478 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 831/1674] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:29 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:30.264616 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091e136-2f52-4b42-9a95-d6dd62a9863e admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:30.278748 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72643d-a493-4fc7-b282-b645e501483e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:30.280024 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72643d-a493-4fc7-b282-b645e501483e service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:30.280531 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72643d-a493-4fc7-b282-b645e501483e service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:30.281081 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72643d-a493-4fc7-b282-b645e501483e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:30.306408 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72643d-a493-4fc7-b282-b645e501483e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:30.308357 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72643d-a493-4fc7-b282-b645e501483e service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:30.336337 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 844/1675] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:30 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:59:31.155726 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243472e-942c-49e0-b18d-4824dc6facd2 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:31.213127 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243472e-942c-49e0-b18d-4824dc6facd2 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:31.226639 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572ddb5-a4fa-4764-ab8f-372e7e1d6db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:31.234782 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572ddb5-a4fa-4764-ab8f-372e7e1d6db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:31.235218 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572ddb5-a4fa-4764-ab8f-372e7e1d6db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:31.247558 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572ddb5-a4fa-4764-ab8f-372e7e1d6db0 admin admin] PATH_INFO: `/v3/users/df92a2298df24dc48d182e16f84e3d9a` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:31.254757 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572ddb5-a4fa-4764-ab8f-372e7e1d6db0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df92a2298df24dc48d182e16f84e3d9a)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:31.261958 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572ddb5-a4fa-4764-ab8f-372e7e1d6db0 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:31.590103 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72643d-a493-4fc7-b282-b645e501483e service cinder] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:31.591766 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-4f72643d-a493-4fc7-b282-b645e501483e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:31.603012 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a572ddb5-a4fa-4764-ab8f-372e7e1d6db0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df92a2298df24dc48d182e16f84e3d9a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:31.616324 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a572ddb5-a4fa-4764-ab8f-372e7e1d6db0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df92a2298df24dc48d182e16f84e3d9a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:31.618306 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a572ddb5-a4fa-4764-ab8f-372e7e1d6db0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df92a2298df24dc48d182e16f84e3d9a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:31.619793 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a572ddb5-a4fa-4764-ab8f-372e7e1d6db0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df92a2298df24dc48d182e16f84e3d9a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:31.626401 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72643d-a493-4fc7-b282-b645e501483e service cinder] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:31.651131 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559382b-840f-460f-83f9-824de58bf2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:31.652053 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559382b-840f-460f-83f9-824de58bf2f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:31.652494 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559382b-840f-460f-83f9-824de58bf2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:31.652934 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559382b-840f-460f-83f9-824de58bf2f7 admin admin] PATH_INFO: `/v3/projects/e08383aa131642f0a2cb2ee9db59eac9` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:31.655455 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559382b-840f-460f-83f9-824de58bf2f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e08383aa131642f0a2cb2ee9db59eac9)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:31.661981 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559382b-840f-460f-83f9-824de58bf2f7 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:31.717545 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a572ddb5-a4fa-4764-ab8f-372e7e1d6db0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df92a2298df24dc48d182e16f84e3d9a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:31.806283 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 832/1676] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 14:59:30 2022] DELETE /identity/v3/users/df92a2298df24dc48d182e16f84e3d9a => generated 0 bytes in 820 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:31.807975 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b174d4a-f556-46ee-8fea-d420b71fa18e None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:31.815332 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b174d4a-f556-46ee-8fea-d420b71fa18e None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:31.815744 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b174d4a-f556-46ee-8fea-d420b71fa18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:31.861757 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4559382b-840f-460f-83f9-824de58bf2f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e08383aa131642f0a2cb2ee9db59eac9', 'request_id': 'req-4559382b-840f-460f-83f9-824de58bf2f7'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:31.872698 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-5b174d4a-f556-46ee-8fea-d420b71fa18e None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:31.874926 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4559382b-840f-460f-83f9-824de58bf2f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e08383aa131642f0a2cb2ee9db59eac9', 'request_id': 'req-4559382b-840f-460f-83f9-824de58bf2f7'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:31.877361 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-5b174d4a-f556-46ee-8fea-d420b71fa18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:31.884004 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4559382b-840f-460f-83f9-824de58bf2f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e08383aa131642f0a2cb2ee9db59eac9', 'request_id': 'req-4559382b-840f-460f-83f9-824de58bf2f7'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:32.027699 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4559382b-840f-460f-83f9-824de58bf2f7 admin admin] The token cache is being invalidate because project e08383aa131642f0a2cb2ee9db59eac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 14:59:32.028106 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4559382b-840f-460f-83f9-824de58bf2f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:32.028632 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4559382b-840f-460f-83f9-824de58bf2f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:32.030483 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 845/1677] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 14:59:31 2022] DELETE /identity/v3/projects/e08383aa131642f0a2cb2ee9db59eac9 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:32.051923 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152a9f5-602f-4b7b-920a-2072bdeb0914 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:32.052233 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152a9f5-602f-4b7b-920a-2072bdeb0914 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:32.052490 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152a9f5-602f-4b7b-920a-2072bdeb0914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:32.053258 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 833/1678] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:32.100949 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-2152a9f5-602f-4b7b-920a-2072bdeb0914 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:32.108958 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-2152a9f5-602f-4b7b-920a-2072bdeb0914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:32.131435 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 846/1679] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:32.139293 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9787c-027e-4364-abeb-d884bfa8d128 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:32.139586 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9787c-027e-4364-abeb-d884bfa8d128 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:32.139866 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9787c-027e-4364-abeb-d884bfa8d128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:32.171853 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-40a9787c-027e-4364-abeb-d884bfa8d128 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:32.173088 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-40a9787c-027e-4364-abeb-d884bfa8d128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:32.194142 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 834/1680] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:32.201288 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152a9f5-602f-4b7b-920a-2072bdeb0914 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:32.235065 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152a9f5-602f-4b7b-920a-2072bdeb0914 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:32.251076 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca472eeb-1c6e-467e-bc89-e01ccaa0e1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:32.251876 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca472eeb-1c6e-467e-bc89-e01ccaa0e1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:32.252902 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca472eeb-1c6e-467e-bc89-e01ccaa0e1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:32.253422 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca472eeb-1c6e-467e-bc89-e01ccaa0e1e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:32.254242 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca472eeb-1c6e-467e-bc89-e01ccaa0e1e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:59:32.257161 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca472eeb-1c6e-467e-bc89-e01ccaa0e1e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:32.258910 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca472eeb-1c6e-467e-bc89-e01ccaa0e1e4 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:32.265923 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9787c-027e-4364-abeb-d884bfa8d128 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:32.267364 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-40a9787c-027e-4364-abeb-d884bfa8d128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:32.298027 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 847/1681] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 14:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:59:32.299533 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca472eeb-1c6e-467e-bc89-e01ccaa0e1e4 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:32.337823 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca472eeb-1c6e-467e-bc89-e01ccaa0e1e4 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:32.355069 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12670ff6-130b-4a1f-96a3-fe80e59c73c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:32.355765 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12670ff6-130b-4a1f-96a3-fe80e59c73c6 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:32.357168 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12670ff6-130b-4a1f-96a3-fe80e59c73c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:32.363122 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12670ff6-130b-4a1f-96a3-fe80e59c73c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:32.363122 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12670ff6-130b-4a1f-96a3-fe80e59c73c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:32.363122 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12670ff6-130b-4a1f-96a3-fe80e59c73c6 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:32.412060 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9787c-027e-4364-abeb-d884bfa8d128 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:32.415717 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e61be-160e-4d13-9063-bcd6e0e5f7bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:32.416373 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e61be-160e-4d13-9063-bcd6e0e5f7bb service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:32.416652 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e61be-160e-4d13-9063-bcd6e0e5f7bb service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:32.416930 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e61be-160e-4d13-9063-bcd6e0e5f7bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:32.427406 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e61be-160e-4d13-9063-bcd6e0e5f7bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:32.429146 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e61be-160e-4d13-9063-bcd6e0e5f7bb service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:32.444836 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 835/1682] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:59:32.486159 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 848/1683] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 14:59:32 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 14:59:32.490740 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e61be-160e-4d13-9063-bcd6e0e5f7bb service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:32.517938 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e61be-160e-4d13-9063-bcd6e0e5f7bb service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:32.675748 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1198d7-9899-4548-b035-d0e39b43bf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:32.675944 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1198d7-9899-4548-b035-d0e39b43bf23 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:32.676176 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1198d7-9899-4548-b035-d0e39b43bf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:32.676456 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1198d7-9899-4548-b035-d0e39b43bf23 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:32.681512 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1198d7-9899-4548-b035-d0e39b43bf23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:32.685764 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1198d7-9899-4548-b035-d0e39b43bf23 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:32.851237 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 836/1684] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 14:59:32 2022] POST /identity/v3/users => generated 293 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:32.863673 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12670ff6-130b-4a1f-96a3-fe80e59c73c6 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:32.887967 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12670ff6-130b-4a1f-96a3-fe80e59c73c6 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:32.909667 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbc3ca-40e8-40b4-8f01-4efc23ac17b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:32.910524 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbc3ca-40e8-40b4-8f01-4efc23ac17b1 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:32.910821 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbc3ca-40e8-40b4-8f01-4efc23ac17b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:32.911102 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbc3ca-40e8-40b4-8f01-4efc23ac17b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:32.912326 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbc3ca-40e8-40b4-8f01-4efc23ac17b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:32.916505 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbc3ca-40e8-40b4-8f01-4efc23ac17b1 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:32.946127 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 849/1685] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:32.950069 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1198d7-9899-4548-b035-d0e39b43bf23 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:32.980761 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1198d7-9899-4548-b035-d0e39b43bf23 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:32.996928 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d731c8-1e66-4599-a52a-a577578d8240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:33.000293 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d731c8-1e66-4599-a52a-a577578d8240 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:33.000891 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d731c8-1e66-4599-a52a-a577578d8240 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:33.001448 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d731c8-1e66-4599-a52a-a577578d8240 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:33.002953 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d731c8-1e66-4599-a52a-a577578d8240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:33.009334 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d731c8-1e66-4599-a52a-a577578d8240 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:33.048183 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 837/1686] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:33.053636 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbc3ca-40e8-40b4-8f01-4efc23ac17b1 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:33.075706 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbc3ca-40e8-40b4-8f01-4efc23ac17b1 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:33.085723 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f9f52-677b-428a-ac56-d87c07c8efa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:33.087052 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f9f52-677b-428a-ac56-d87c07c8efa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:33.087987 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f9f52-677b-428a-ac56-d87c07c8efa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:33.088433 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f9f52-677b-428a-ac56-d87c07c8efa1 admin admin] PATH_INFO: `/v3/projects/7c9351ecdd7d430d8c3ae7895011f66d/users/daec324ae1924d4690258ce6fc82bc13/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:33.134308 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f9f52-677b-428a-ac56-d87c07c8efa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c9351ecdd7d430d8c3ae7895011f66d, user_id=daec324ae1924d4690258ce6fc82bc13, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:33.138109 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f9f52-677b-428a-ac56-d87c07c8efa1 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:33.247636 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 850/1687] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 14:59:33 2022] PUT /identity/v3/projects/7c9351ecdd7d430d8c3ae7895011f66d/users/daec324ae1924d4690258ce6fc82bc13/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:33.260792 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a28db6-1fc5-4ac5-902d-04df6974cdb2 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:33.265047 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a28db6-1fc5-4ac5-902d-04df6974cdb2 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:33.265047 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a28db6-1fc5-4ac5-902d-04df6974cdb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:33.318116 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-97a28db6-1fc5-4ac5-902d-04df6974cdb2 None None] MFA Rules not processed for user `daec324ae1924d4690258ce6fc82bc13`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:33.331398 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-97a28db6-1fc5-4ac5-902d-04df6974cdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:33.429357 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1e32a-b11c-4272-b4fe-90a94af9e2f3 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:33.429823 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1e32a-b11c-4272-b4fe-90a94af9e2f3 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:33.430104 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1e32a-b11c-4272-b4fe-90a94af9e2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:33.501744 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-5fe1e32a-b11c-4272-b4fe-90a94af9e2f3 None None] MFA Rules not processed for user `4295ba06618a45988ebeb45a82230bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:33.503401 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-5fe1e32a-b11c-4272-b4fe-90a94af9e2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:33.551634 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 838/1688] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:33.556497 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a28db6-1fc5-4ac5-902d-04df6974cdb2 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:33.670845 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 851/1689] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:33.704640 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a28db6-1fc5-4ac5-902d-04df6974cdb2 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:33.713157 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b844cf-8edb-4890-8cf2-c3d3eaf5d6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:33.714717 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b844cf-8edb-4890-8cf2-c3d3eaf5d6e5 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:33.715261 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b844cf-8edb-4890-8cf2-c3d3eaf5d6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:33.715744 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b844cf-8edb-4890-8cf2-c3d3eaf5d6e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:33.716918 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b844cf-8edb-4890-8cf2-c3d3eaf5d6e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:33.720004 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b844cf-8edb-4890-8cf2-c3d3eaf5d6e5 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:33.743797 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659dcb9f-999b-4827-82bf-4f0c52c0ea87 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:33.744321 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659dcb9f-999b-4827-82bf-4f0c52c0ea87 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:33.744781 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659dcb9f-999b-4827-82bf-4f0c52c0ea87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:33.772235 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-659dcb9f-999b-4827-82bf-4f0c52c0ea87 None None] MFA Rules not processed for user `4295ba06618a45988ebeb45a82230bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:33.775496 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-659dcb9f-999b-4827-82bf-4f0c52c0ea87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:33.790306 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 852/1690] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:59:33.800782 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659dcb9f-999b-4827-82bf-4f0c52c0ea87 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:33.802634 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-659dcb9f-999b-4827-82bf-4f0c52c0ea87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:33.837400 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 839/1691] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 14:59:33 2022] POST /identity/v3/projects => generated 389 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:33.840683 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b844cf-8edb-4890-8cf2-c3d3eaf5d6e5 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:33.987330 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659dcb9f-999b-4827-82bf-4f0c52c0ea87 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:34.034475 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b844cf-8edb-4890-8cf2-c3d3eaf5d6e5 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:34.045523 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6fb29-f988-42c8-9028-36a96dba3e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:34.048743 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6fb29-f988-42c8-9028-36a96dba3e8e admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:34.049039 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6fb29-f988-42c8-9028-36a96dba3e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:34.051751 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6fb29-f988-42c8-9028-36a96dba3e8e admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:34.051751 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6fb29-f988-42c8-9028-36a96dba3e8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:34.064063 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6fb29-f988-42c8-9028-36a96dba3e8e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:34.174933 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 840/1692] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 14:59:33 2022] POST /identity/v3/users => generated 301 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 14:59:34.182418 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6fb29-f988-42c8-9028-36a96dba3e8e admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:34.201704 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6fb29-f988-42c8-9028-36a96dba3e8e admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:34.210516 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba058b-f91f-48a8-9d6b-724525dd874c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:34.211412 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba058b-f91f-48a8-9d6b-724525dd874c service nova] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:34.211879 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba058b-f91f-48a8-9d6b-724525dd874c service nova] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:34.212338 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba058b-f91f-48a8-9d6b-724525dd874c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:34.213421 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba3f78-1d4e-4dc8-bf75-c1bcbf70043a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:34.214163 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba3f78-1d4e-4dc8-bf75-c1bcbf70043a admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:34.214533 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba3f78-1d4e-4dc8-bf75-c1bcbf70043a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:34.214883 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba3f78-1d4e-4dc8-bf75-c1bcbf70043a admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:34.215794 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba3f78-1d4e-4dc8-bf75-c1bcbf70043a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:34.218331 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba3f78-1d4e-4dc8-bf75-c1bcbf70043a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:34.245500 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 841/1693] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:34.247035 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce054b-6053-4ed9-ab64-a645060b3334 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:34.247340 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce054b-6053-4ed9-ab64-a645060b3334 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:34.247618 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce054b-6053-4ed9-ab64-a645060b3334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:34.286644 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-78ce054b-6053-4ed9-ab64-a645060b3334 None None] MFA Rules not processed for user `29314b0be6534c79b36f31402d51d17b`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:34.287952 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-78ce054b-6053-4ed9-ab64-a645060b3334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:34.364981 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba058b-f91f-48a8-9d6b-724525dd874c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:34.373012 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 842/1694] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Jan 5 14:59:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:34.374142 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce054b-6053-4ed9-ab64-a645060b3334 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:34.380499 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-78ce054b-6053-4ed9-ab64-a645060b3334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:34.380618 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba058b-f91f-48a8-9d6b-724525dd874c service nova] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:34.395254 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce054b-6053-4ed9-ab64-a645060b3334 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:34.413356 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5817666-fdf3-4d65-bdcc-4fd7e77ae95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:34.414245 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5817666-fdf3-4d65-bdcc-4fd7e77ae95e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:34.414528 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5817666-fdf3-4d65-bdcc-4fd7e77ae95e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:34.414943 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5817666-fdf3-4d65-bdcc-4fd7e77ae95e admin admin] PATH_INFO: `/v3/users/f8535ecec5054d4fad485bd2bcb800f5` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:34.416717 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5817666-fdf3-4d65-bdcc-4fd7e77ae95e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8535ecec5054d4fad485bd2bcb800f5)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:34.418590 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5817666-fdf3-4d65-bdcc-4fd7e77ae95e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:34.426203 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 853/1695] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 14:59:34.432115 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba058b-f91f-48a8-9d6b-724525dd874c service nova] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:34.468893 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba058b-f91f-48a8-9d6b-724525dd874c service nova] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:34.488346 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d02f3-d596-4030-aa89-89db227cab26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:34.489301 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d02f3-d596-4030-aa89-89db227cab26 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:34.489582 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d02f3-d596-4030-aa89-89db227cab26 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:34.489856 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d02f3-d596-4030-aa89-89db227cab26 admin admin] PATH_INFO: `/v3/projects/028a9f9aa13a4326a29c6545cb798a5c/users/287c99118886405bb8e272139a0d4755/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:34.527899 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d02f3-d596-4030-aa89-89db227cab26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=028a9f9aa13a4326a29c6545cb798a5c, user_id=287c99118886405bb8e272139a0d4755, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:34.529966 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d02f3-d596-4030-aa89-89db227cab26 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:34.638431 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 854/1696] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 14:59:34 2022] PUT /identity/v3/projects/028a9f9aa13a4326a29c6545cb798a5c/users/287c99118886405bb8e272139a0d4755/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:34.642716 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d02f3-d596-4030-aa89-89db227cab26 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:34.727682 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b5817666-fdf3-4d65-bdcc-4fd7e77ae95e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8535ecec5054d4fad485bd2bcb800f5'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:34.743788 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b5817666-fdf3-4d65-bdcc-4fd7e77ae95e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8535ecec5054d4fad485bd2bcb800f5'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:34.744968 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b5817666-fdf3-4d65-bdcc-4fd7e77ae95e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8535ecec5054d4fad485bd2bcb800f5'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:34.747731 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b5817666-fdf3-4d65-bdcc-4fd7e77ae95e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8535ecec5054d4fad485bd2bcb800f5'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:34.784596 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d02f3-d596-4030-aa89-89db227cab26 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:34.799256 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cca8e3-37b0-4fa2-84ff-4f0d1b9a98c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:34.799476 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cca8e3-37b0-4fa2-84ff-4f0d1b9a98c4 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:34.799741 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cca8e3-37b0-4fa2-84ff-4f0d1b9a98c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:34.804023 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cca8e3-37b0-4fa2-84ff-4f0d1b9a98c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:34.804023 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cca8e3-37b0-4fa2-84ff-4f0d1b9a98c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:34.804023 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cca8e3-37b0-4fa2-84ff-4f0d1b9a98c4 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:34.819630 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 855/1697] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:34.821569 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cca8e3-37b0-4fa2-84ff-4f0d1b9a98c4 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:34.830353 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-63cca8e3-37b0-4fa2-84ff-4f0d1b9a98c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:34.839699 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cca8e3-37b0-4fa2-84ff-4f0d1b9a98c4 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:34.855731 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6dd69e-2260-4af5-a5fb-acef7a586b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:34.857289 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dd69e-2260-4af5-a5fb-acef7a586b25 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:34.857289 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dd69e-2260-4af5-a5fb-acef7a586b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:34.857289 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dd69e-2260-4af5-a5fb-acef7a586b25 admin admin] PATH_INFO: `/v3/projects/028a9f9aa13a4326a29c6545cb798a5c/users/287c99118886405bb8e272139a0d4755/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:34.867531 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6dd69e-2260-4af5-a5fb-acef7a586b25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=028a9f9aa13a4326a29c6545cb798a5c, user_id=287c99118886405bb8e272139a0d4755, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:34.872337 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6dd69e-2260-4af5-a5fb-acef7a586b25 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:34.877133 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b5817666-fdf3-4d65-bdcc-4fd7e77ae95e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8535ecec5054d4fad485bd2bcb800f5'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:34.916553 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 856/1698] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 14:59:34 2022] PUT /identity/v3/projects/028a9f9aa13a4326a29c6545cb798a5c/users/287c99118886405bb8e272139a0d4755/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:34.922606 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14573aa4-8aaa-4ba2-b6c3-4b974971c5d1 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:34.923213 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14573aa4-8aaa-4ba2-b6c3-4b974971c5d1 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:34.924567 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14573aa4-8aaa-4ba2-b6c3-4b974971c5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:34.929415 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 843/1699] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 14:59:34 2022] DELETE /identity/v3/users/f8535ecec5054d4fad485bd2bcb800f5 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:34.935553 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3573c-4fe6-4795-a6d4-cebe351916a6 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:34.936645 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3573c-4fe6-4795-a6d4-cebe351916a6 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:34.946855 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3573c-4fe6-4795-a6d4-cebe351916a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:35.018018 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-cea3573c-4fe6-4795-a6d4-cebe351916a6 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:35.019244 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-cea3573c-4fe6-4795-a6d4-cebe351916a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:35.023554 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-14573aa4-8aaa-4ba2-b6c3-4b974971c5d1 None None] MFA Rules not processed for user `287c99118886405bb8e272139a0d4755`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:35.025250 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-14573aa4-8aaa-4ba2-b6c3-4b974971c5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:35.121979 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 844/1700] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:35.127050 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3573c-4fe6-4795-a6d4-cebe351916a6 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:35.127050 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-cea3573c-4fe6-4795-a6d4-cebe351916a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:35.141774 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3573c-4fe6-4795-a6d4-cebe351916a6 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:35.146644 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27309b2-0801-44c7-a399-fba7e37dd966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:35.147695 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27309b2-0801-44c7-a399-fba7e37dd966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:35.148268 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27309b2-0801-44c7-a399-fba7e37dd966 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:35.148706 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27309b2-0801-44c7-a399-fba7e37dd966 admin admin] PATH_INFO: `/v3/projects/b895d9e0ea654bc0bf2f35a27f097b7e` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:35.150667 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27309b2-0801-44c7-a399-fba7e37dd966 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b895d9e0ea654bc0bf2f35a27f097b7e)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:35.151845 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: WARNING py.warnings [None req-b27309b2-0801-44c7-a399-fba7e37dd966 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:35.151845 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: warnings.warn(msg) Jan 05 14:59:35.151845 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: Jan 05 14:59:35.153431 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27309b2-0801-44c7-a399-fba7e37dd966 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:35.184740 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 857/1701] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:59:35.186859 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14573aa4-8aaa-4ba2-b6c3-4b974971c5d1 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:35.190070 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-14573aa4-8aaa-4ba2-b6c3-4b974971c5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:35.287634 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14573aa4-8aaa-4ba2-b6c3-4b974971c5d1 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:35.293695 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1e4a9-b243-41b7-a852-9949fbb66c66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ea13fd3e704b16aad5a38606ddc049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:35.295823 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1e4a9-b243-41b7-a852-9949fbb66c66 service swift] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:35.295823 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1e4a9-b243-41b7-a852-9949fbb66c66 service swift] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:35.295823 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1e4a9-b243-41b7-a852-9949fbb66c66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:35.297586 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-24e1e4a9-b243-41b7-a852-9949fbb66c66 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:35.346870 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b27309b2-0801-44c7-a399-fba7e37dd966 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b895d9e0ea654bc0bf2f35a27f097b7e', 'request_id': 'req-b27309b2-0801-44c7-a399-fba7e37dd966'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:35.377476 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1e4a9-b243-41b7-a852-9949fbb66c66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:35.379003 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1e4a9-b243-41b7-a852-9949fbb66c66 service swift] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:35.388265 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 858/1702] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jan 5 14:59:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 14:59:35.389713 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800058da-282b-48a0-839c-9cfa89376929 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:35.390563 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800058da-282b-48a0-839c-9cfa89376929 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:35.390802 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800058da-282b-48a0-839c-9cfa89376929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:35.397401 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b27309b2-0801-44c7-a399-fba7e37dd966 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b895d9e0ea654bc0bf2f35a27f097b7e', 'request_id': 'req-b27309b2-0801-44c7-a399-fba7e37dd966'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:35.423439 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-800058da-282b-48a0-839c-9cfa89376929 None None] MFA Rules not processed for user `2de1d8ec06134669a4db8ca248feceae`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:35.424764 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-800058da-282b-48a0-839c-9cfa89376929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:35.486446 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b27309b2-0801-44c7-a399-fba7e37dd966 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b895d9e0ea654bc0bf2f35a27f097b7e', 'request_id': 'req-b27309b2-0801-44c7-a399-fba7e37dd966'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:35.524039 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b27309b2-0801-44c7-a399-fba7e37dd966 admin admin] The token cache is being invalidate because project b895d9e0ea654bc0bf2f35a27f097b7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 14:59:35.524335 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b27309b2-0801-44c7-a399-fba7e37dd966 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:35.534524 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b27309b2-0801-44c7-a399-fba7e37dd966 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:35.541294 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 845/1703] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 14:59:35 2022] DELETE /identity/v3/projects/b895d9e0ea654bc0bf2f35a27f097b7e => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:35.551259 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27309b2-0801-44c7-a399-fba7e37dd966 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:35.559477 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-b27309b2-0801-44c7-a399-fba7e37dd966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:35.602485 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 859/1704] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:35.610425 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800058da-282b-48a0-839c-9cfa89376929 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:35.615212 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-800058da-282b-48a0-839c-9cfa89376929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:35.782029 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800058da-282b-48a0-839c-9cfa89376929 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:35.789706 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f9558-af69-47f4-8e5d-f95101597fe9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:35.790696 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f9558-af69-47f4-8e5d-f95101597fe9 service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:35.791055 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f9558-af69-47f4-8e5d-f95101597fe9 service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:35.791329 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f9558-af69-47f4-8e5d-f95101597fe9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:35.794571 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-002f9558-af69-47f4-8e5d-f95101597fe9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:35.795076 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27309b2-0801-44c7-a399-fba7e37dd966 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:35.805565 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d673e8-6a6f-459e-8ea7-25de461b95e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:35.808435 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d673e8-6a6f-459e-8ea7-25de461b95e0 service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:35.808435 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d673e8-6a6f-459e-8ea7-25de461b95e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:35.808435 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d673e8-6a6f-459e-8ea7-25de461b95e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:35.816390 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-98d673e8-6a6f-459e-8ea7-25de461b95e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:35.943108 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f9558-af69-47f4-8e5d-f95101597fe9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:35.944153 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f9558-af69-47f4-8e5d-f95101597fe9 service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:35.961852 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 860/1705] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:35 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:59:35.963936 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434affd7-96e3-4159-a44c-71fafe86bd76 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:35.964253 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434affd7-96e3-4159-a44c-71fafe86bd76 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:35.964531 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434affd7-96e3-4159-a44c-71fafe86bd76 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:35.966738 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 861/1706] 10.222.0.30 () {54 vars in 912 bytes} [Wed Jan 5 14:59:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:59:35.967545 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434affd7-96e3-4159-a44c-71fafe86bd76 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:35.969759 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-434affd7-96e3-4159-a44c-71fafe86bd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:36.011458 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d673e8-6a6f-459e-8ea7-25de461b95e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:36.013666 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d673e8-6a6f-459e-8ea7-25de461b95e0 service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:36.036612 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 846/1707] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:59:36.037286 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d673e8-6a6f-459e-8ea7-25de461b95e0 service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:36.043255 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-98d673e8-6a6f-459e-8ea7-25de461b95e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:36.293300 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434affd7-96e3-4159-a44c-71fafe86bd76 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:36.317204 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996b12a-1ea8-41c8-9fd3-82baa8c698d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:36.323128 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996b12a-1ea8-41c8-9fd3-82baa8c698d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:36.323552 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996b12a-1ea8-41c8-9fd3-82baa8c698d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:36.323660 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996b12a-1ea8-41c8-9fd3-82baa8c698d0 admin admin] PATH_INFO: `/v3/users/77ed20259361480283e33a3f4c38be3c` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:36.329059 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996b12a-1ea8-41c8-9fd3-82baa8c698d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77ed20259361480283e33a3f4c38be3c)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:36.345154 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d673e8-6a6f-459e-8ea7-25de461b95e0 service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:36.370855 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996b12a-1ea8-41c8-9fd3-82baa8c698d0 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:36.378027 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf9053-8865-4823-873d-3030036c3ba1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:36.380508 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf9053-8865-4823-873d-3030036c3ba1 service nova] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:36.381455 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf9053-8865-4823-873d-3030036c3ba1 service nova] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:36.381942 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf9053-8865-4823-873d-3030036c3ba1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:36.419964 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf9053-8865-4823-873d-3030036c3ba1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:36.424906 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf9053-8865-4823-873d-3030036c3ba1 service nova] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:36.462821 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 847/1708] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:59:36.473958 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda3168-ab1f-4947-a2b0-a16cde1c6162 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:36.473958 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda3168-ab1f-4947-a2b0-a16cde1c6162 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:36.473958 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda3168-ab1f-4947-a2b0-a16cde1c6162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:36.525666 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-fcda3168-ab1f-4947-a2b0-a16cde1c6162 None None] MFA Rules not processed for user `a6234d716a014808a8a4eb22b903bbc9`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:36.530488 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-fcda3168-ab1f-4947-a2b0-a16cde1c6162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:36.583237 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 848/1709] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Jan 5 14:59:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:36.584754 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda3168-ab1f-4947-a2b0-a16cde1c6162 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:36.591969 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-fcda3168-ab1f-4947-a2b0-a16cde1c6162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:36.653815 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda3168-ab1f-4947-a2b0-a16cde1c6162 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:36.671290 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5667b33-4e85-462f-950a-070207fc6d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:36.698479 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-d996b12a-1ea8-41c8-9fd3-82baa8c698d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77ed20259361480283e33a3f4c38be3c'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:36.699787 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5667b33-4e85-462f-950a-070207fc6d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:36.700632 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5667b33-4e85-462f-950a-070207fc6d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:36.705818 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5667b33-4e85-462f-950a-070207fc6d65 admin admin] PATH_INFO: `/v3/users/daec324ae1924d4690258ce6fc82bc13` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:36.709340 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5667b33-4e85-462f-950a-070207fc6d65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daec324ae1924d4690258ce6fc82bc13)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:36.722120 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-d996b12a-1ea8-41c8-9fd3-82baa8c698d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77ed20259361480283e33a3f4c38be3c'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:36.725168 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5667b33-4e85-462f-950a-070207fc6d65 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:36.729306 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-d996b12a-1ea8-41c8-9fd3-82baa8c698d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77ed20259361480283e33a3f4c38be3c'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:36.960944 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-d996b12a-1ea8-41c8-9fd3-82baa8c698d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77ed20259361480283e33a3f4c38be3c'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:36.985355 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-d996b12a-1ea8-41c8-9fd3-82baa8c698d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77ed20259361480283e33a3f4c38be3c'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:37.012801 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 862/1710] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 14:59:35 2022] DELETE /identity/v3/users/77ed20259361480283e33a3f4c38be3c => generated 0 bytes in 1046 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:37.016305 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996b12a-1ea8-41c8-9fd3-82baa8c698d0 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:37.022497 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-d996b12a-1ea8-41c8-9fd3-82baa8c698d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:37.111830 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-e5667b33-4e85-462f-950a-070207fc6d65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daec324ae1924d4690258ce6fc82bc13'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:37.174415 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-e5667b33-4e85-462f-950a-070207fc6d65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daec324ae1924d4690258ce6fc82bc13'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:37.174415 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-e5667b33-4e85-462f-950a-070207fc6d65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daec324ae1924d4690258ce6fc82bc13'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:37.174415 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-e5667b33-4e85-462f-950a-070207fc6d65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daec324ae1924d4690258ce6fc82bc13'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:37.279735 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996b12a-1ea8-41c8-9fd3-82baa8c698d0 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:37.287049 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d12089-61cc-4655-aaae-14e3823d955b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:37.287049 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d12089-61cc-4655-aaae-14e3823d955b service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:37.287049 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d12089-61cc-4655-aaae-14e3823d955b service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:37.287049 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d12089-61cc-4655-aaae-14e3823d955b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:37.305880 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-e5667b33-4e85-462f-950a-070207fc6d65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daec324ae1924d4690258ce6fc82bc13'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:37.314307 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-d8d12089-61cc-4655-aaae-14e3823d955b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:37.338167 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d12089-61cc-4655-aaae-14e3823d955b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:37.339660 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d12089-61cc-4655-aaae-14e3823d955b service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:37.350583 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 849/1711] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 14:59:36 2022] DELETE /identity/v3/users/daec324ae1924d4690258ce6fc82bc13 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:37.350583 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5667b33-4e85-462f-950a-070207fc6d65 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:37.353362 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-e5667b33-4e85-462f-950a-070207fc6d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:37.381715 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 863/1712] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:59:37.383410 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907919ed-c2a9-45bd-ae0a-289faae21a15 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:37.384134 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907919ed-c2a9-45bd-ae0a-289faae21a15 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:37.384681 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907919ed-c2a9-45bd-ae0a-289faae21a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:37.411984 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-907919ed-c2a9-45bd-ae0a-289faae21a15 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:37.413937 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-907919ed-c2a9-45bd-ae0a-289faae21a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:37.577013 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5667b33-4e85-462f-950a-070207fc6d65 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:37.593051 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 864/1713] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:37.598668 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929a03e-f238-47e6-aee6-702c06aaa9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:37.602317 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929a03e-f238-47e6-aee6-702c06aaa9b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:37.602317 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929a03e-f238-47e6-aee6-702c06aaa9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:37.602317 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929a03e-f238-47e6-aee6-702c06aaa9b1 admin admin] PATH_INFO: `/v3/users/3b20ad7c70664d418abfb770a85d8a4a` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:37.603360 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929a03e-f238-47e6-aee6-702c06aaa9b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b20ad7c70664d418abfb770a85d8a4a)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:37.607969 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929a03e-f238-47e6-aee6-702c06aaa9b1 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:37.614143 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907919ed-c2a9-45bd-ae0a-289faae21a15 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:37.615710 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-907919ed-c2a9-45bd-ae0a-289faae21a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:37.637773 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907919ed-c2a9-45bd-ae0a-289faae21a15 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:37.645588 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47109852-4447-4ae8-8a34-0c7dba0cfc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:37.646728 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47109852-4447-4ae8-8a34-0c7dba0cfc0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:37.647059 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47109852-4447-4ae8-8a34-0c7dba0cfc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:37.647703 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47109852-4447-4ae8-8a34-0c7dba0cfc0f admin admin] PATH_INFO: `/v3/projects/6ace62f50516457cafc0b284bac70247` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:37.649425 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47109852-4447-4ae8-8a34-0c7dba0cfc0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ace62f50516457cafc0b284bac70247)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:37.653631 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47109852-4447-4ae8-8a34-0c7dba0cfc0f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:37.898844 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-47109852-4447-4ae8-8a34-0c7dba0cfc0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ace62f50516457cafc0b284bac70247', 'request_id': 'req-47109852-4447-4ae8-8a34-0c7dba0cfc0f'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:37.904983 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-c929a03e-f238-47e6-aee6-702c06aaa9b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b20ad7c70664d418abfb770a85d8a4a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:37.938071 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-47109852-4447-4ae8-8a34-0c7dba0cfc0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ace62f50516457cafc0b284bac70247', 'request_id': 'req-47109852-4447-4ae8-8a34-0c7dba0cfc0f'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:37.971766 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-47109852-4447-4ae8-8a34-0c7dba0cfc0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ace62f50516457cafc0b284bac70247', 'request_id': 'req-47109852-4447-4ae8-8a34-0c7dba0cfc0f'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:37.996987 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-c929a03e-f238-47e6-aee6-702c06aaa9b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b20ad7c70664d418abfb770a85d8a4a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:38.002875 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-c929a03e-f238-47e6-aee6-702c06aaa9b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b20ad7c70664d418abfb770a85d8a4a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:38.002875 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-c929a03e-f238-47e6-aee6-702c06aaa9b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b20ad7c70664d418abfb770a85d8a4a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:38.317922 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-47109852-4447-4ae8-8a34-0c7dba0cfc0f admin admin] The token cache is being invalidate because project 6ace62f50516457cafc0b284bac70247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 14:59:38.317922 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-47109852-4447-4ae8-8a34-0c7dba0cfc0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:38.318498 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-47109852-4447-4ae8-8a34-0c7dba0cfc0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:38.324538 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 865/1714] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 14:59:37 2022] DELETE /identity/v3/projects/6ace62f50516457cafc0b284bac70247 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:38.325516 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47109852-4447-4ae8-8a34-0c7dba0cfc0f admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:38.326953 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-47109852-4447-4ae8-8a34-0c7dba0cfc0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:38.428475 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-c929a03e-f238-47e6-aee6-702c06aaa9b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b20ad7c70664d418abfb770a85d8a4a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:38.498160 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 850/1715] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 14:59:37 2022] DELETE /identity/v3/users/3b20ad7c70664d418abfb770a85d8a4a => generated 0 bytes in 1150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:38.500942 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90777a25-cfa7-4994-b335-439bb977d98a None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:38.503332 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47109852-4447-4ae8-8a34-0c7dba0cfc0f admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:38.503877 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90777a25-cfa7-4994-b335-439bb977d98a None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:38.506327 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90777a25-cfa7-4994-b335-439bb977d98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:38.563629 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-90777a25-cfa7-4994-b335-439bb977d98a None None] MFA Rules not processed for user `a6234d716a014808a8a4eb22b903bbc9`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:38.568752 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-90777a25-cfa7-4994-b335-439bb977d98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:38.682957 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7617060-cb11-46a3-93ab-b62467fe43bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:38.683559 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7617060-cb11-46a3-93ab-b62467fe43bb service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:38.684024 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7617060-cb11-46a3-93ab-b62467fe43bb service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:38.684145 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7617060-cb11-46a3-93ab-b62467fe43bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:38.686157 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-f7617060-cb11-46a3-93ab-b62467fe43bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:38.709578 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 851/1716] 10.222.0.13 () {58 vars in 1015 bytes} [Wed Jan 5 14:59:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:38.712634 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80f3f0-8dfe-4969-b0db-364d03bab8bf None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:38.715193 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80f3f0-8dfe-4969-b0db-364d03bab8bf None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:38.716253 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80f3f0-8dfe-4969-b0db-364d03bab8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:38.789665 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-3e80f3f0-8dfe-4969-b0db-364d03bab8bf None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:38.795447 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-3e80f3f0-8dfe-4969-b0db-364d03bab8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:38.897831 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7617060-cb11-46a3-93ab-b62467fe43bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:38.900783 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7617060-cb11-46a3-93ab-b62467fe43bb service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:38.963695 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 866/1717] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:59:38.970635 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7617060-cb11-46a3-93ab-b62467fe43bb service neutron] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:38.970635 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-f7617060-cb11-46a3-93ab-b62467fe43bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:39.003970 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 852/1718] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:39.005882 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00941ba-4725-4586-bdcf-c5027e1bdc00 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:39.006396 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00941ba-4725-4586-bdcf-c5027e1bdc00 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:39.006847 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00941ba-4725-4586-bdcf-c5027e1bdc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:39.037930 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7617060-cb11-46a3-93ab-b62467fe43bb service neutron] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:39.064778 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede20ec0-c4cc-4363-ab8b-ad3fa95c0f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:39.066083 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede20ec0-c4cc-4363-ab8b-ad3fa95c0f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:39.069481 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede20ec0-c4cc-4363-ab8b-ad3fa95c0f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:39.074207 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede20ec0-c4cc-4363-ab8b-ad3fa95c0f7d admin admin] PATH_INFO: `/v3/projects/94e0c100c2dd40cf958e4b1ca8ee33be` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:39.077116 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede20ec0-c4cc-4363-ab8b-ad3fa95c0f7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=94e0c100c2dd40cf958e4b1ca8ee33be)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:39.081723 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede20ec0-c4cc-4363-ab8b-ad3fa95c0f7d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:39.082090 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-c00941ba-4725-4586-bdcf-c5027e1bdc00 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:39.083722 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-c00941ba-4725-4586-bdcf-c5027e1bdc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:39.166304 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 853/1719] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:39.167310 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00941ba-4725-4586-bdcf-c5027e1bdc00 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:39.210901 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00941ba-4725-4586-bdcf-c5027e1bdc00 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:39.229086 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a73ef5-f5a7-48b3-afff-b4c8ca93a22a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:39.231967 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a73ef5-f5a7-48b3-afff-b4c8ca93a22a service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:39.234013 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a73ef5-f5a7-48b3-afff-b4c8ca93a22a service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:39.234331 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a73ef5-f5a7-48b3-afff-b4c8ca93a22a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:39.275180 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a73ef5-f5a7-48b3-afff-b4c8ca93a22a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:39.281736 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a73ef5-f5a7-48b3-afff-b4c8ca93a22a service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:39.295594 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 854/1720] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:59:39.297701 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da3aa7-1a37-4627-be0d-220f7ceb49a4 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:39.298293 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da3aa7-1a37-4627-be0d-220f7ceb49a4 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:39.298887 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da3aa7-1a37-4627-be0d-220f7ceb49a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:39.356895 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-a6da3aa7-1a37-4627-be0d-220f7ceb49a4 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:39.358573 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-a6da3aa7-1a37-4627-be0d-220f7ceb49a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:39.369136 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 855/1721] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:39.370487 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a21293-6108-420a-a9e4-aab27dfc9712 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:39.370818 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a21293-6108-420a-a9e4-aab27dfc9712 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:39.371066 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a21293-6108-420a-a9e4-aab27dfc9712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:39.471452 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-75a21293-6108-420a-a9e4-aab27dfc9712 None None] MFA Rules not processed for user `4295ba06618a45988ebeb45a82230bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:39.477395 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-75a21293-6108-420a-a9e4-aab27dfc9712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:39.561585 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ede20ec0-c4cc-4363-ab8b-ad3fa95c0f7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94e0c100c2dd40cf958e4b1ca8ee33be', 'request_id': 'req-ede20ec0-c4cc-4363-ab8b-ad3fa95c0f7d'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:39.580815 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ede20ec0-c4cc-4363-ab8b-ad3fa95c0f7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94e0c100c2dd40cf958e4b1ca8ee33be', 'request_id': 'req-ede20ec0-c4cc-4363-ab8b-ad3fa95c0f7d'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:39.604583 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ede20ec0-c4cc-4363-ab8b-ad3fa95c0f7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94e0c100c2dd40cf958e4b1ca8ee33be', 'request_id': 'req-ede20ec0-c4cc-4363-ab8b-ad3fa95c0f7d'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:39.717798 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ede20ec0-c4cc-4363-ab8b-ad3fa95c0f7d admin admin] The token cache is being invalidate because project 94e0c100c2dd40cf958e4b1ca8ee33be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 14:59:39.718137 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ede20ec0-c4cc-4363-ab8b-ad3fa95c0f7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:39.721135 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ede20ec0-c4cc-4363-ab8b-ad3fa95c0f7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:39.723504 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 867/1722] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 14:59:38 2022] DELETE /identity/v3/projects/94e0c100c2dd40cf958e4b1ca8ee33be => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:39.729400 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede20ec0-c4cc-4363-ab8b-ad3fa95c0f7d admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:39.742617 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-ede20ec0-c4cc-4363-ab8b-ad3fa95c0f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:39.754598 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 856/1723] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:39.757664 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a21293-6108-420a-a9e4-aab27dfc9712 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:39.762160 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-75a21293-6108-420a-a9e4-aab27dfc9712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:39.952934 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede20ec0-c4cc-4363-ab8b-ad3fa95c0f7d admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:39.963931 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f8b04-68ee-474c-bb23-c3eb42f08ca6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:39.964681 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f8b04-68ee-474c-bb23-c3eb42f08ca6 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:39.964834 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f8b04-68ee-474c-bb23-c3eb42f08ca6 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:39.965452 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f8b04-68ee-474c-bb23-c3eb42f08ca6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:39.967374 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a21293-6108-420a-a9e4-aab27dfc9712 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:39.970778 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-9f2f8b04-68ee-474c-bb23-c3eb42f08ca6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:39.987414 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f4ef1-0cf2-4b8d-972a-89aa692797b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:39.988092 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f4ef1-0cf2-4b8d-972a-89aa692797b0 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:39.988398 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f4ef1-0cf2-4b8d-972a-89aa692797b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:39.988659 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f4ef1-0cf2-4b8d-972a-89aa692797b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:39.989795 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f4ef1-0cf2-4b8d-972a-89aa692797b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:59:39.990277 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f4ef1-0cf2-4b8d-972a-89aa692797b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:39.992536 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f4ef1-0cf2-4b8d-972a-89aa692797b0 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:40.015987 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f8b04-68ee-474c-bb23-c3eb42f08ca6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:40.018099 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f8b04-68ee-474c-bb23-c3eb42f08ca6 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:40.025946 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 857/1724] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 14:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:59:40.027472 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1336c-a58c-46e7-ba13-52995a2b19a4 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:40.027774 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1336c-a58c-46e7-ba13-52995a2b19a4 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:40.028048 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1336c-a58c-46e7-ba13-52995a2b19a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:40.033937 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 868/1725] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:59:40.117789 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-cbb1336c-a58c-46e7-ba13-52995a2b19a4 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:40.117789 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-cbb1336c-a58c-46e7-ba13-52995a2b19a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:40.117789 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 858/1726] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:40.123203 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f8b04-68ee-474c-bb23-c3eb42f08ca6 service neutron] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:40.143633 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f8b04-68ee-474c-bb23-c3eb42f08ca6 service neutron] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:40.156128 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b9753-08fa-4773-8d90-902a14598c02 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:40.156417 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b9753-08fa-4773-8d90-902a14598c02 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:40.161274 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b9753-08fa-4773-8d90-902a14598c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:40.175748 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34118e-a75b-47c8-9dc9-344607b064fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:40.176638 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34118e-a75b-47c8-9dc9-344607b064fb admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:40.176931 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34118e-a75b-47c8-9dc9-344607b064fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:40.177282 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34118e-a75b-47c8-9dc9-344607b064fb admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:40.178335 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34118e-a75b-47c8-9dc9-344607b064fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:40.180652 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34118e-a75b-47c8-9dc9-344607b064fb admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:40.228662 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-fe7b9753-08fa-4773-8d90-902a14598c02 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:40.230455 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-fe7b9753-08fa-4773-8d90-902a14598c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:40.242647 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 859/1727] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:40.253766 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b9753-08fa-4773-8d90-902a14598c02 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:40.275777 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b9753-08fa-4773-8d90-902a14598c02 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:40.304936 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3e678-7fdb-457a-9ee6-2d71e2c45cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:40.310243 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3e678-7fdb-457a-9ee6-2d71e2c45cda admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:40.312312 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3e678-7fdb-457a-9ee6-2d71e2c45cda admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:40.313520 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3e678-7fdb-457a-9ee6-2d71e2c45cda admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:40.314456 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3e678-7fdb-457a-9ee6-2d71e2c45cda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:59:40.316342 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3e678-7fdb-457a-9ee6-2d71e2c45cda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:40.322399 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3e678-7fdb-457a-9ee6-2d71e2c45cda admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:40.355213 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 860/1728] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 14:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:59:40.362128 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3e678-7fdb-457a-9ee6-2d71e2c45cda admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:40.378029 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 869/1729] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 14:59:40 2022] POST /identity/v3/projects => generated 365 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 14:59:40.385590 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34118e-a75b-47c8-9dc9-344607b064fb admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:40.406708 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3e678-7fdb-457a-9ee6-2d71e2c45cda admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:40.623359 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b453897-72bb-4288-b543-30c8e5cd5ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:40.625627 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b453897-72bb-4288-b543-30c8e5cd5ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:40.626241 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b453897-72bb-4288-b543-30c8e5cd5ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:40.626711 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b453897-72bb-4288-b543-30c8e5cd5ce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:40.778421 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b453897-72bb-4288-b543-30c8e5cd5ce9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:40.778421 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b453897-72bb-4288-b543-30c8e5cd5ce9 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:40.781368 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34118e-a75b-47c8-9dc9-344607b064fb admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:40.781368 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc67573-cd3d-4814-82af-4d2a4e5eee1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:40.781368 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc67573-cd3d-4814-82af-4d2a4e5eee1e admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:40.781368 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc67573-cd3d-4814-82af-4d2a4e5eee1e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:40.783004 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc67573-cd3d-4814-82af-4d2a4e5eee1e admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:40.783004 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc67573-cd3d-4814-82af-4d2a4e5eee1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:40.783004 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc67573-cd3d-4814-82af-4d2a4e5eee1e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:40.997996 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 870/1730] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 14:59:40 2022] POST /identity/v3/users => generated 283 bytes in 617 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:41.002956 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc67573-cd3d-4814-82af-4d2a4e5eee1e admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:41.008485 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 861/1731] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 14:59:40 2022] POST /identity/v3/projects => generated 373 bytes in 647 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:41.011969 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b453897-72bb-4288-b543-30c8e5cd5ce9 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:41.038832 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc67573-cd3d-4814-82af-4d2a4e5eee1e admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:41.228378 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b453897-72bb-4288-b543-30c8e5cd5ce9 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:41.266271 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce518b5f-5ebe-47af-b2ae-a49ad17ba163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:41.267501 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce518b5f-5ebe-47af-b2ae-a49ad17ba163 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:41.267949 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce518b5f-5ebe-47af-b2ae-a49ad17ba163 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:41.268383 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce518b5f-5ebe-47af-b2ae-a49ad17ba163 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:41.269284 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce518b5f-5ebe-47af-b2ae-a49ad17ba163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:41.271533 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce518b5f-5ebe-47af-b2ae-a49ad17ba163 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:41.280099 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227be74-0f13-4a37-bc51-19e966cf900c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:41.281347 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227be74-0f13-4a37-bc51-19e966cf900c admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:41.281638 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227be74-0f13-4a37-bc51-19e966cf900c admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:41.281914 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227be74-0f13-4a37-bc51-19e966cf900c admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:41.282668 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b227be74-0f13-4a37-bc51-19e966cf900c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:41.284322 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b227be74-0f13-4a37-bc51-19e966cf900c admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:41.320620 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 871/1732] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:41.326676 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227be74-0f13-4a37-bc51-19e966cf900c admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:41.349846 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227be74-0f13-4a37-bc51-19e966cf900c admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:41.362173 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150f6ec-8115-4164-a741-a4efc6b7b3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:41.363240 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150f6ec-8115-4164-a741-a4efc6b7b3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:41.363758 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150f6ec-8115-4164-a741-a4efc6b7b3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:41.364306 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150f6ec-8115-4164-a741-a4efc6b7b3c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:41.365452 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150f6ec-8115-4164-a741-a4efc6b7b3c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:41.370644 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150f6ec-8115-4164-a741-a4efc6b7b3c9 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:41.386104 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 862/1733] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 14:59:41 2022] POST /identity/v3/users => generated 287 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:41.391233 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce518b5f-5ebe-47af-b2ae-a49ad17ba163 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:41.397479 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 872/1734] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:41.407915 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150f6ec-8115-4164-a741-a4efc6b7b3c9 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:41.430652 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce518b5f-5ebe-47af-b2ae-a49ad17ba163 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:41.432235 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150f6ec-8115-4164-a741-a4efc6b7b3c9 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:41.443079 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48320c-b04e-41cd-a162-733c72e575a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:41.444289 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48320c-b04e-41cd-a162-733c72e575a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:41.444794 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48320c-b04e-41cd-a162-733c72e575a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:41.445318 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48320c-b04e-41cd-a162-733c72e575a5 admin admin] PATH_INFO: `/v3/projects/ecf16855511c4ec8a6d102b40f2f1d74/users/d4a98c1eb7ba49a1801a1a67f29c43f7/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:41.457180 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36b38b-3a13-48bd-ad44-e1f1962814fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:41.460965 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36b38b-3a13-48bd-ad44-e1f1962814fe admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:41.461323 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36b38b-3a13-48bd-ad44-e1f1962814fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:41.461613 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36b38b-3a13-48bd-ad44-e1f1962814fe admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:41.462405 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36b38b-3a13-48bd-ad44-e1f1962814fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:41.464085 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36b38b-3a13-48bd-ad44-e1f1962814fe admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:41.494573 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 863/1735] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:41.498254 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36b38b-3a13-48bd-ad44-e1f1962814fe admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:41.522433 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48320c-b04e-41cd-a162-733c72e575a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf16855511c4ec8a6d102b40f2f1d74, user_id=d4a98c1eb7ba49a1801a1a67f29c43f7, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:41.528636 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36b38b-3a13-48bd-ad44-e1f1962814fe admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:41.539006 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acabf97-c4d0-4cd6-a8fd-11450de8db6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:41.542221 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acabf97-c4d0-4cd6-a8fd-11450de8db6b admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:41.542691 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acabf97-c4d0-4cd6-a8fd-11450de8db6b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:41.543126 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acabf97-c4d0-4cd6-a8fd-11450de8db6b admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:41.544059 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acabf97-c4d0-4cd6-a8fd-11450de8db6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:41.555392 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acabf97-c4d0-4cd6-a8fd-11450de8db6b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:41.560847 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48320c-b04e-41cd-a162-733c72e575a5 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:41.581606 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 864/1736] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:41.584884 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acabf97-c4d0-4cd6-a8fd-11450de8db6b admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:41.610175 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acabf97-c4d0-4cd6-a8fd-11450de8db6b admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:41.638797 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f6167-e659-45ae-b11d-c2530b8358d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:41.642209 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f6167-e659-45ae-b11d-c2530b8358d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:41.642843 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f6167-e659-45ae-b11d-c2530b8358d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:41.647700 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f6167-e659-45ae-b11d-c2530b8358d3 admin admin] PATH_INFO: `/v3/projects/b9b647a359ef4133b4a04e6309bfcf66/users/7086a7d0a79f4bc8aa184ed1e8ad3348/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:41.666983 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 873/1737] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 14:59:41 2022] PUT /identity/v3/projects/ecf16855511c4ec8a6d102b40f2f1d74/users/d4a98c1eb7ba49a1801a1a67f29c43f7/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:41.680654 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ac4ef-2711-476e-8e0e-0ce514a2eb8d None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:41.681186 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ac4ef-2711-476e-8e0e-0ce514a2eb8d None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:41.681690 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ac4ef-2711-476e-8e0e-0ce514a2eb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:41.699609 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f6167-e659-45ae-b11d-c2530b8358d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b647a359ef4133b4a04e6309bfcf66, user_id=7086a7d0a79f4bc8aa184ed1e8ad3348, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:41.707545 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f6167-e659-45ae-b11d-c2530b8358d3 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:41.783403 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-e16ac4ef-2711-476e-8e0e-0ce514a2eb8d None None] MFA Rules not processed for user `d4a98c1eb7ba49a1801a1a67f29c43f7`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:41.786606 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-e16ac4ef-2711-476e-8e0e-0ce514a2eb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:41.940115 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 874/1738] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 14:59:41.941846 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ac4ef-2711-476e-8e0e-0ce514a2eb8d None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:42.004427 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 865/1739] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 14:59:41 2022] PUT /identity/v3/projects/b9b647a359ef4133b4a04e6309bfcf66/users/7086a7d0a79f4bc8aa184ed1e8ad3348/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:42.014896 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d6676-c8d9-4abe-b049-88331b8cf3eb None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:42.015224 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d6676-c8d9-4abe-b049-88331b8cf3eb None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:42.015684 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d6676-c8d9-4abe-b049-88331b8cf3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:42.080341 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ac4ef-2711-476e-8e0e-0ce514a2eb8d None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:42.092964 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-ed9d6676-c8d9-4abe-b049-88331b8cf3eb None None] MFA Rules not processed for user `7086a7d0a79f4bc8aa184ed1e8ad3348`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:42.095089 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-ed9d6676-c8d9-4abe-b049-88331b8cf3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:42.269378 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 866/1740] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:42.282403 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d6676-c8d9-4abe-b049-88331b8cf3eb None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:42.294193 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa259c-a486-417c-a2e9-1b676f531ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:42.294783 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa259c-a486-417c-a2e9-1b676f531ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:42.295743 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa259c-a486-417c-a2e9-1b676f531ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:42.295916 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa259c-a486-417c-a2e9-1b676f531ef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:42.296942 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa259c-a486-417c-a2e9-1b676f531ef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:42.300246 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa259c-a486-417c-a2e9-1b676f531ef6 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:42.412304 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d6676-c8d9-4abe-b049-88331b8cf3eb None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:42.419775 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afcab1-052d-4ca0-aedf-9eed3e2a71d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:42.421786 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afcab1-052d-4ca0-aedf-9eed3e2a71d1 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:42.421786 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afcab1-052d-4ca0-aedf-9eed3e2a71d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:42.427173 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afcab1-052d-4ca0-aedf-9eed3e2a71d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:42.428063 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afcab1-052d-4ca0-aedf-9eed3e2a71d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:42.449020 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afcab1-052d-4ca0-aedf-9eed3e2a71d1 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:42.585877 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 875/1741] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 14:59:41 2022] POST /identity/v3/projects => generated 363 bytes in 645 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:42.586929 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa259c-a486-417c-a2e9-1b676f531ef6 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:42.611819 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 867/1742] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 14:59:42 2022] POST /identity/v3/projects => generated 371 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:42.612034 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-c7fa259c-a486-417c-a2e9-1b676f531ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:42.613493 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afcab1-052d-4ca0-aedf-9eed3e2a71d1 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:42.800117 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa259c-a486-417c-a2e9-1b676f531ef6 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:42.853861 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afcab1-052d-4ca0-aedf-9eed3e2a71d1 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:42.868130 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37552e9b-761f-431a-98f4-b54249b9fa6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:42.868879 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37552e9b-761f-431a-98f4-b54249b9fa6b admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:42.869258 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37552e9b-761f-431a-98f4-b54249b9fa6b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:42.869562 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37552e9b-761f-431a-98f4-b54249b9fa6b admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:42.870284 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37552e9b-761f-431a-98f4-b54249b9fa6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:42.872415 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37552e9b-761f-431a-98f4-b54249b9fa6b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:42.979013 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526f211-9508-4a7b-ace3-5a42a067fc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:42.981975 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526f211-9508-4a7b-ace3-5a42a067fc4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:42.982278 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526f211-9508-4a7b-ace3-5a42a067fc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:42.982624 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526f211-9508-4a7b-ace3-5a42a067fc4a admin admin] PATH_INFO: `/v3/projects/7c9351ecdd7d430d8c3ae7895011f66d` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:42.992687 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526f211-9508-4a7b-ace3-5a42a067fc4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c9351ecdd7d430d8c3ae7895011f66d)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:42.994801 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526f211-9508-4a7b-ace3-5a42a067fc4a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:43.333229 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-d526f211-9508-4a7b-ace3-5a42a067fc4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c9351ecdd7d430d8c3ae7895011f66d', 'request_id': 'req-d526f211-9508-4a7b-ace3-5a42a067fc4a'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:43.366168 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-d526f211-9508-4a7b-ace3-5a42a067fc4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c9351ecdd7d430d8c3ae7895011f66d', 'request_id': 'req-d526f211-9508-4a7b-ace3-5a42a067fc4a'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:43.379270 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-d526f211-9508-4a7b-ace3-5a42a067fc4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c9351ecdd7d430d8c3ae7895011f66d', 'request_id': 'req-d526f211-9508-4a7b-ace3-5a42a067fc4a'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:43.478175 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 868/1743] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 14:59:42 2022] POST /identity/v3/users => generated 288 bytes in 865 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:43.479012 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37552e9b-761f-431a-98f4-b54249b9fa6b admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:43.514735 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37552e9b-761f-431a-98f4-b54249b9fa6b admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:43.648249 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c806ba-99d5-42ca-910e-e1cb4669fc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:43.648986 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c806ba-99d5-42ca-910e-e1cb4669fc54 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:43.649619 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c806ba-99d5-42ca-910e-e1cb4669fc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:43.650131 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c806ba-99d5-42ca-910e-e1cb4669fc54 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:43.651115 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c806ba-99d5-42ca-910e-e1cb4669fc54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:43.653435 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c806ba-99d5-42ca-910e-e1cb4669fc54 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:43.690814 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-d526f211-9508-4a7b-ace3-5a42a067fc4a admin admin] The token cache is being invalidate because project 7c9351ecdd7d430d8c3ae7895011f66d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 14:59:43.691492 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-d526f211-9508-4a7b-ace3-5a42a067fc4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:43.692796 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-d526f211-9508-4a7b-ace3-5a42a067fc4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:43.696172 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 876/1744] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 14:59:42 2022] DELETE /identity/v3/projects/7c9351ecdd7d430d8c3ae7895011f66d => generated 0 bytes in 1110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:43.699554 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24607f9-7f4a-4bfc-a6ab-0f88c6aa26ac None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:43.701407 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24607f9-7f4a-4bfc-a6ab-0f88c6aa26ac None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:43.701786 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24607f9-7f4a-4bfc-a6ab-0f88c6aa26ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:43.793353 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-b24607f9-7f4a-4bfc-a6ab-0f88c6aa26ac None None] MFA Rules not processed for user `d43400b4646449ce94967ec5bab4eca1`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:43.794484 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 869/1745] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 14:59:43 2022] POST /identity/v3/users => generated 292 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:43.794725 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-b24607f9-7f4a-4bfc-a6ab-0f88c6aa26ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:43.795380 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c806ba-99d5-42ca-910e-e1cb4669fc54 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:43.802140 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-09c806ba-99d5-42ca-910e-e1cb4669fc54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:43.823401 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c806ba-99d5-42ca-910e-e1cb4669fc54 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:43.839728 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241a37b-c0fd-4a73-b149-27aebf4fe1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:43.840460 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241a37b-c0fd-4a73-b149-27aebf4fe1ff admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:43.840752 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241a37b-c0fd-4a73-b149-27aebf4fe1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:43.841075 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241a37b-c0fd-4a73-b149-27aebf4fe1ff admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:43.841851 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241a37b-c0fd-4a73-b149-27aebf4fe1ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:43.844096 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241a37b-c0fd-4a73-b149-27aebf4fe1ff admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:43.891377 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 870/1746] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:43.892455 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241a37b-c0fd-4a73-b149-27aebf4fe1ff admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:43.897351 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-1241a37b-c0fd-4a73-b149-27aebf4fe1ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:43.925332 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241a37b-c0fd-4a73-b149-27aebf4fe1ff admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:43.939803 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaeac21-77ad-4076-929e-3e5ae54db3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:43.940945 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaeac21-77ad-4076-929e-3e5ae54db3b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:43.941091 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaeac21-77ad-4076-929e-3e5ae54db3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:43.941302 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaeac21-77ad-4076-929e-3e5ae54db3b6 admin admin] PATH_INFO: `/v3/users/287c99118886405bb8e272139a0d4755` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:43.943052 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaeac21-77ad-4076-929e-3e5ae54db3b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=287c99118886405bb8e272139a0d4755)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:43.944553 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaeac21-77ad-4076-929e-3e5ae54db3b6 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:44.305407 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 877/1747] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:44.305407 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24607f9-7f4a-4bfc-a6ab-0f88c6aa26ac None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:44.305407 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-b24607f9-7f4a-4bfc-a6ab-0f88c6aa26ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:44.305407 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24607f9-7f4a-4bfc-a6ab-0f88c6aa26ac None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:44.310480 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c78e6-600f-4b67-9964-21fb1e898dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:44.310480 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c78e6-600f-4b67-9964-21fb1e898dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:44.310480 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c78e6-600f-4b67-9964-21fb1e898dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:44.310480 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c78e6-600f-4b67-9964-21fb1e898dbb admin admin] PATH_INFO: `/v3/projects/ea9610acf168459db6721420c43a17b4` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:44.311476 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c78e6-600f-4b67-9964-21fb1e898dbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea9610acf168459db6721420c43a17b4)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:44.311476 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c78e6-600f-4b67-9964-21fb1e898dbb admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:44.628556 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3aaeac21-77ad-4076-929e-3e5ae54db3b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '287c99118886405bb8e272139a0d4755'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:44.643380 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3aaeac21-77ad-4076-929e-3e5ae54db3b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '287c99118886405bb8e272139a0d4755'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:44.645583 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-021c78e6-600f-4b67-9964-21fb1e898dbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea9610acf168459db6721420c43a17b4', 'request_id': 'req-021c78e6-600f-4b67-9964-21fb1e898dbb'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:44.645832 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3aaeac21-77ad-4076-929e-3e5ae54db3b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '287c99118886405bb8e272139a0d4755'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:44.647181 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3aaeac21-77ad-4076-929e-3e5ae54db3b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '287c99118886405bb8e272139a0d4755'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:44.655304 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-021c78e6-600f-4b67-9964-21fb1e898dbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea9610acf168459db6721420c43a17b4', 'request_id': 'req-021c78e6-600f-4b67-9964-21fb1e898dbb'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:44.662484 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-021c78e6-600f-4b67-9964-21fb1e898dbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea9610acf168459db6721420c43a17b4', 'request_id': 'req-021c78e6-600f-4b67-9964-21fb1e898dbb'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:44.765692 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3aaeac21-77ad-4076-929e-3e5ae54db3b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '287c99118886405bb8e272139a0d4755'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:44.806037 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 871/1748] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 14:59:43 2022] DELETE /identity/v3/users/287c99118886405bb8e272139a0d4755 => generated 0 bytes in 911 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:44.807436 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaeac21-77ad-4076-929e-3e5ae54db3b6 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:44.811453 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-3aaeac21-77ad-4076-929e-3e5ae54db3b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:44.923834 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaeac21-77ad-4076-929e-3e5ae54db3b6 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:44.929548 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d77918-9a0c-40a2-b184-00b56a4f1a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:44.930544 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d77918-9a0c-40a2-b184-00b56a4f1a48 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:44.931038 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d77918-9a0c-40a2-b184-00b56a4f1a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:44.931520 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d77918-9a0c-40a2-b184-00b56a4f1a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:44.932481 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d77918-9a0c-40a2-b184-00b56a4f1a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:44.934358 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d77918-9a0c-40a2-b184-00b56a4f1a48 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:44.954068 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 872/1749] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:44.955916 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad69b5b-a747-4f76-9944-969cb2a61d54 None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:44.956423 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad69b5b-a747-4f76-9944-969cb2a61d54 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:44.956908 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad69b5b-a747-4f76-9944-969cb2a61d54 None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:44.958940 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 873/1750] 10.222.0.30 () {54 vars in 921 bytes} [Wed Jan 5 14:59:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:59:44.960029 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad69b5b-a747-4f76-9944-969cb2a61d54 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:44.962035 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-cad69b5b-a747-4f76-9944-969cb2a61d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:45.010038 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad69b5b-a747-4f76-9944-969cb2a61d54 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:45.028459 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98a47d-4406-4808-ad6a-360108b28855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:45.029663 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98a47d-4406-4808-ad6a-360108b28855 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:45.032860 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98a47d-4406-4808-ad6a-360108b28855 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:45.032860 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98a47d-4406-4808-ad6a-360108b28855 admin admin] PATH_INFO: `/v3/projects/699a163c4a354ae0afd7674bc0d1562c/users/d93b480fcf5343f5beb5844577f098a3/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:45.037400 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-021c78e6-600f-4b67-9964-21fb1e898dbb admin admin] The token cache is being invalidate because project ea9610acf168459db6721420c43a17b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 14:59:45.037929 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-021c78e6-600f-4b67-9964-21fb1e898dbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:45.039806 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-021c78e6-600f-4b67-9964-21fb1e898dbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:45.046962 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 878/1751] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 14:59:44 2022] DELETE /identity/v3/projects/ea9610acf168459db6721420c43a17b4 => generated 0 bytes in 937 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:45.048752 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c78e6-600f-4b67-9964-21fb1e898dbb admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:45.052237 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-021c78e6-600f-4b67-9964-21fb1e898dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:45.080110 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98a47d-4406-4808-ad6a-360108b28855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=699a163c4a354ae0afd7674bc0d1562c, user_id=d93b480fcf5343f5beb5844577f098a3, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:45.084107 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98a47d-4406-4808-ad6a-360108b28855 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:45.212019 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c78e6-600f-4b67-9964-21fb1e898dbb admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:45.335706 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b02e5a-b93f-4697-8726-a45979b78ade service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:45.336484 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b02e5a-b93f-4697-8726-a45979b78ade service nova] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:45.336730 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b02e5a-b93f-4697-8726-a45979b78ade service nova] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:45.337011 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b02e5a-b93f-4697-8726-a45979b78ade service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:45.339820 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-87b02e5a-b93f-4697-8726-a45979b78ade service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:45.387605 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 874/1752] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 14:59:44 2022] PUT /identity/v3/projects/699a163c4a354ae0afd7674bc0d1562c/users/d93b480fcf5343f5beb5844577f098a3/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:45.387605 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05c8b3-4529-4793-89b5-3801a4a5c946 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:45.387605 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05c8b3-4529-4793-89b5-3801a4a5c946 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:45.387605 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05c8b3-4529-4793-89b5-3801a4a5c946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:45.458286 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b02e5a-b93f-4697-8726-a45979b78ade service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:45.460144 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b02e5a-b93f-4697-8726-a45979b78ade service nova] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:45.470415 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-bd05c8b3-4529-4793-89b5-3801a4a5c946 None None] MFA Rules not processed for user `2de1d8ec06134669a4db8ca248feceae`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:45.473426 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-bd05c8b3-4529-4793-89b5-3801a4a5c946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:45.488458 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 879/1753] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:59:45.489423 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b02e5a-b93f-4697-8726-a45979b78ade service nova] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:45.492574 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-87b02e5a-b93f-4697-8726-a45979b78ade service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:45.523371 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b02e5a-b93f-4697-8726-a45979b78ade service nova] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:45.652057 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 875/1754] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:45.655384 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54948835-d20b-479f-8733-cd49dba00567 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:45.658418 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54948835-d20b-479f-8733-cd49dba00567 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:45.658418 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54948835-d20b-479f-8733-cd49dba00567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:45.701510 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46630e68-e99a-489f-bcde-76ded9d2cd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:45.703183 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46630e68-e99a-489f-bcde-76ded9d2cd08 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:45.703563 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46630e68-e99a-489f-bcde-76ded9d2cd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:45.706134 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46630e68-e99a-489f-bcde-76ded9d2cd08 admin admin] PATH_INFO: `/v3/projects/eac26a94175d43c6af67bb9748275a55/users/f5b6e874f2644fd8af4e947e010667df/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:45.743097 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46630e68-e99a-489f-bcde-76ded9d2cd08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eac26a94175d43c6af67bb9748275a55, user_id=f5b6e874f2644fd8af4e947e010667df, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:45.746140 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46630e68-e99a-489f-bcde-76ded9d2cd08 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:45.751037 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-54948835-d20b-479f-8733-cd49dba00567 None None] MFA Rules not processed for user `77db235e2f7046e4bdbad7f31b5e3ebc`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:45.763716 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-54948835-d20b-479f-8733-cd49dba00567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:45.862118 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 880/1755] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 14:59:45 2022] PUT /identity/v3/projects/eac26a94175d43c6af67bb9748275a55/users/f5b6e874f2644fd8af4e947e010667df/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:45.865532 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a302636-f410-45e3-bd8a-cbc094234299 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:45.867934 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a302636-f410-45e3-bd8a-cbc094234299 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:45.868371 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a302636-f410-45e3-bd8a-cbc094234299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:45.966680 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-2a302636-f410-45e3-bd8a-cbc094234299 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:45.973608 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-2a302636-f410-45e3-bd8a-cbc094234299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:46.129258 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 876/1756] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Jan 5 14:59:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:46.132299 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54948835-d20b-479f-8733-cd49dba00567 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:46.135307 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-54948835-d20b-479f-8733-cd49dba00567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:46.192037 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54948835-d20b-479f-8733-cd49dba00567 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:46.223391 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 881/1757] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:46.231206 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a302636-f410-45e3-bd8a-cbc094234299 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:46.239523 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-2a302636-f410-45e3-bd8a-cbc094234299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:46.268455 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a302636-f410-45e3-bd8a-cbc094234299 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:46.293734 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92cbb8e-0184-45dd-b332-81c329f8ed97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:46.294634 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cbb8e-0184-45dd-b332-81c329f8ed97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:46.295000 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cbb8e-0184-45dd-b332-81c329f8ed97 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:46.295282 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cbb8e-0184-45dd-b332-81c329f8ed97 admin admin] PATH_INFO: `/v3/projects/028a9f9aa13a4326a29c6545cb798a5c` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:46.302005 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92cbb8e-0184-45dd-b332-81c329f8ed97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=028a9f9aa13a4326a29c6545cb798a5c)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:46.306509 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92cbb8e-0184-45dd-b332-81c329f8ed97 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:46.365759 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e9978-9423-47df-89f4-5b5d63a516a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:46.368466 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e9978-9423-47df-89f4-5b5d63a516a6 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:46.370064 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e9978-9423-47df-89f4-5b5d63a516a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:46.372930 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e9978-9423-47df-89f4-5b5d63a516a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:46.372930 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e9978-9423-47df-89f4-5b5d63a516a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:46.378853 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e9978-9423-47df-89f4-5b5d63a516a6 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:46.407597 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 877/1758] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:46.410176 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e9978-9423-47df-89f4-5b5d63a516a6 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:46.618707 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e9978-9423-47df-89f4-5b5d63a516a6 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:46.618707 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa96ae-4eeb-49fd-a291-51cb7d7bcdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:46.618707 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa96ae-4eeb-49fd-a291-51cb7d7bcdde admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:46.618707 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa96ae-4eeb-49fd-a291-51cb7d7bcdde admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:46.621023 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa96ae-4eeb-49fd-a291-51cb7d7bcdde admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:46.621023 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa96ae-4eeb-49fd-a291-51cb7d7bcdde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:46.621023 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa96ae-4eeb-49fd-a291-51cb7d7bcdde admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:46.621023 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 878/1759] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:46.621023 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3048830-569e-45ec-895f-6425c12c297e None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:46.621023 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3048830-569e-45ec-895f-6425c12c297e None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:46.622207 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3048830-569e-45ec-895f-6425c12c297e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:46.622207 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-a3048830-569e-45ec-895f-6425c12c297e None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:46.622207 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-a3048830-569e-45ec-895f-6425c12c297e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:46.622207 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 879/1760] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:46.622207 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3048830-569e-45ec-895f-6425c12c297e None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:46.622207 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3048830-569e-45ec-895f-6425c12c297e None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:46.622752 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6bc32-65ac-4fa6-b555-50b4bdfa3589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:46.622752 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6bc32-65ac-4fa6-b555-50b4bdfa3589 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:46.622752 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6bc32-65ac-4fa6-b555-50b4bdfa3589 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:46.622752 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6bc32-65ac-4fa6-b555-50b4bdfa3589 admin admin] PATH_INFO: `/v3/projects/699a163c4a354ae0afd7674bc0d1562c/users/d93b480fcf5343f5beb5844577f098a3/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:46.623220 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6bc32-65ac-4fa6-b555-50b4bdfa3589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=699a163c4a354ae0afd7674bc0d1562c, user_id=d93b480fcf5343f5beb5844577f098a3, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:46.623220 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6bc32-65ac-4fa6-b555-50b4bdfa3589 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:46.623220 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 880/1761] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 14:59:46 2022] PUT /identity/v3/projects/699a163c4a354ae0afd7674bc0d1562c/users/d93b480fcf5343f5beb5844577f098a3/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:46.633147 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6bc32-65ac-4fa6-b555-50b4bdfa3589 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:46.744491 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6bc32-65ac-4fa6-b555-50b4bdfa3589 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:46.754678 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904ddd9-2db8-4f37-89f3-b9eda89e816c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:46.757715 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904ddd9-2db8-4f37-89f3-b9eda89e816c admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:46.758099 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904ddd9-2db8-4f37-89f3-b9eda89e816c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:46.758494 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904ddd9-2db8-4f37-89f3-b9eda89e816c admin admin] PATH_INFO: `/v3/projects/eac26a94175d43c6af67bb9748275a55/users/f5b6e874f2644fd8af4e947e010667df/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:46.763087 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904ddd9-2db8-4f37-89f3-b9eda89e816c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eac26a94175d43c6af67bb9748275a55, user_id=f5b6e874f2644fd8af4e947e010667df, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:46.775399 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904ddd9-2db8-4f37-89f3-b9eda89e816c admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:46.776487 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e92cbb8e-0184-45dd-b332-81c329f8ed97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '028a9f9aa13a4326a29c6545cb798a5c', 'request_id': 'req-e92cbb8e-0184-45dd-b332-81c329f8ed97'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:46.793500 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e92cbb8e-0184-45dd-b332-81c329f8ed97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '028a9f9aa13a4326a29c6545cb798a5c', 'request_id': 'req-e92cbb8e-0184-45dd-b332-81c329f8ed97'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:46.806716 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e92cbb8e-0184-45dd-b332-81c329f8ed97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '028a9f9aa13a4326a29c6545cb798a5c', 'request_id': 'req-e92cbb8e-0184-45dd-b332-81c329f8ed97'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:46.816474 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 881/1762] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 14:59:46 2022] PUT /identity/v3/projects/eac26a94175d43c6af67bb9748275a55/users/f5b6e874f2644fd8af4e947e010667df/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:46.830471 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904ddd9-2db8-4f37-89f3-b9eda89e816c admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:47.031214 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904ddd9-2db8-4f37-89f3-b9eda89e816c admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:47.049202 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce75255-6198-4290-a3f7-dbd8d7583721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:47.050299 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce75255-6198-4290-a3f7-dbd8d7583721 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:47.050588 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce75255-6198-4290-a3f7-dbd8d7583721 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:47.050867 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce75255-6198-4290-a3f7-dbd8d7583721 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:47.051625 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce75255-6198-4290-a3f7-dbd8d7583721 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:59:47.052158 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce75255-6198-4290-a3f7-dbd8d7583721 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:47.053860 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce75255-6198-4290-a3f7-dbd8d7583721 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:47.083342 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 882/1763] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 14:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:59:47.085927 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78963ff8-3904-4d05-a5c9-751e71260a3e None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:47.086587 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78963ff8-3904-4d05-a5c9-751e71260a3e None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:47.086894 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78963ff8-3904-4d05-a5c9-751e71260a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:47.144140 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e92cbb8e-0184-45dd-b332-81c329f8ed97 admin admin] The token cache is being invalidate because project 028a9f9aa13a4326a29c6545cb798a5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 14:59:47.144682 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e92cbb8e-0184-45dd-b332-81c329f8ed97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:47.147514 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e92cbb8e-0184-45dd-b332-81c329f8ed97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 14:59:47.149800 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 882/1764] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 14:59:46 2022] DELETE /identity/v3/projects/028a9f9aa13a4326a29c6545cb798a5c => generated 0 bytes in 926 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:47.151267 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31261a-5dfb-4fd1-b71f-6af049066224 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:47.151714 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31261a-5dfb-4fd1-b71f-6af049066224 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:47.152186 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31261a-5dfb-4fd1-b71f-6af049066224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:47.161669 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-78963ff8-3904-4d05-a5c9-751e71260a3e None None] MFA Rules not processed for user `d93b480fcf5343f5beb5844577f098a3`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:47.164561 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-78963ff8-3904-4d05-a5c9-751e71260a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:47.238156 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-ac31261a-5dfb-4fd1-b71f-6af049066224 None None] MFA Rules not processed for user `f5b6e874f2644fd8af4e947e010667df`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:47.239408 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-ac31261a-5dfb-4fd1-b71f-6af049066224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:47.428194 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 883/1765] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:47 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:47.430678 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31261a-5dfb-4fd1-b71f-6af049066224 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:47.434309 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-ac31261a-5dfb-4fd1-b71f-6af049066224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:47.448998 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 883/1766] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:47 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:47.457807 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78963ff8-3904-4d05-a5c9-751e71260a3e None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:47.457807 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-78963ff8-3904-4d05-a5c9-751e71260a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:47.518437 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78963ff8-3904-4d05-a5c9-751e71260a3e None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:47.537791 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f87d6-86f6-49d5-97a8-5fd9074c3b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:47.542515 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f87d6-86f6-49d5-97a8-5fd9074c3b42 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:47.544561 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f87d6-86f6-49d5-97a8-5fd9074c3b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:47.545501 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f87d6-86f6-49d5-97a8-5fd9074c3b42 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:47.549874 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f87d6-86f6-49d5-97a8-5fd9074c3b42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:47.555460 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f87d6-86f6-49d5-97a8-5fd9074c3b42 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:47.662555 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31261a-5dfb-4fd1-b71f-6af049066224 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:47.680213 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee08fbd-ac5f-471d-aae8-6739f6ee2179 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:47.681260 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee08fbd-ac5f-471d-aae8-6739f6ee2179 service nova] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:47.692816 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee08fbd-ac5f-471d-aae8-6739f6ee2179 service nova] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:47.693726 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee08fbd-ac5f-471d-aae8-6739f6ee2179 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:47.698541 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-2ee08fbd-ac5f-471d-aae8-6739f6ee2179 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:47.717542 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee08fbd-ac5f-471d-aae8-6739f6ee2179 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:47.720557 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee08fbd-ac5f-471d-aae8-6739f6ee2179 service nova] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:47.744842 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 884/1767] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:59:47.746566 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070161a-5598-49a5-bfc1-2daf040adf39 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:47.746929 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070161a-5598-49a5-bfc1-2daf040adf39 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:47.747273 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070161a-5598-49a5-bfc1-2daf040adf39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:47.794353 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 884/1768] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 14:59:47 2022] POST /identity/v3/projects => generated 383 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:47.795472 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f87d6-86f6-49d5-97a8-5fd9074c3b42 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:47.801220 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-7a7f87d6-86f6-49d5-97a8-5fd9074c3b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:47.808199 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-0070161a-5598-49a5-bfc1-2daf040adf39 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:47.816602 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-0070161a-5598-49a5-bfc1-2daf040adf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:48.027939 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f87d6-86f6-49d5-97a8-5fd9074c3b42 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:48.040908 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058ff0c-e136-4236-9ad3-64b5ff0cf3d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:48.044748 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058ff0c-e136-4236-9ad3-64b5ff0cf3d7 service cinder] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:48.044748 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058ff0c-e136-4236-9ad3-64b5ff0cf3d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:48.044748 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058ff0c-e136-4236-9ad3-64b5ff0cf3d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:48.172354 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 885/1769] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:48.174504 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070161a-5598-49a5-bfc1-2daf040adf39 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:48.298084 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058ff0c-e136-4236-9ad3-64b5ff0cf3d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:48.302323 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-0070161a-5598-49a5-bfc1-2daf040adf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:48.302981 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058ff0c-e136-4236-9ad3-64b5ff0cf3d7 service cinder] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:48.302981 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 885/1770] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:47 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:59:48.302981 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058ff0c-e136-4236-9ad3-64b5ff0cf3d7 service cinder] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:48.303681 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070161a-5598-49a5-bfc1-2daf040adf39 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:48.303681 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ddee2-8f84-4611-9459-d86fd07ed090 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:48.303681 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ddee2-8f84-4611-9459-d86fd07ed090 service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:48.303681 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ddee2-8f84-4611-9459-d86fd07ed090 service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:48.304582 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ddee2-8f84-4611-9459-d86fd07ed090 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:48.315470 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058ff0c-e136-4236-9ad3-64b5ff0cf3d7 service cinder] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:48.350768 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31493e-4b64-4b82-af6a-3affc0468417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:48.351800 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31493e-4b64-4b82-af6a-3affc0468417 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:48.352245 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31493e-4b64-4b82-af6a-3affc0468417 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:48.352716 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31493e-4b64-4b82-af6a-3affc0468417 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:48.356652 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31493e-4b64-4b82-af6a-3affc0468417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:48.375702 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31493e-4b64-4b82-af6a-3affc0468417 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:48.517983 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 886/1771] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 14:59:48 2022] POST /identity/v3/users => generated 292 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:48.520276 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c942de3-4ee3-4048-970a-754934ec03ee None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:48.521286 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c942de3-4ee3-4048-970a-754934ec03ee None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:48.521513 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c942de3-4ee3-4048-970a-754934ec03ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:48.534461 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ddee2-8f84-4611-9459-d86fd07ed090 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:48.550526 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ddee2-8f84-4611-9459-d86fd07ed090 service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:48.612577 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 886/1772] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:48 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:59:48.616999 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ddee2-8f84-4611-9459-d86fd07ed090 service cinder] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:48.622766 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-3c942de3-4ee3-4048-970a-754934ec03ee None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:48.626449 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-3c942de3-4ee3-4048-970a-754934ec03ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:48.652790 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 887/1773] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:48.657894 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ddee2-8f84-4611-9459-d86fd07ed090 service cinder] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:48.659109 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c942de3-4ee3-4048-970a-754934ec03ee None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:48.673844 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba146e5-8b12-4537-a3ac-fe2bd06a9a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:48.676302 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba146e5-8b12-4537-a3ac-fe2bd06a9a6a admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:48.676302 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba146e5-8b12-4537-a3ac-fe2bd06a9a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:48.676504 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c942de3-4ee3-4048-970a-754934ec03ee None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:48.676599 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba146e5-8b12-4537-a3ac-fe2bd06a9a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:48.676599 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba146e5-8b12-4537-a3ac-fe2bd06a9a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:48.681353 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d47594-c094-48e7-8e58-56c81c32f53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:48.683991 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d47594-c094-48e7-8e58-56c81c32f53d admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:48.684858 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d47594-c094-48e7-8e58-56c81c32f53d admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:48.685574 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d47594-c094-48e7-8e58-56c81c32f53d admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:48.686589 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d47594-c094-48e7-8e58-56c81c32f53d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 14:59:48.687146 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d47594-c094-48e7-8e58-56c81c32f53d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:48.688403 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba146e5-8b12-4537-a3ac-fe2bd06a9a6a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:48.689476 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d47594-c094-48e7-8e58-56c81c32f53d admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:48.712382 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 888/1774] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 14:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 14:59:48.716316 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d47594-c094-48e7-8e58-56c81c32f53d admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:48.740099 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 887/1775] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:48.745296 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba146e5-8b12-4537-a3ac-fe2bd06a9a6a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:48.747786 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d47594-c094-48e7-8e58-56c81c32f53d admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:48.757635 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1ab9d-b4ac-4f0b-be79-d2a3a282fbb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:48.761781 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1ab9d-b4ac-4f0b-be79-d2a3a282fbb3 service cinder] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:48.761781 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1ab9d-b4ac-4f0b-be79-d2a3a282fbb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:48.761781 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1ab9d-b4ac-4f0b-be79-d2a3a282fbb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:48.761781 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-12a1ab9d-b4ac-4f0b-be79-d2a3a282fbb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:48.792208 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba146e5-8b12-4537-a3ac-fe2bd06a9a6a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:48.810395 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda3eb0-c930-4759-9dc7-052ac0efa0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:48.811112 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda3eb0-c930-4759-9dc7-052ac0efa0e9 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:48.811346 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda3eb0-c930-4759-9dc7-052ac0efa0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:48.811621 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda3eb0-c930-4759-9dc7-052ac0efa0e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:48.815495 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda3eb0-c930-4759-9dc7-052ac0efa0e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:48.817473 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda3eb0-c930-4759-9dc7-052ac0efa0e9 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:48.910252 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1ab9d-b4ac-4f0b-be79-d2a3a282fbb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:48.911890 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1ab9d-b4ac-4f0b-be79-d2a3a282fbb3 service cinder] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:48.929888 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 889/1776] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:59:48.931225 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1ab9d-b4ac-4f0b-be79-d2a3a282fbb3 service cinder] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:48.972611 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 888/1777] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 14:59:48 2022] POST /identity/v3/projects => generated 409 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:48.973419 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1ab9d-b4ac-4f0b-be79-d2a3a282fbb3 service cinder] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:48.976649 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda3eb0-c930-4759-9dc7-052ac0efa0e9 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:49.121299 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04526d4c-7dbe-40f9-ab0f-54fdcdd86b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:49.122184 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04526d4c-7dbe-40f9-ab0f-54fdcdd86b56 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:49.123096 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04526d4c-7dbe-40f9-ab0f-54fdcdd86b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:49.123511 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04526d4c-7dbe-40f9-ab0f-54fdcdd86b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:49.124958 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04526d4c-7dbe-40f9-ab0f-54fdcdd86b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:49.126837 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04526d4c-7dbe-40f9-ab0f-54fdcdd86b56 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:49.166720 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 890/1778] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:49.168405 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04526d4c-7dbe-40f9-ab0f-54fdcdd86b56 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:49.172879 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda3eb0-c930-4759-9dc7-052ac0efa0e9 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:49.179105 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774ad52-a568-44a4-9cd7-7f2bb2eba42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:49.179948 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774ad52-a568-44a4-9cd7-7f2bb2eba42f admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:49.181111 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774ad52-a568-44a4-9cd7-7f2bb2eba42f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:49.181111 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774ad52-a568-44a4-9cd7-7f2bb2eba42f admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:49.183013 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774ad52-a568-44a4-9cd7-7f2bb2eba42f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:49.194577 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774ad52-a568-44a4-9cd7-7f2bb2eba42f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:49.317811 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04526d4c-7dbe-40f9-ab0f-54fdcdd86b56 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:49.343961 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de31bd-683c-4347-9ac2-f0bdc5a50f4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:49.344560 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de31bd-683c-4347-9ac2-f0bdc5a50f4b service cinder] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:49.344849 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de31bd-683c-4347-9ac2-f0bdc5a50f4b service cinder] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:49.345145 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de31bd-683c-4347-9ac2-f0bdc5a50f4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:49.347617 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-b4de31bd-683c-4347-9ac2-f0bdc5a50f4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:49.444240 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 889/1779] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 14:59:48 2022] POST /identity/v3/users => generated 305 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:49.445307 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774ad52-a568-44a4-9cd7-7f2bb2eba42f admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:49.461809 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774ad52-a568-44a4-9cd7-7f2bb2eba42f admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:49.478672 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dac783-06d7-4bba-8944-21719eb1c265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:49.479656 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dac783-06d7-4bba-8944-21719eb1c265 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:49.480206 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dac783-06d7-4bba-8944-21719eb1c265 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:49.480526 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dac783-06d7-4bba-8944-21719eb1c265 admin admin] PATH_INFO: `/v3/projects/00ecba1e2bf3435392069e0cfa8522f4/users/fcd351f74f474970861711ca32d401d4/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:49.532561 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dac783-06d7-4bba-8944-21719eb1c265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00ecba1e2bf3435392069e0cfa8522f4, user_id=fcd351f74f474970861711ca32d401d4, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:49.547573 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dac783-06d7-4bba-8944-21719eb1c265 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:49.564088 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de31bd-683c-4347-9ac2-f0bdc5a50f4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:49.568036 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de31bd-683c-4347-9ac2-f0bdc5a50f4b service cinder] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:49.595840 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 891/1780] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:49 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:59:49.597095 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de31bd-683c-4347-9ac2-f0bdc5a50f4b service cinder] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:49.657356 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de31bd-683c-4347-9ac2-f0bdc5a50f4b service cinder] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:49.671948 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49ce2d-aa30-479e-aba7-24d286375e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:49.672639 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49ce2d-aa30-479e-aba7-24d286375e6c admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:49.672927 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49ce2d-aa30-479e-aba7-24d286375e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:49.675603 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49ce2d-aa30-479e-aba7-24d286375e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:49.678770 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49ce2d-aa30-479e-aba7-24d286375e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:49.684472 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49ce2d-aa30-479e-aba7-24d286375e6c admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:49.689786 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 890/1781] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 14:59:49 2022] PUT /identity/v3/projects/00ecba1e2bf3435392069e0cfa8522f4/users/fcd351f74f474970861711ca32d401d4/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:49.699969 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad767b1-55ab-419c-80be-cb8291c42361 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:49.700300 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad767b1-55ab-419c-80be-cb8291c42361 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:49.700597 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad767b1-55ab-419c-80be-cb8291c42361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:49.748080 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 892/1782] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:49.750724 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49ce2d-aa30-479e-aba7-24d286375e6c admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:49.801011 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-cad767b1-55ab-419c-80be-cb8291c42361 None None] MFA Rules not processed for user `fcd351f74f474970861711ca32d401d4`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:49.806813 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-cad767b1-55ab-419c-80be-cb8291c42361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:49.807080 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49ce2d-aa30-479e-aba7-24d286375e6c admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:50.068913 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 891/1783] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:50.073322 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad767b1-55ab-419c-80be-cb8291c42361 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:50.138570 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e94623-c0a7-4846-b7e3-8e324be1f1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:50.139374 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e94623-c0a7-4846-b7e3-8e324be1f1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:50.144122 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e94623-c0a7-4846-b7e3-8e324be1f1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:50.144494 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e94623-c0a7-4846-b7e3-8e324be1f1a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:50.145334 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e94623-c0a7-4846-b7e3-8e324be1f1a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:50.153821 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e94623-c0a7-4846-b7e3-8e324be1f1a8 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:50.164720 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad767b1-55ab-419c-80be-cb8291c42361 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:50.172267 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0098b-6209-4795-9172-1ce04751f505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:50.173401 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0098b-6209-4795-9172-1ce04751f505 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:50.173877 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0098b-6209-4795-9172-1ce04751f505 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:50.174434 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0098b-6209-4795-9172-1ce04751f505 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:50.175535 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0098b-6209-4795-9172-1ce04751f505 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:50.177619 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0098b-6209-4795-9172-1ce04751f505 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:50.194242 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 893/1784] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:50.198778 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e94623-c0a7-4846-b7e3-8e324be1f1a8 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:50.223491 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e94623-c0a7-4846-b7e3-8e324be1f1a8 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:50.244167 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78fd62-85e6-4c6e-a51b-a418a5a7bb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:50.245116 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78fd62-85e6-4c6e-a51b-a418a5a7bb85 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:50.248058 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78fd62-85e6-4c6e-a51b-a418a5a7bb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:50.249362 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78fd62-85e6-4c6e-a51b-a418a5a7bb85 admin admin] PATH_INFO: `/v3/projects/1af8f554c27c4082857972f93ac139a2/users/27ea27c814f14ba2860219a89dfaa762/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:50.271207 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78fd62-85e6-4c6e-a51b-a418a5a7bb85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af8f554c27c4082857972f93ac139a2, user_id=27ea27c814f14ba2860219a89dfaa762, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:50.279648 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78fd62-85e6-4c6e-a51b-a418a5a7bb85 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:50.328556 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 892/1785] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 14:59:50 2022] POST /identity/v3/projects => generated 383 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 14:59:50.329869 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0098b-6209-4795-9172-1ce04751f505 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:50.411004 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 894/1786] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 14:59:50 2022] PUT /identity/v3/projects/1af8f554c27c4082857972f93ac139a2/users/27ea27c814f14ba2860219a89dfaa762/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:50.431309 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f3ed5-ecba-4c7a-8fb9-09133934a9dc None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:50.431309 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f3ed5-ecba-4c7a-8fb9-09133934a9dc None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:50.431309 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f3ed5-ecba-4c7a-8fb9-09133934a9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:50.471425 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0098b-6209-4795-9172-1ce04751f505 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:50.514056 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-6f9f3ed5-ecba-4c7a-8fb9-09133934a9dc None None] MFA Rules not processed for user `27ea27c814f14ba2860219a89dfaa762`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:50.515839 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-6f9f3ed5-ecba-4c7a-8fb9-09133934a9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:50.659429 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71393f-473b-4f2b-a54e-42387b6a7e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:50.661221 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71393f-473b-4f2b-a54e-42387b6a7e47 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:50.668056 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71393f-473b-4f2b-a54e-42387b6a7e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:50.668056 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71393f-473b-4f2b-a54e-42387b6a7e47 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:50.668056 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71393f-473b-4f2b-a54e-42387b6a7e47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:50.669530 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71393f-473b-4f2b-a54e-42387b6a7e47 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:50.742096 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 895/1787] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:50 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:50.743130 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f3ed5-ecba-4c7a-8fb9-09133934a9dc None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:50.796104 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f3ed5-ecba-4c7a-8fb9-09133934a9dc None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:50.811678 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862b6e1-64c2-4add-b37c-c06d404dc2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:50.812925 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862b6e1-64c2-4add-b37c-c06d404dc2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:50.813296 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862b6e1-64c2-4add-b37c-c06d404dc2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:50.813591 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862b6e1-64c2-4add-b37c-c06d404dc2e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:50.814522 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862b6e1-64c2-4add-b37c-c06d404dc2e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:50.816514 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862b6e1-64c2-4add-b37c-c06d404dc2e4 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:51.154263 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 896/1788] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 14:59:50 2022] POST /identity/v3/projects => generated 407 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:51.158321 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862b6e1-64c2-4add-b37c-c06d404dc2e4 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:51.163538 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 893/1789] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 14:59:50 2022] POST /identity/v3/users => generated 298 bytes in 834 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 14:59:51.167198 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71393f-473b-4f2b-a54e-42387b6a7e47 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:51.185310 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71393f-473b-4f2b-a54e-42387b6a7e47 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:51.255089 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862b6e1-64c2-4add-b37c-c06d404dc2e4 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:51.256278 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9518f8f-2e11-4792-894d-8a65fffb8adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:51.257102 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9518f8f-2e11-4792-894d-8a65fffb8adc admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:51.257523 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9518f8f-2e11-4792-894d-8a65fffb8adc admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:51.257912 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9518f8f-2e11-4792-894d-8a65fffb8adc admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:51.258884 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9518f8f-2e11-4792-894d-8a65fffb8adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:51.260732 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9518f8f-2e11-4792-894d-8a65fffb8adc admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:51.262684 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763a8ff-0bb3-42d7-8e2c-32ea93f97ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:51.263222 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763a8ff-0bb3-42d7-8e2c-32ea93f97ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:51.263619 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763a8ff-0bb3-42d7-8e2c-32ea93f97ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:51.264218 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763a8ff-0bb3-42d7-8e2c-32ea93f97ac8 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:51.265595 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763a8ff-0bb3-42d7-8e2c-32ea93f97ac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:51.269467 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763a8ff-0bb3-42d7-8e2c-32ea93f97ac8 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:51.277646 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 894/1790] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:51.278682 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9518f8f-2e11-4792-894d-8a65fffb8adc admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:51.292792 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9518f8f-2e11-4792-894d-8a65fffb8adc admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:51.299690 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c854770-9181-449c-88ec-8889c490450b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:51.303836 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c854770-9181-449c-88ec-8889c490450b admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:51.303836 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c854770-9181-449c-88ec-8889c490450b admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:51.303836 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c854770-9181-449c-88ec-8889c490450b admin admin] PATH_INFO: `/v3/projects/1eb42812b9514b96863176c67d04da7d/users/d6e35af75b9b4bcb9e6c4ce87a78305e/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:51.319924 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c854770-9181-449c-88ec-8889c490450b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb42812b9514b96863176c67d04da7d, user_id=d6e35af75b9b4bcb9e6c4ce87a78305e, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:51.321981 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c854770-9181-449c-88ec-8889c490450b admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:51.447651 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 895/1791] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 14:59:51 2022] PUT /identity/v3/projects/1eb42812b9514b96863176c67d04da7d/users/d6e35af75b9b4bcb9e6c4ce87a78305e/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:51.448666 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c854770-9181-449c-88ec-8889c490450b admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:51.454557 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 897/1792] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 14:59:51 2022] POST /identity/v3/users => generated 310 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 14:59:51.456309 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763a8ff-0bb3-42d7-8e2c-32ea93f97ac8 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:51.470378 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763a8ff-0bb3-42d7-8e2c-32ea93f97ac8 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:51.568392 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065270d-67f5-4c4e-8a1a-3a31f3447df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:51.569335 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065270d-67f5-4c4e-8a1a-3a31f3447df4 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:51.569622 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065270d-67f5-4c4e-8a1a-3a31f3447df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:51.569954 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065270d-67f5-4c4e-8a1a-3a31f3447df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:51.570757 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065270d-67f5-4c4e-8a1a-3a31f3447df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:51.580347 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065270d-67f5-4c4e-8a1a-3a31f3447df4 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:51.595286 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 898/1793] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:51.600543 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065270d-67f5-4c4e-8a1a-3a31f3447df4 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:51.607769 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c854770-9181-449c-88ec-8889c490450b admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:51.622430 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410ab8a-ab4e-477d-85c3-c2f37d62f3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:51.623146 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065270d-67f5-4c4e-8a1a-3a31f3447df4 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:51.629838 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b77a7-0a46-44fd-8e37-dfb8cd857198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:51.630972 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b77a7-0a46-44fd-8e37-dfb8cd857198 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:51.631257 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b77a7-0a46-44fd-8e37-dfb8cd857198 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:51.631689 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b77a7-0a46-44fd-8e37-dfb8cd857198 admin admin] PATH_INFO: `/v3/projects/bc90c0e1fa3f411e98c6f008e5d5285a/users/f07c16d2ba5243818c84ca10d7ce7d7a/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:51.633795 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410ab8a-ab4e-477d-85c3-c2f37d62f3ef admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:51.634092 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410ab8a-ab4e-477d-85c3-c2f37d62f3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:51.634374 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410ab8a-ab4e-477d-85c3-c2f37d62f3ef admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:51.646786 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a410ab8a-ab4e-477d-85c3-c2f37d62f3ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:51.653806 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a410ab8a-ab4e-477d-85c3-c2f37d62f3ef admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:51.656350 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959b77a7-0a46-44fd-8e37-dfb8cd857198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc90c0e1fa3f411e98c6f008e5d5285a, user_id=f07c16d2ba5243818c84ca10d7ce7d7a, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:51.669689 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959b77a7-0a46-44fd-8e37-dfb8cd857198 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:51.683990 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 896/1794] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:51.685579 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b878c0-0a8f-4e70-9dc1-bc2445136e27 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:51.686481 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b878c0-0a8f-4e70-9dc1-bc2445136e27 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:51.686812 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b878c0-0a8f-4e70-9dc1-bc2445136e27 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:51.689344 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 897/1795] 10.222.0.30 () {54 vars in 921 bytes} [Wed Jan 5 14:59:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 14:59:51.690124 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b878c0-0a8f-4e70-9dc1-bc2445136e27 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:51.704786 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b878c0-0a8f-4e70-9dc1-bc2445136e27 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:51.710334 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836468c3-3f1c-4fac-94e3-fe1bf1b8c793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:51.711391 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836468c3-3f1c-4fac-94e3-fe1bf1b8c793 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:51.711681 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836468c3-3f1c-4fac-94e3-fe1bf1b8c793 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:51.712194 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836468c3-3f1c-4fac-94e3-fe1bf1b8c793 admin admin] PATH_INFO: `/v3/projects/1eb42812b9514b96863176c67d04da7d/users/d6e35af75b9b4bcb9e6c4ce87a78305e/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:51.714947 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836468c3-3f1c-4fac-94e3-fe1bf1b8c793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb42812b9514b96863176c67d04da7d, user_id=d6e35af75b9b4bcb9e6c4ce87a78305e, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:51.717934 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836468c3-3f1c-4fac-94e3-fe1bf1b8c793 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:51.741803 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 898/1796] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 14:59:51 2022] PUT /identity/v3/projects/1eb42812b9514b96863176c67d04da7d/users/d6e35af75b9b4bcb9e6c4ce87a78305e/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:51.754130 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9717c67-fcab-47d9-bf42-edab6332be4a None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:51.755734 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9717c67-fcab-47d9-bf42-edab6332be4a None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:51.756108 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9717c67-fcab-47d9-bf42-edab6332be4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:51.760312 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 899/1797] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 14:59:51 2022] PUT /identity/v3/projects/bc90c0e1fa3f411e98c6f008e5d5285a/users/f07c16d2ba5243818c84ca10d7ce7d7a/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:51.764549 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b77a7-0a46-44fd-8e37-dfb8cd857198 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:51.830168 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-e9717c67-fcab-47d9-bf42-edab6332be4a None None] MFA Rules not processed for user `d6e35af75b9b4bcb9e6c4ce87a78305e`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:51.831966 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-e9717c67-fcab-47d9-bf42-edab6332be4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:51.885188 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b77a7-0a46-44fd-8e37-dfb8cd857198 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:51.892747 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1119f8-80e2-4d79-be54-32ebeed9e848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:51.894593 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1119f8-80e2-4d79-be54-32ebeed9e848 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:51.897765 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1119f8-80e2-4d79-be54-32ebeed9e848 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:51.899665 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1119f8-80e2-4d79-be54-32ebeed9e848 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:51.900711 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1119f8-80e2-4d79-be54-32ebeed9e848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:51.903284 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1119f8-80e2-4d79-be54-32ebeed9e848 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:51.921257 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 900/1798] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 14:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 14:59:51.922897 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22463409-2d1c-4d6f-aaf4-fc85bb2eb15c None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:51.923315 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22463409-2d1c-4d6f-aaf4-fc85bb2eb15c None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:51.923670 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22463409-2d1c-4d6f-aaf4-fc85bb2eb15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:51.980467 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-22463409-2d1c-4d6f-aaf4-fc85bb2eb15c None None] MFA Rules not processed for user `77db235e2f7046e4bdbad7f31b5e3ebc`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:51.984676 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-22463409-2d1c-4d6f-aaf4-fc85bb2eb15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:52.004198 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 899/1799] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:52.004198 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9717c67-fcab-47d9-bf42-edab6332be4a None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:52.029408 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9717c67-fcab-47d9-bf42-edab6332be4a None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:52.044294 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef979d2-d004-497a-a2b4-5242e838b26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:52.045128 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef979d2-d004-497a-a2b4-5242e838b26e admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:52.045416 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef979d2-d004-497a-a2b4-5242e838b26e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:52.045885 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef979d2-d004-497a-a2b4-5242e838b26e admin admin] PATH_INFO: `/v3/projects/bc90c0e1fa3f411e98c6f008e5d5285a/users/f07c16d2ba5243818c84ca10d7ce7d7a/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:52.051796 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef979d2-d004-497a-a2b4-5242e838b26e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc90c0e1fa3f411e98c6f008e5d5285a, user_id=f07c16d2ba5243818c84ca10d7ce7d7a, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:52.056001 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef979d2-d004-497a-a2b4-5242e838b26e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:52.079432 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 900/1800] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 14:59:51 2022] PUT /identity/v3/projects/bc90c0e1fa3f411e98c6f008e5d5285a/users/f07c16d2ba5243818c84ca10d7ce7d7a/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 14:59:52.080240 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef979d2-d004-497a-a2b4-5242e838b26e admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:52.143202 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef979d2-d004-497a-a2b4-5242e838b26e admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:52.147807 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e6eee-acec-4eba-9eee-c54ca24d5099 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:52.148631 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e6eee-acec-4eba-9eee-c54ca24d5099 service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:52.148858 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e6eee-acec-4eba-9eee-c54ca24d5099 service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:52.149236 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e6eee-acec-4eba-9eee-c54ca24d5099 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:52.191058 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 901/1801] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Jan 5 14:59:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:52.192406 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dff44-151d-4a14-9827-428802299208 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:52.192699 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dff44-151d-4a14-9827-428802299208 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:52.192982 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dff44-151d-4a14-9827-428802299208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:52.225736 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e6eee-acec-4eba-9eee-c54ca24d5099 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:52.227489 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e6eee-acec-4eba-9eee-c54ca24d5099 service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:52.256087 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 901/1802] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:59:52.279537 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-541dff44-151d-4a14-9827-428802299208 None None] MFA Rules not processed for user `f07c16d2ba5243818c84ca10d7ce7d7a`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:52.279537 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-541dff44-151d-4a14-9827-428802299208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:52.371589 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e6eee-acec-4eba-9eee-c54ca24d5099 service cinder] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:52.383956 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e6eee-acec-4eba-9eee-c54ca24d5099 service cinder] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:52.389476 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd3313-3751-48ac-81c6-e27154c9b20b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:52.394291 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd3313-3751-48ac-81c6-e27154c9b20b service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:52.395453 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd3313-3751-48ac-81c6-e27154c9b20b service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:52.395790 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd3313-3751-48ac-81c6-e27154c9b20b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:52.428719 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 902/1803] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:52 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 14:59:52.472836 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd3313-3751-48ac-81c6-e27154c9b20b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:52.474844 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd3313-3751-48ac-81c6-e27154c9b20b service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:52.496640 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 902/1804] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 14:59:52.535589 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541dff44-151d-4a14-9827-428802299208 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:52.568476 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd3313-3751-48ac-81c6-e27154c9b20b service cinder] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:52.577562 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd3313-3751-48ac-81c6-e27154c9b20b service cinder] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:52.588319 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303b2ab-2123-470c-95cc-41a8c7324bd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:52.589055 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303b2ab-2123-470c-95cc-41a8c7324bd7 service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:52.589365 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303b2ab-2123-470c-95cc-41a8c7324bd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:52.589772 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303b2ab-2123-470c-95cc-41a8c7324bd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:52.610271 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303b2ab-2123-470c-95cc-41a8c7324bd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:52.612286 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303b2ab-2123-470c-95cc-41a8c7324bd7 service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:52.639225 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 903/1805] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:52 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 14:59:52.667899 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541dff44-151d-4a14-9827-428802299208 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:52.677896 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590b597-a886-47f8-8c24-5ed32b2ec1b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:52.678649 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590b597-a886-47f8-8c24-5ed32b2ec1b3 service nova] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:52.687064 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590b597-a886-47f8-8c24-5ed32b2ec1b3 service nova] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:52.687064 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590b597-a886-47f8-8c24-5ed32b2ec1b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:52.690625 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590b597-a886-47f8-8c24-5ed32b2ec1b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:52.693723 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590b597-a886-47f8-8c24-5ed32b2ec1b3 service nova] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:52.716660 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 903/1806] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:59:53.347478 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303b2ab-2123-470c-95cc-41a8c7324bd7 service cinder] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 14:59:53.371198 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303b2ab-2123-470c-95cc-41a8c7324bd7 service cinder] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 14:59:53.375958 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aea673-9cb2-4411-8944-7187ee47a03c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 14:59:53.376658 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aea673-9cb2-4411-8944-7187ee47a03c service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:53.376992 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aea673-9cb2-4411-8944-7187ee47a03c service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:53.377308 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aea673-9cb2-4411-8944-7187ee47a03c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:53.479280 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aea673-9cb2-4411-8944-7187ee47a03c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 14:59:53.481994 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aea673-9cb2-4411-8944-7187ee47a03c service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 14:59:53.504697 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 904/1807] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 14:59:53 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 14:59:54.181332 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527377b-5e62-40a1-97f8-4b6658ea13c6 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 14:59:54.182115 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527377b-5e62-40a1-97f8-4b6658ea13c6 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 14:59:54.182699 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527377b-5e62-40a1-97f8-4b6658ea13c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 14:59:54.202138 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-d527377b-5e62-40a1-97f8-4b6658ea13c6 None None] MFA Rules not processed for user `d43400b4646449ce94967ec5bab4eca1`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 14:59:54.205390 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-d527377b-5e62-40a1-97f8-4b6658ea13c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 14:59:54.309515 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 904/1808] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 14:59:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:00:04.370651 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aea673-9cb2-4411-8944-7187ee47a03c service cinder] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:04.449679 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aea673-9cb2-4411-8944-7187ee47a03c service cinder] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:04.458886 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c84ce-6b06-487b-80f7-84e955231eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:04.459862 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c84ce-6b06-487b-80f7-84e955231eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:04.460143 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c84ce-6b06-487b-80f7-84e955231eab admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:04.460449 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c84ce-6b06-487b-80f7-84e955231eab admin admin] PATH_INFO: `/v3/users/fcd351f74f474970861711ca32d401d4` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:04.462037 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c84ce-6b06-487b-80f7-84e955231eab admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcd351f74f474970861711ca32d401d4)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:04.464276 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c84ce-6b06-487b-80f7-84e955231eab admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:05.045099 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-2f9c84ce-6b06-487b-80f7-84e955231eab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcd351f74f474970861711ca32d401d4'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:05.051811 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-2f9c84ce-6b06-487b-80f7-84e955231eab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcd351f74f474970861711ca32d401d4'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:05.052613 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-2f9c84ce-6b06-487b-80f7-84e955231eab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcd351f74f474970861711ca32d401d4'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:05.175193 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-2f9c84ce-6b06-487b-80f7-84e955231eab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcd351f74f474970861711ca32d401d4'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:05.192967 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-2f9c84ce-6b06-487b-80f7-84e955231eab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcd351f74f474970861711ca32d401d4'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:05.201244 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 905/1809] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:00:04 2022] DELETE /identity/v3/users/fcd351f74f474970861711ca32d401d4 => generated 0 bytes in 831 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:05.209108 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e836b-0d16-43b1-9779-57145716681c None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:05.209108 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e836b-0d16-43b1-9779-57145716681c None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:05.209108 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e836b-0d16-43b1-9779-57145716681c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:05.228641 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-c83e836b-0d16-43b1-9779-57145716681c None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:05.230168 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-c83e836b-0d16-43b1-9779-57145716681c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:05.315209 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 905/1810] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:00:05.327430 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c84ce-6b06-487b-80f7-84e955231eab admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:05.329900 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-2f9c84ce-6b06-487b-80f7-84e955231eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:05.397045 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c84ce-6b06-487b-80f7-84e955231eab admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:05.403055 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7653c-a846-43a1-ba49-80f06e7a8e1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:05.403814 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7653c-a846-43a1-ba49-80f06e7a8e1c service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:05.404222 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7653c-a846-43a1-ba49-80f06e7a8e1c service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:05.404614 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7653c-a846-43a1-ba49-80f06e7a8e1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:05.417701 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7653c-a846-43a1-ba49-80f06e7a8e1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:05.420198 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7653c-a846-43a1-ba49-80f06e7a8e1c service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:05.432664 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 906/1811] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:00:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:00:06.126682 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd6035-abc3-44cf-9801-acce078d014b None None] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:06.127323 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd6035-abc3-44cf-9801-acce078d014b None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:06.127753 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd6035-abc3-44cf-9801-acce078d014b None None] PATH_INFO: `/` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:06.131041 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 906/1812] 10.222.0.30 () {54 vars in 921 bytes} [Wed Jan 5 15:00:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 15:00:06.246256 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245770c-89b2-40a7-9d32-30d8cc060c1b None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:06.251508 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245770c-89b2-40a7-9d32-30d8cc060c1b None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:06.251508 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245770c-89b2-40a7-9d32-30d8cc060c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:06.287479 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-2245770c-89b2-40a7-9d32-30d8cc060c1b None None] MFA Rules not processed for user `77db235e2f7046e4bdbad7f31b5e3ebc`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:06.290220 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-2245770c-89b2-40a7-9d32-30d8cc060c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:06.409838 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 907/1813] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Jan 5 15:00:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:00:06.428228 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd6035-abc3-44cf-9801-acce078d014b None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:06.430154 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-8bdd6035-abc3-44cf-9801-acce078d014b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:06.458403 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd6035-abc3-44cf-9801-acce078d014b None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:06.468025 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ea6fb-194b-4263-8b24-51f218e95f86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:06.468828 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ea6fb-194b-4263-8b24-51f218e95f86 service nova] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:06.472575 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ea6fb-194b-4263-8b24-51f218e95f86 service nova] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:06.472575 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ea6fb-194b-4263-8b24-51f218e95f86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:06.475249 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245770c-89b2-40a7-9d32-30d8cc060c1b None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:06.476944 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-2245770c-89b2-40a7-9d32-30d8cc060c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:06.501826 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ea6fb-194b-4263-8b24-51f218e95f86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:06.505256 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ea6fb-194b-4263-8b24-51f218e95f86 service nova] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:06.517964 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245770c-89b2-40a7-9d32-30d8cc060c1b None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:06.528505 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720dbc8-3bfe-41d0-9468-bfeb977ac5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:06.530111 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720dbc8-3bfe-41d0-9468-bfeb977ac5fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:06.573961 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 907/1814] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:00:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:00:06.574566 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720dbc8-3bfe-41d0-9468-bfeb977ac5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:06.574566 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720dbc8-3bfe-41d0-9468-bfeb977ac5fd admin admin] PATH_INFO: `/v3/projects/00ecba1e2bf3435392069e0cfa8522f4` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:06.574566 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720dbc8-3bfe-41d0-9468-bfeb977ac5fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=00ecba1e2bf3435392069e0cfa8522f4)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:06.574566 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720dbc8-3bfe-41d0-9468-bfeb977ac5fd admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:06.724214 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-5720dbc8-3bfe-41d0-9468-bfeb977ac5fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00ecba1e2bf3435392069e0cfa8522f4', 'request_id': 'req-5720dbc8-3bfe-41d0-9468-bfeb977ac5fd'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:06.734396 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-5720dbc8-3bfe-41d0-9468-bfeb977ac5fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00ecba1e2bf3435392069e0cfa8522f4', 'request_id': 'req-5720dbc8-3bfe-41d0-9468-bfeb977ac5fd'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:06.741634 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-5720dbc8-3bfe-41d0-9468-bfeb977ac5fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00ecba1e2bf3435392069e0cfa8522f4', 'request_id': 'req-5720dbc8-3bfe-41d0-9468-bfeb977ac5fd'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:07.032694 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-5720dbc8-3bfe-41d0-9468-bfeb977ac5fd admin admin] The token cache is being invalidate because project 00ecba1e2bf3435392069e0cfa8522f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:00:07.033425 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-5720dbc8-3bfe-41d0-9468-bfeb977ac5fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:07.034226 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-5720dbc8-3bfe-41d0-9468-bfeb977ac5fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:07.038668 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 908/1815] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:00:06 2022] DELETE /identity/v3/projects/00ecba1e2bf3435392069e0cfa8522f4 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:07.039953 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ea6fb-194b-4263-8b24-51f218e95f86 service nova] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:07.051841 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ea6fb-194b-4263-8b24-51f218e95f86 service nova] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:07.121426 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6e30d-2f81-4453-88c0-f8e15f1daf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:07.122314 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6e30d-2f81-4453-88c0-f8e15f1daf31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:07.122627 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6e30d-2f81-4453-88c0-f8e15f1daf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:07.122909 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6e30d-2f81-4453-88c0-f8e15f1daf31 admin admin] PATH_INFO: `/v3/users/d6e35af75b9b4bcb9e6c4ce87a78305e` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:07.124225 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6e30d-2f81-4453-88c0-f8e15f1daf31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6e35af75b9b4bcb9e6c4ce87a78305e)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:07.126277 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6e30d-2f81-4453-88c0-f8e15f1daf31 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:07.366781 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-25d6e30d-2f81-4453-88c0-f8e15f1daf31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6e35af75b9b4bcb9e6c4ce87a78305e'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:07.374746 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-25d6e30d-2f81-4453-88c0-f8e15f1daf31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6e35af75b9b4bcb9e6c4ce87a78305e'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:07.375566 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-25d6e30d-2f81-4453-88c0-f8e15f1daf31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6e35af75b9b4bcb9e6c4ce87a78305e'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:07.376246 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-25d6e30d-2f81-4453-88c0-f8e15f1daf31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6e35af75b9b4bcb9e6c4ce87a78305e'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:07.437294 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-25d6e30d-2f81-4453-88c0-f8e15f1daf31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6e35af75b9b4bcb9e6c4ce87a78305e'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:07.461314 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 908/1816] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:00:07 2022] DELETE /identity/v3/users/d6e35af75b9b4bcb9e6c4ce87a78305e => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:00:07.915840 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720dbc8-3bfe-41d0-9468-bfeb977ac5fd admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:07.918004 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-5720dbc8-3bfe-41d0-9468-bfeb977ac5fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:07.949255 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720dbc8-3bfe-41d0-9468-bfeb977ac5fd admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:08.029453 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd7e5c-168b-43c0-a520-569398d5f51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:08.029453 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd7e5c-168b-43c0-a520-569398d5f51e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:08.029453 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd7e5c-168b-43c0-a520-569398d5f51e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:08.029837 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd7e5c-168b-43c0-a520-569398d5f51e admin admin] PATH_INFO: `/v3/projects/1eb42812b9514b96863176c67d04da7d` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:08.031368 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd7e5c-168b-43c0-a520-569398d5f51e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eb42812b9514b96863176c67d04da7d)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:08.033407 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd7e5c-168b-43c0-a520-569398d5f51e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:08.185775 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-9afd7e5c-168b-43c0-a520-569398d5f51e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eb42812b9514b96863176c67d04da7d', 'request_id': 'req-9afd7e5c-168b-43c0-a520-569398d5f51e'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:08.191631 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-9afd7e5c-168b-43c0-a520-569398d5f51e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eb42812b9514b96863176c67d04da7d', 'request_id': 'req-9afd7e5c-168b-43c0-a520-569398d5f51e'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:08.196833 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-9afd7e5c-168b-43c0-a520-569398d5f51e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eb42812b9514b96863176c67d04da7d', 'request_id': 'req-9afd7e5c-168b-43c0-a520-569398d5f51e'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:08.321561 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-9afd7e5c-168b-43c0-a520-569398d5f51e admin admin] The token cache is being invalidate because project 1eb42812b9514b96863176c67d04da7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:00:08.325601 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-9afd7e5c-168b-43c0-a520-569398d5f51e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:08.325601 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-9afd7e5c-168b-43c0-a520-569398d5f51e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:08.325601 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 909/1817] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:00:07 2022] DELETE /identity/v3/projects/1eb42812b9514b96863176c67d04da7d => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:08.331842 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da5cab-283f-4cb0-ba33-fddf1661823c None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:08.332092 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da5cab-283f-4cb0-ba33-fddf1661823c None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:08.332374 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da5cab-283f-4cb0-ba33-fddf1661823c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:08.360579 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-20da5cab-283f-4cb0-ba33-fddf1661823c None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:08.360579 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-20da5cab-283f-4cb0-ba33-fddf1661823c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:08.433231 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 909/1818] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:00:08.441251 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8d4e0-8c90-4c9b-b14d-662078ab3c99 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:08.441251 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8d4e0-8c90-4c9b-b14d-662078ab3c99 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:08.441251 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8d4e0-8c90-4c9b-b14d-662078ab3c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:08.456278 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-a8f8d4e0-8c90-4c9b-b14d-662078ab3c99 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:08.457399 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-a8f8d4e0-8c90-4c9b-b14d-662078ab3c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:08.465743 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 910/1819] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:00:08.470086 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da5cab-283f-4cb0-ba33-fddf1661823c None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:08.479575 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da5cab-283f-4cb0-ba33-fddf1661823c None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:08.484946 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e1788-07d2-43ad-b46e-57322e39d59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:08.485640 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e1788-07d2-43ad-b46e-57322e39d59b admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:08.485923 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e1788-07d2-43ad-b46e-57322e39d59b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:08.486229 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e1788-07d2-43ad-b46e-57322e39d59b admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:08.486963 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e1788-07d2-43ad-b46e-57322e39d59b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:00:08.487270 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e1788-07d2-43ad-b46e-57322e39d59b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:08.488883 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e1788-07d2-43ad-b46e-57322e39d59b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:08.504275 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 910/1820] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 15:00:08.505443 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8d4e0-8c90-4c9b-b14d-662078ab3c99 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:08.518748 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8d4e0-8c90-4c9b-b14d-662078ab3c99 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:08.524145 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35caab-3e25-4b34-80e7-0b54d858c9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:08.524876 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35caab-3e25-4b34-80e7-0b54d858c9e7 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:08.525250 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35caab-3e25-4b34-80e7-0b54d858c9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:08.527865 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35caab-3e25-4b34-80e7-0b54d858c9e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:08.527865 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35caab-3e25-4b34-80e7-0b54d858c9e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:08.528367 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35caab-3e25-4b34-80e7-0b54d858c9e7 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:08.710961 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 911/1821] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:00:08 2022] POST /identity/v3/projects => generated 385 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:00:08.715048 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e1788-07d2-43ad-b46e-57322e39d59b admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:08.725655 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e1788-07d2-43ad-b46e-57322e39d59b admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:08.782486 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ecd9b-1387-48f6-ae66-2f85a9c2dee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:08.783155 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ecd9b-1387-48f6-ae66-2f85a9c2dee2 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:08.783494 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ecd9b-1387-48f6-ae66-2f85a9c2dee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:08.783777 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ecd9b-1387-48f6-ae66-2f85a9c2dee2 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:08.784491 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ecd9b-1387-48f6-ae66-2f85a9c2dee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:08.786527 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ecd9b-1387-48f6-ae66-2f85a9c2dee2 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:08.906683 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 911/1822] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:00:08 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:00:08.910738 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35caab-3e25-4b34-80e7-0b54d858c9e7 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:08.921110 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35caab-3e25-4b34-80e7-0b54d858c9e7 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:08.926473 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591706d-607c-437b-b364-3d23e4c32139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:08.926899 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591706d-607c-437b-b364-3d23e4c32139 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:08.927181 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591706d-607c-437b-b364-3d23e4c32139 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:08.927462 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591706d-607c-437b-b364-3d23e4c32139 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:08.928198 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591706d-607c-437b-b364-3d23e4c32139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:08.929941 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591706d-607c-437b-b364-3d23e4c32139 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:08.940419 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 912/1823] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:00:08.944315 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ecd9b-1387-48f6-ae66-2f85a9c2dee2 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:08.954908 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ecd9b-1387-48f6-ae66-2f85a9c2dee2 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:08.962121 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f85ca-3d6b-4ccd-9659-63c92a94ccc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:08.962121 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f85ca-3d6b-4ccd-9659-63c92a94ccc1 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:08.962121 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f85ca-3d6b-4ccd-9659-63c92a94ccc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:08.962121 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f85ca-3d6b-4ccd-9659-63c92a94ccc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:08.962479 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f85ca-3d6b-4ccd-9659-63c92a94ccc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:08.963274 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f85ca-3d6b-4ccd-9659-63c92a94ccc1 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:08.966486 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591706d-607c-437b-b364-3d23e4c32139 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:08.968638 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-e591706d-607c-437b-b364-3d23e4c32139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:08.977106 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 912/1824] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:00:08.978382 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f85ca-3d6b-4ccd-9659-63c92a94ccc1 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:08.984590 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591706d-607c-437b-b364-3d23e4c32139 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:08.989434 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f85ca-3d6b-4ccd-9659-63c92a94ccc1 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:08.990323 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4599aa-353e-48c8-bec8-72a9c3a41423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:08.991180 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4599aa-353e-48c8-bec8-72a9c3a41423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:08.991465 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4599aa-353e-48c8-bec8-72a9c3a41423 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:08.991740 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4599aa-353e-48c8-bec8-72a9c3a41423 admin admin] PATH_INFO: `/v3/users/27ea27c814f14ba2860219a89dfaa762` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:08.992942 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4599aa-353e-48c8-bec8-72a9c3a41423 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27ea27c814f14ba2860219a89dfaa762)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:08.994473 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b50db-b565-44e5-a7a5-92cdf77b5e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:08.994898 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4599aa-353e-48c8-bec8-72a9c3a41423 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:08.995348 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b50db-b565-44e5-a7a5-92cdf77b5e83 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:08.995631 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b50db-b565-44e5-a7a5-92cdf77b5e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:08.995939 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b50db-b565-44e5-a7a5-92cdf77b5e83 admin admin] PATH_INFO: `/v3/projects/9516c82e7cd04567a9518309976f2a68/users/a85b78846e454dbdad0fae1778d6c144/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:09.013306 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b50db-b565-44e5-a7a5-92cdf77b5e83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9516c82e7cd04567a9518309976f2a68, user_id=a85b78846e454dbdad0fae1778d6c144, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:09.015996 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b50db-b565-44e5-a7a5-92cdf77b5e83 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:09.274851 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 913/1825] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:00:08 2022] PUT /identity/v3/projects/9516c82e7cd04567a9518309976f2a68/users/a85b78846e454dbdad0fae1778d6c144/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:09.283596 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bcd7a-7b37-40aa-9d24-aee4eedc9587 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:09.283888 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bcd7a-7b37-40aa-9d24-aee4eedc9587 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:09.284168 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bcd7a-7b37-40aa-9d24-aee4eedc9587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:09.310897 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-a50bcd7a-7b37-40aa-9d24-aee4eedc9587 None None] MFA Rules not processed for user `a85b78846e454dbdad0fae1778d6c144`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:09.312826 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-a50bcd7a-7b37-40aa-9d24-aee4eedc9587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:09.375525 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 914/1826] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:00:09.385127 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bcd7a-7b37-40aa-9d24-aee4eedc9587 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:09.386523 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-a50bcd7a-7b37-40aa-9d24-aee4eedc9587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:09.398886 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-cf4599aa-353e-48c8-bec8-72a9c3a41423 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27ea27c814f14ba2860219a89dfaa762'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:09.406728 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-cf4599aa-353e-48c8-bec8-72a9c3a41423 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27ea27c814f14ba2860219a89dfaa762'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:09.407420 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-cf4599aa-353e-48c8-bec8-72a9c3a41423 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27ea27c814f14ba2860219a89dfaa762'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:09.448283 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bcd7a-7b37-40aa-9d24-aee4eedc9587 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:09.453515 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a576f8a-4404-43e3-8a04-9526e0d791fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:09.454184 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a576f8a-4404-43e3-8a04-9526e0d791fb service cinder] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:09.454453 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a576f8a-4404-43e3-8a04-9526e0d791fb service cinder] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:09.454735 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a576f8a-4404-43e3-8a04-9526e0d791fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:09.463766 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a576f8a-4404-43e3-8a04-9526e0d791fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:09.465311 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a576f8a-4404-43e3-8a04-9526e0d791fb service cinder] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:09.480752 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 915/1827] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:00:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 15:00:09.505195 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-cf4599aa-353e-48c8-bec8-72a9c3a41423 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27ea27c814f14ba2860219a89dfaa762'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:09.527728 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-cf4599aa-353e-48c8-bec8-72a9c3a41423 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27ea27c814f14ba2860219a89dfaa762'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:09.539754 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 913/1828] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:00:08 2022] DELETE /identity/v3/users/27ea27c814f14ba2860219a89dfaa762 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:00:09.541238 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5431d8-1a44-4113-ba7d-eea776f6744b None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:09.545474 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5431d8-1a44-4113-ba7d-eea776f6744b None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:09.545474 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5431d8-1a44-4113-ba7d-eea776f6744b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:09.568056 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-8e5431d8-1a44-4113-ba7d-eea776f6744b None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:09.570962 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-8e5431d8-1a44-4113-ba7d-eea776f6744b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:09.643129 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 916/1829] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:00:09.657897 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4599aa-353e-48c8-bec8-72a9c3a41423 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:09.659522 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-cf4599aa-353e-48c8-bec8-72a9c3a41423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:09.733769 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4599aa-353e-48c8-bec8-72a9c3a41423 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:09.738452 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262fe37-2a5f-41ff-a2a3-0cec5c990bed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:09.739160 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262fe37-2a5f-41ff-a2a3-0cec5c990bed service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:09.739443 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262fe37-2a5f-41ff-a2a3-0cec5c990bed service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:09.750642 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262fe37-2a5f-41ff-a2a3-0cec5c990bed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:09.750642 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262fe37-2a5f-41ff-a2a3-0cec5c990bed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:09.752082 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262fe37-2a5f-41ff-a2a3-0cec5c990bed service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:09.784336 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 914/1830] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:00:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:00:10.318872 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5431d8-1a44-4113-ba7d-eea776f6744b None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:10.320440 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-8e5431d8-1a44-4113-ba7d-eea776f6744b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:10.361222 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5431d8-1a44-4113-ba7d-eea776f6744b None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:10.383294 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413d5dc-da74-41f2-b517-ddfe9da8e574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:10.383294 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413d5dc-da74-41f2-b517-ddfe9da8e574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:10.383294 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413d5dc-da74-41f2-b517-ddfe9da8e574 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:10.383294 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413d5dc-da74-41f2-b517-ddfe9da8e574 admin admin] PATH_INFO: `/v3/projects/1af8f554c27c4082857972f93ac139a2` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:10.383717 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413d5dc-da74-41f2-b517-ddfe9da8e574 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1af8f554c27c4082857972f93ac139a2)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:10.383717 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413d5dc-da74-41f2-b517-ddfe9da8e574 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:10.571423 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-2413d5dc-da74-41f2-b517-ddfe9da8e574 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1af8f554c27c4082857972f93ac139a2', 'request_id': 'req-2413d5dc-da74-41f2-b517-ddfe9da8e574'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:10.578777 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-2413d5dc-da74-41f2-b517-ddfe9da8e574 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1af8f554c27c4082857972f93ac139a2', 'request_id': 'req-2413d5dc-da74-41f2-b517-ddfe9da8e574'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:10.671643 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-2413d5dc-da74-41f2-b517-ddfe9da8e574 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1af8f554c27c4082857972f93ac139a2', 'request_id': 'req-2413d5dc-da74-41f2-b517-ddfe9da8e574'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:10.685768 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-2413d5dc-da74-41f2-b517-ddfe9da8e574 admin admin] The token cache is being invalidate because project 1af8f554c27c4082857972f93ac139a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:00:10.685768 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-2413d5dc-da74-41f2-b517-ddfe9da8e574 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:10.686232 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-2413d5dc-da74-41f2-b517-ddfe9da8e574 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:10.688535 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 917/1831] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:00:10 2022] DELETE /identity/v3/projects/1af8f554c27c4082857972f93ac139a2 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:10.692827 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262fe37-2a5f-41ff-a2a3-0cec5c990bed service neutron] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:10.706083 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262fe37-2a5f-41ff-a2a3-0cec5c990bed service neutron] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:10.766942 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf370c-2f2f-4b9c-89d0-641962dfd4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:10.767922 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf370c-2f2f-4b9c-89d0-641962dfd4f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:10.768217 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf370c-2f2f-4b9c-89d0-641962dfd4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:10.768491 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf370c-2f2f-4b9c-89d0-641962dfd4f7 admin admin] PATH_INFO: `/v3/users/f07c16d2ba5243818c84ca10d7ce7d7a` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:10.769856 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf370c-2f2f-4b9c-89d0-641962dfd4f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f07c16d2ba5243818c84ca10d7ce7d7a)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:10.771815 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf370c-2f2f-4b9c-89d0-641962dfd4f7 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:11.116005 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-fcdf370c-2f2f-4b9c-89d0-641962dfd4f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f07c16d2ba5243818c84ca10d7ce7d7a'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:11.122897 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-fcdf370c-2f2f-4b9c-89d0-641962dfd4f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f07c16d2ba5243818c84ca10d7ce7d7a'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:11.123585 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-fcdf370c-2f2f-4b9c-89d0-641962dfd4f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f07c16d2ba5243818c84ca10d7ce7d7a'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:11.237392 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-fcdf370c-2f2f-4b9c-89d0-641962dfd4f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f07c16d2ba5243818c84ca10d7ce7d7a'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:11.252513 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-fcdf370c-2f2f-4b9c-89d0-641962dfd4f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f07c16d2ba5243818c84ca10d7ce7d7a'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:11.260098 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 915/1832] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:00:10 2022] DELETE /identity/v3/users/f07c16d2ba5243818c84ca10d7ce7d7a => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:00:11.365741 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413d5dc-da74-41f2-b517-ddfe9da8e574 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:11.367658 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-2413d5dc-da74-41f2-b517-ddfe9da8e574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:11.381315 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413d5dc-da74-41f2-b517-ddfe9da8e574 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:11.451514 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666a109-1513-4300-9a57-ba5829bf6451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:11.452785 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666a109-1513-4300-9a57-ba5829bf6451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:11.457861 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666a109-1513-4300-9a57-ba5829bf6451 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:11.457861 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666a109-1513-4300-9a57-ba5829bf6451 admin admin] PATH_INFO: `/v3/users/d4a98c1eb7ba49a1801a1a67f29c43f7` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:11.457861 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666a109-1513-4300-9a57-ba5829bf6451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4a98c1eb7ba49a1801a1a67f29c43f7)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:11.457861 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666a109-1513-4300-9a57-ba5829bf6451 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:11.686985 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-6666a109-1513-4300-9a57-ba5829bf6451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4a98c1eb7ba49a1801a1a67f29c43f7'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:11.696396 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-6666a109-1513-4300-9a57-ba5829bf6451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4a98c1eb7ba49a1801a1a67f29c43f7'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:11.697332 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-6666a109-1513-4300-9a57-ba5829bf6451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4a98c1eb7ba49a1801a1a67f29c43f7'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:11.698342 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-6666a109-1513-4300-9a57-ba5829bf6451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4a98c1eb7ba49a1801a1a67f29c43f7'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:11.819314 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-6666a109-1513-4300-9a57-ba5829bf6451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4a98c1eb7ba49a1801a1a67f29c43f7'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:11.837691 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 918/1833] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:00:11 2022] DELETE /identity/v3/users/d4a98c1eb7ba49a1801a1a67f29c43f7 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:11.842225 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d0b14-8b11-4ee1-87fc-db81a8037aca None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:11.842667 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d0b14-8b11-4ee1-87fc-db81a8037aca None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:11.842783 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d0b14-8b11-4ee1-87fc-db81a8037aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:11.862050 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-fc1d0b14-8b11-4ee1-87fc-db81a8037aca None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:11.863251 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-fc1d0b14-8b11-4ee1-87fc-db81a8037aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:11.916980 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666a109-1513-4300-9a57-ba5829bf6451 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:11.919555 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-6666a109-1513-4300-9a57-ba5829bf6451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:11.946232 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 916/1834] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:00:11.959625 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d0b14-8b11-4ee1-87fc-db81a8037aca None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:11.961420 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-fc1d0b14-8b11-4ee1-87fc-db81a8037aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:12.014616 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666a109-1513-4300-9a57-ba5829bf6451 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:12.019487 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bcb12-4579-4f5d-8aad-0dd44f63e210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:12.020348 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bcb12-4579-4f5d-8aad-0dd44f63e210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:12.020632 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bcb12-4579-4f5d-8aad-0dd44f63e210 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:12.020939 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bcb12-4579-4f5d-8aad-0dd44f63e210 admin admin] PATH_INFO: `/v3/projects/bc90c0e1fa3f411e98c6f008e5d5285a` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:12.021534 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d0b14-8b11-4ee1-87fc-db81a8037aca None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:12.022358 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772bcb12-4579-4f5d-8aad-0dd44f63e210 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc90c0e1fa3f411e98c6f008e5d5285a)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:12.024271 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772bcb12-4579-4f5d-8aad-0dd44f63e210 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:12.025398 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f831b3-84da-4ffe-9503-7369e4a8f99e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:12.026047 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f831b3-84da-4ffe-9503-7369e4a8f99e service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:12.026327 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f831b3-84da-4ffe-9503-7369e4a8f99e service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:12.039375 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f831b3-84da-4ffe-9503-7369e4a8f99e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:12.039375 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f831b3-84da-4ffe-9503-7369e4a8f99e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:12.039375 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f831b3-84da-4ffe-9503-7369e4a8f99e service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:12.047935 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 917/1835] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:00:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:00:12.215862 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-772bcb12-4579-4f5d-8aad-0dd44f63e210 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc90c0e1fa3f411e98c6f008e5d5285a', 'request_id': 'req-772bcb12-4579-4f5d-8aad-0dd44f63e210'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:12.223180 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-772bcb12-4579-4f5d-8aad-0dd44f63e210 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc90c0e1fa3f411e98c6f008e5d5285a', 'request_id': 'req-772bcb12-4579-4f5d-8aad-0dd44f63e210'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:12.345519 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-772bcb12-4579-4f5d-8aad-0dd44f63e210 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc90c0e1fa3f411e98c6f008e5d5285a', 'request_id': 'req-772bcb12-4579-4f5d-8aad-0dd44f63e210'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:12.356805 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-772bcb12-4579-4f5d-8aad-0dd44f63e210 admin admin] The token cache is being invalidate because project bc90c0e1fa3f411e98c6f008e5d5285a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:00:12.357117 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-772bcb12-4579-4f5d-8aad-0dd44f63e210 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:12.357762 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-772bcb12-4579-4f5d-8aad-0dd44f63e210 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:12.359728 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 919/1836] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:00:11 2022] DELETE /identity/v3/projects/bc90c0e1fa3f411e98c6f008e5d5285a => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:12.368195 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026782f1-774d-4dc3-972d-b7dc37ae3f4b None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:12.368195 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026782f1-774d-4dc3-972d-b7dc37ae3f4b None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:12.368195 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026782f1-774d-4dc3-972d-b7dc37ae3f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:12.389444 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-026782f1-774d-4dc3-972d-b7dc37ae3f4b None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:12.391276 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-026782f1-774d-4dc3-972d-b7dc37ae3f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:12.453980 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 918/1837] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:00:12.461995 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc00c2b-1aee-4e16-a69b-85f2f6571b81 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:12.462289 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc00c2b-1aee-4e16-a69b-85f2f6571b81 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:12.462575 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc00c2b-1aee-4e16-a69b-85f2f6571b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:12.480785 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-4bc00c2b-1aee-4e16-a69b-85f2f6571b81 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:12.482036 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-4bc00c2b-1aee-4e16-a69b-85f2f6571b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:12.493797 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 920/1838] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:00:12.495031 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026782f1-774d-4dc3-972d-b7dc37ae3f4b None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:12.505014 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026782f1-774d-4dc3-972d-b7dc37ae3f4b None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:12.510100 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2174d0-e37a-4f44-8fa5-761d233aa668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:12.510791 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2174d0-e37a-4f44-8fa5-761d233aa668 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:12.511100 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2174d0-e37a-4f44-8fa5-761d233aa668 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:12.511378 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2174d0-e37a-4f44-8fa5-761d233aa668 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:12.512282 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2174d0-e37a-4f44-8fa5-761d233aa668 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:00:12.512532 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2174d0-e37a-4f44-8fa5-761d233aa668 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:12.514177 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2174d0-e37a-4f44-8fa5-761d233aa668 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:12.525707 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 919/1839] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 15:00:12.530260 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc00c2b-1aee-4e16-a69b-85f2f6571b81 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:12.543306 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc00c2b-1aee-4e16-a69b-85f2f6571b81 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:12.545313 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995328f3-6618-45fe-be82-af9a8fbd0d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:12.546010 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995328f3-6618-45fe-be82-af9a8fbd0d18 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:12.546845 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995328f3-6618-45fe-be82-af9a8fbd0d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:12.547124 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995328f3-6618-45fe-be82-af9a8fbd0d18 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:12.547828 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995328f3-6618-45fe-be82-af9a8fbd0d18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:12.549808 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995328f3-6618-45fe-be82-af9a8fbd0d18 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:12.576811 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2174d0-e37a-4f44-8fa5-761d233aa668 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:12.579058 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-9e2174d0-e37a-4f44-8fa5-761d233aa668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:12.592748 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2174d0-e37a-4f44-8fa5-761d233aa668 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:12.598633 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d64aa6-cf33-4704-93ab-af671e5e7bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:12.599402 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d64aa6-cf33-4704-93ab-af671e5e7bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:12.599726 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d64aa6-cf33-4704-93ab-af671e5e7bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:12.599933 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d64aa6-cf33-4704-93ab-af671e5e7bb3 admin admin] PATH_INFO: `/v3/projects/ecf16855511c4ec8a6d102b40f2f1d74` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:12.601396 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d64aa6-cf33-4704-93ab-af671e5e7bb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecf16855511c4ec8a6d102b40f2f1d74)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:12.603387 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d64aa6-cf33-4704-93ab-af671e5e7bb3 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:12.638670 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 921/1840] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:00:12 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:00:12.642845 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995328f3-6618-45fe-be82-af9a8fbd0d18 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:12.716788 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995328f3-6618-45fe-be82-af9a8fbd0d18 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:12.724187 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-06d64aa6-cf33-4704-93ab-af671e5e7bb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecf16855511c4ec8a6d102b40f2f1d74', 'request_id': 'req-06d64aa6-cf33-4704-93ab-af671e5e7bb3'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:12.733201 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-06d64aa6-cf33-4704-93ab-af671e5e7bb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecf16855511c4ec8a6d102b40f2f1d74', 'request_id': 'req-06d64aa6-cf33-4704-93ab-af671e5e7bb3'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:12.740903 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-06d64aa6-cf33-4704-93ab-af671e5e7bb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecf16855511c4ec8a6d102b40f2f1d74', 'request_id': 'req-06d64aa6-cf33-4704-93ab-af671e5e7bb3'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:12.800293 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371ffcb-397b-4572-ac2a-63023cd5d284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:12.801165 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371ffcb-397b-4572-ac2a-63023cd5d284 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:12.801650 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371ffcb-397b-4572-ac2a-63023cd5d284 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:12.802068 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371ffcb-397b-4572-ac2a-63023cd5d284 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:12.803053 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371ffcb-397b-4572-ac2a-63023cd5d284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:12.805231 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371ffcb-397b-4572-ac2a-63023cd5d284 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:12.823295 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-06d64aa6-cf33-4704-93ab-af671e5e7bb3 admin admin] The token cache is being invalidate because project ecf16855511c4ec8a6d102b40f2f1d74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:00:12.823636 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-06d64aa6-cf33-4704-93ab-af671e5e7bb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:12.824278 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-06d64aa6-cf33-4704-93ab-af671e5e7bb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:12.826267 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 920/1841] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:00:12 2022] DELETE /identity/v3/projects/ecf16855511c4ec8a6d102b40f2f1d74 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:12.829955 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d64aa6-cf33-4704-93ab-af671e5e7bb3 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:12.831505 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-06d64aa6-cf33-4704-93ab-af671e5e7bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:12.845176 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d64aa6-cf33-4704-93ab-af671e5e7bb3 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:12.850445 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e14aa-3903-4c6d-be51-220e3095039d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:12.851565 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e14aa-3903-4c6d-be51-220e3095039d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:12.852074 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e14aa-3903-4c6d-be51-220e3095039d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:12.852710 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e14aa-3903-4c6d-be51-220e3095039d admin admin] PATH_INFO: `/v3/users/d93b480fcf5343f5beb5844577f098a3` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:12.854125 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e14aa-3903-4c6d-be51-220e3095039d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d93b480fcf5343f5beb5844577f098a3)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:12.856319 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e14aa-3903-4c6d-be51-220e3095039d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:12.913555 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 922/1842] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:00:12 2022] POST /identity/v3/users => generated 288 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:00:12.914454 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371ffcb-397b-4572-ac2a-63023cd5d284 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:12.916792 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-7371ffcb-397b-4572-ac2a-63023cd5d284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:12.929872 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371ffcb-397b-4572-ac2a-63023cd5d284 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:12.935583 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92671b1a-cb1a-49bf-b070-1707b5a977ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:12.936279 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92671b1a-cb1a-49bf-b070-1707b5a977ea admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:12.936560 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92671b1a-cb1a-49bf-b070-1707b5a977ea admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:12.937561 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92671b1a-cb1a-49bf-b070-1707b5a977ea admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:12.938349 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92671b1a-cb1a-49bf-b070-1707b5a977ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:12.942772 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92671b1a-cb1a-49bf-b070-1707b5a977ea admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:12.950067 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 923/1843] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:00:12.954134 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92671b1a-cb1a-49bf-b070-1707b5a977ea admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:12.963947 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92671b1a-cb1a-49bf-b070-1707b5a977ea admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:12.968923 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3427b-d412-4aaa-b4fd-466892953389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:12.971561 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3427b-d412-4aaa-b4fd-466892953389 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:12.971561 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3427b-d412-4aaa-b4fd-466892953389 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:12.971561 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3427b-d412-4aaa-b4fd-466892953389 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:12.971561 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3427b-d412-4aaa-b4fd-466892953389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:12.972890 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3427b-d412-4aaa-b4fd-466892953389 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:12.987295 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 924/1844] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:00:12.988238 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3427b-d412-4aaa-b4fd-466892953389 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:12.997744 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3427b-d412-4aaa-b4fd-466892953389 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:13.002537 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb711a6c-e9f8-4680-b6db-f3a7ab2ca84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:13.003395 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb711a6c-e9f8-4680-b6db-f3a7ab2ca84b admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:13.005741 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb711a6c-e9f8-4680-b6db-f3a7ab2ca84b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:13.005741 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb711a6c-e9f8-4680-b6db-f3a7ab2ca84b admin admin] PATH_INFO: `/v3/projects/a58a92493d354f4c93ae830af1fd6fd6/users/42105480c9a24e599b1fb4f0a88d40c7/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:13.018962 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb711a6c-e9f8-4680-b6db-f3a7ab2ca84b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58a92493d354f4c93ae830af1fd6fd6, user_id=42105480c9a24e599b1fb4f0a88d40c7, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:13.021600 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb711a6c-e9f8-4680-b6db-f3a7ab2ca84b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:13.078024 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-de7e14aa-3903-4c6d-be51-220e3095039d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd93b480fcf5343f5beb5844577f098a3'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:13.084633 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-de7e14aa-3903-4c6d-be51-220e3095039d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd93b480fcf5343f5beb5844577f098a3'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:13.085303 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-de7e14aa-3903-4c6d-be51-220e3095039d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd93b480fcf5343f5beb5844577f098a3'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:13.099018 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 925/1845] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:00:12 2022] PUT /identity/v3/projects/a58a92493d354f4c93ae830af1fd6fd6/users/42105480c9a24e599b1fb4f0a88d40c7/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:00:13.111012 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefe8b7-a207-4d08-ae23-44b3b5c472a6 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:13.111301 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefe8b7-a207-4d08-ae23-44b3b5c472a6 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:13.111580 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefe8b7-a207-4d08-ae23-44b3b5c472a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:13.137587 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-8eefe8b7-a207-4d08-ae23-44b3b5c472a6 None None] MFA Rules not processed for user `42105480c9a24e599b1fb4f0a88d40c7`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:13.138698 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-8eefe8b7-a207-4d08-ae23-44b3b5c472a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:13.150402 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-de7e14aa-3903-4c6d-be51-220e3095039d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd93b480fcf5343f5beb5844577f098a3'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:13.162564 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-de7e14aa-3903-4c6d-be51-220e3095039d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd93b480fcf5343f5beb5844577f098a3'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:13.168781 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 921/1846] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:00:12 2022] DELETE /identity/v3/users/d93b480fcf5343f5beb5844577f098a3 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:00:13.201870 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 926/1847] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:00:13.212164 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e14aa-3903-4c6d-be51-220e3095039d admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:13.213619 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-de7e14aa-3903-4c6d-be51-220e3095039d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:13.275467 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e14aa-3903-4c6d-be51-220e3095039d admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:13.279151 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb4bdd-6809-437f-89f2-7f8bd19e1e58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:13.279872 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb4bdd-6809-437f-89f2-7f8bd19e1e58 service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:13.280152 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb4bdd-6809-437f-89f2-7f8bd19e1e58 service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:13.280949 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb4bdd-6809-437f-89f2-7f8bd19e1e58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:13.339782 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb4bdd-6809-437f-89f2-7f8bd19e1e58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:13.341409 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb4bdd-6809-437f-89f2-7f8bd19e1e58 service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:13.351548 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 922/1848] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:00:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:00:13.631216 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefe8b7-a207-4d08-ae23-44b3b5c472a6 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:13.631216 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-8eefe8b7-a207-4d08-ae23-44b3b5c472a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:13.694956 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefe8b7-a207-4d08-ae23-44b3b5c472a6 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:13.749157 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83dde22-a4d4-4ba5-877e-92c7ae638098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:13.750642 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dde22-a4d4-4ba5-877e-92c7ae638098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:13.750922 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dde22-a4d4-4ba5-877e-92c7ae638098 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:13.751229 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dde22-a4d4-4ba5-877e-92c7ae638098 admin admin] PATH_INFO: `/v3/projects/699a163c4a354ae0afd7674bc0d1562c` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:13.752411 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83dde22-a4d4-4ba5-877e-92c7ae638098 admin admin] RBAC: Authorizing `identity:delete_project(project_id=699a163c4a354ae0afd7674bc0d1562c)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:13.754379 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83dde22-a4d4-4ba5-877e-92c7ae638098 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:13.888306 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b83dde22-a4d4-4ba5-877e-92c7ae638098 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '699a163c4a354ae0afd7674bc0d1562c', 'request_id': 'req-b83dde22-a4d4-4ba5-877e-92c7ae638098'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:13.894595 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b83dde22-a4d4-4ba5-877e-92c7ae638098 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '699a163c4a354ae0afd7674bc0d1562c', 'request_id': 'req-b83dde22-a4d4-4ba5-877e-92c7ae638098'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:13.996791 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b83dde22-a4d4-4ba5-877e-92c7ae638098 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '699a163c4a354ae0afd7674bc0d1562c', 'request_id': 'req-b83dde22-a4d4-4ba5-877e-92c7ae638098'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:14.007968 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b83dde22-a4d4-4ba5-877e-92c7ae638098 admin admin] The token cache is being invalidate because project 699a163c4a354ae0afd7674bc0d1562c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:00:14.008258 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b83dde22-a4d4-4ba5-877e-92c7ae638098 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:14.008885 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b83dde22-a4d4-4ba5-877e-92c7ae638098 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:14.010560 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 927/1849] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:00:13 2022] DELETE /identity/v3/projects/699a163c4a354ae0afd7674bc0d1562c => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:14.016756 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f935b-a54a-4d71-96be-7d4386301d7f None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:14.017301 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f935b-a54a-4d71-96be-7d4386301d7f None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:14.017389 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f935b-a54a-4d71-96be-7d4386301d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:14.049753 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-690f935b-a54a-4d71-96be-7d4386301d7f None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:14.051939 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-690f935b-a54a-4d71-96be-7d4386301d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:14.119395 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 923/1850] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:00:14.127564 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0ab4f-4dcf-4271-96c2-2322a7fb44a2 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:14.132328 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0ab4f-4dcf-4271-96c2-2322a7fb44a2 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:14.132328 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0ab4f-4dcf-4271-96c2-2322a7fb44a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:14.147678 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-1ea0ab4f-4dcf-4271-96c2-2322a7fb44a2 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:14.148981 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-1ea0ab4f-4dcf-4271-96c2-2322a7fb44a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:14.163366 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 928/1851] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:00:14.164752 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f935b-a54a-4d71-96be-7d4386301d7f None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:14.175483 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f935b-a54a-4d71-96be-7d4386301d7f None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:14.180215 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b00c97-ceea-4540-8a5a-1c3c793d63c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:14.180899 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b00c97-ceea-4540-8a5a-1c3c793d63c1 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:14.181220 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b00c97-ceea-4540-8a5a-1c3c793d63c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:14.181496 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b00c97-ceea-4540-8a5a-1c3c793d63c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:14.182226 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b00c97-ceea-4540-8a5a-1c3c793d63c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:00:14.182526 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b00c97-ceea-4540-8a5a-1c3c793d63c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:14.184154 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b00c97-ceea-4540-8a5a-1c3c793d63c1 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:14.195897 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 924/1852] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 15:00:14.200340 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0ab4f-4dcf-4271-96c2-2322a7fb44a2 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:14.210004 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0ab4f-4dcf-4271-96c2-2322a7fb44a2 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:14.214927 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50a599-aa08-4d74-bb2e-e51c897fb5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:14.215569 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50a599-aa08-4d74-bb2e-e51c897fb5e8 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:14.218388 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50a599-aa08-4d74-bb2e-e51c897fb5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:14.218388 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50a599-aa08-4d74-bb2e-e51c897fb5e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:14.218388 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50a599-aa08-4d74-bb2e-e51c897fb5e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:14.218827 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50a599-aa08-4d74-bb2e-e51c897fb5e8 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:14.352624 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 929/1853] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:00:14 2022] POST /identity/v3/projects => generated 363 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:00:14.357285 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b00c97-ceea-4540-8a5a-1c3c793d63c1 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:14.372511 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b00c97-ceea-4540-8a5a-1c3c793d63c1 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:14.431530 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e41a20-f03f-4efe-9a9c-3c5210356a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:14.432549 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e41a20-f03f-4efe-9a9c-3c5210356a7f admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:14.432862 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e41a20-f03f-4efe-9a9c-3c5210356a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:14.433181 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e41a20-f03f-4efe-9a9c-3c5210356a7f admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:14.433923 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e41a20-f03f-4efe-9a9c-3c5210356a7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:14.436082 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e41a20-f03f-4efe-9a9c-3c5210356a7f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:14.533903 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50a599-aa08-4d74-bb2e-e51c897fb5e8 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:14.540853 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 925/1854] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:00:14 2022] POST /identity/v3/users => generated 282 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:00:14.544380 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50a599-aa08-4d74-bb2e-e51c897fb5e8 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:14.549191 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d7a62-9368-4fbe-9ca8-d25c96893c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:14.549888 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d7a62-9368-4fbe-9ca8-d25c96893c0a admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:14.550167 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d7a62-9368-4fbe-9ca8-d25c96893c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:14.550442 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d7a62-9368-4fbe-9ca8-d25c96893c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:14.551179 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d7a62-9368-4fbe-9ca8-d25c96893c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:14.552875 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d7a62-9368-4fbe-9ca8-d25c96893c0a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:14.563782 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 930/1855] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:00:14.567959 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e41a20-f03f-4efe-9a9c-3c5210356a7f admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:14.578400 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e41a20-f03f-4efe-9a9c-3c5210356a7f admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:14.582716 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4126e-2938-4d5a-ba32-27b454e2da3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:14.583456 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4126e-2938-4d5a-ba32-27b454e2da3b admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:14.583736 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4126e-2938-4d5a-ba32-27b454e2da3b admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:14.584007 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4126e-2938-4d5a-ba32-27b454e2da3b admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:14.584733 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4126e-2938-4d5a-ba32-27b454e2da3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:14.586358 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4126e-2938-4d5a-ba32-27b454e2da3b admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:14.596865 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 926/1856] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:00:14.601168 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d7a62-9368-4fbe-9ca8-d25c96893c0a admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:14.611259 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d7a62-9368-4fbe-9ca8-d25c96893c0a admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:14.615896 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de088dc2-e214-46e5-94e7-05e9a141a2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:14.624000 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de088dc2-e214-46e5-94e7-05e9a141a2ca admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:14.624000 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de088dc2-e214-46e5-94e7-05e9a141a2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:14.624000 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de088dc2-e214-46e5-94e7-05e9a141a2ca admin admin] PATH_INFO: `/v3/projects/29572d5cbb0847bab8664679e31ad7b5/users/54356e9db8fb4820b632b10848715ded/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:14.632682 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de088dc2-e214-46e5-94e7-05e9a141a2ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=29572d5cbb0847bab8664679e31ad7b5, user_id=54356e9db8fb4820b632b10848715ded, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:14.635520 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de088dc2-e214-46e5-94e7-05e9a141a2ca admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:14.734202 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 931/1857] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:00:14 2022] PUT /identity/v3/projects/29572d5cbb0847bab8664679e31ad7b5/users/54356e9db8fb4820b632b10848715ded/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:14.745400 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892116ba-6e85-48c1-b125-07a512b1b955 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:14.745688 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892116ba-6e85-48c1-b125-07a512b1b955 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:14.745965 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892116ba-6e85-48c1-b125-07a512b1b955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:14.772770 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-892116ba-6e85-48c1-b125-07a512b1b955 None None] MFA Rules not processed for user `54356e9db8fb4820b632b10848715ded`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:14.773995 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-892116ba-6e85-48c1-b125-07a512b1b955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:14.833356 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 927/1858] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:14 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:00:14.837771 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de088dc2-e214-46e5-94e7-05e9a141a2ca admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:14.897614 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de088dc2-e214-46e5-94e7-05e9a141a2ca admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:14.902387 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407884d0-53d6-46b3-9db6-71a4a183ae34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:14.903038 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407884d0-53d6-46b3-9db6-71a4a183ae34 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:14.903321 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407884d0-53d6-46b3-9db6-71a4a183ae34 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:14.903648 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407884d0-53d6-46b3-9db6-71a4a183ae34 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:14.904304 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407884d0-53d6-46b3-9db6-71a4a183ae34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:14.907163 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407884d0-53d6-46b3-9db6-71a4a183ae34 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:15.032902 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 932/1859] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:00:14 2022] POST /identity/v3/projects => generated 365 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:00:15.034039 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892116ba-6e85-48c1-b125-07a512b1b955 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:15.044845 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892116ba-6e85-48c1-b125-07a512b1b955 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:15.101347 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6db1c-f239-421b-bd4e-fc9fc226d31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:15.102030 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6db1c-f239-421b-bd4e-fc9fc226d31c admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:15.102317 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6db1c-f239-421b-bd4e-fc9fc226d31c admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:15.102591 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6db1c-f239-421b-bd4e-fc9fc226d31c admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:15.103306 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6db1c-f239-421b-bd4e-fc9fc226d31c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:15.105505 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6db1c-f239-421b-bd4e-fc9fc226d31c admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:15.199174 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 928/1860] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:00:15 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:00:15.200792 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407884d0-53d6-46b3-9db6-71a4a183ae34 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:15.212362 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407884d0-53d6-46b3-9db6-71a4a183ae34 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:15.217146 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90db07-d0e4-418c-a7bf-bd805f0f30fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:15.217863 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90db07-d0e4-418c-a7bf-bd805f0f30fe admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:15.218174 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90db07-d0e4-418c-a7bf-bd805f0f30fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:15.218482 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90db07-d0e4-418c-a7bf-bd805f0f30fe admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:15.219220 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c90db07-d0e4-418c-a7bf-bd805f0f30fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:15.220812 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c90db07-d0e4-418c-a7bf-bd805f0f30fe admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:15.231895 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 933/1861] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:00:15.236618 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6db1c-f239-421b-bd4e-fc9fc226d31c admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:15.246407 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6db1c-f239-421b-bd4e-fc9fc226d31c admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:15.251658 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f391c9-6db3-47d7-b89f-b15dd364d7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:15.252547 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f391c9-6db3-47d7-b89f-b15dd364d7ed admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:15.252824 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f391c9-6db3-47d7-b89f-b15dd364d7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:15.253222 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f391c9-6db3-47d7-b89f-b15dd364d7ed admin admin] PATH_INFO: `/v3/projects/1a02745c139b45baa1fd9d5289f9599e/users/acf25d5cfbd64b1280555810aa0f815d/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:15.269256 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f391c9-6db3-47d7-b89f-b15dd364d7ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a02745c139b45baa1fd9d5289f9599e, user_id=acf25d5cfbd64b1280555810aa0f815d, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:15.271968 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f391c9-6db3-47d7-b89f-b15dd364d7ed admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:15.351125 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 929/1862] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:00:15 2022] PUT /identity/v3/projects/1a02745c139b45baa1fd9d5289f9599e/users/acf25d5cfbd64b1280555810aa0f815d/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:15.355229 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90db07-d0e4-418c-a7bf-bd805f0f30fe admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:15.365249 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90db07-d0e4-418c-a7bf-bd805f0f30fe admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:15.422036 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d42b2-5381-4a88-9a97-8c41f1b75487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:15.422704 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d42b2-5381-4a88-9a97-8c41f1b75487 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:15.422984 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d42b2-5381-4a88-9a97-8c41f1b75487 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:15.423259 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d42b2-5381-4a88-9a97-8c41f1b75487 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:15.423990 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d42b2-5381-4a88-9a97-8c41f1b75487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:15.425624 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d42b2-5381-4a88-9a97-8c41f1b75487 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:15.437950 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 934/1863] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:00:15.440675 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f391c9-6db3-47d7-b89f-b15dd364d7ed admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:15.450903 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f391c9-6db3-47d7-b89f-b15dd364d7ed admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:15.455641 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f79bc-89ba-428d-8138-cdfed952ee03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:15.456534 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f79bc-89ba-428d-8138-cdfed952ee03 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:15.456799 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f79bc-89ba-428d-8138-cdfed952ee03 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:15.457092 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f79bc-89ba-428d-8138-cdfed952ee03 admin admin] PATH_INFO: `/v3/projects/1a02745c139b45baa1fd9d5289f9599e/users/acf25d5cfbd64b1280555810aa0f815d/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:15.459090 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f79bc-89ba-428d-8138-cdfed952ee03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a02745c139b45baa1fd9d5289f9599e, user_id=acf25d5cfbd64b1280555810aa0f815d, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:15.461791 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f79bc-89ba-428d-8138-cdfed952ee03 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:15.472933 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 930/1864] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:00:15 2022] PUT /identity/v3/projects/1a02745c139b45baa1fd9d5289f9599e/users/acf25d5cfbd64b1280555810aa0f815d/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:15.485211 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e104a-505d-46dd-836b-1a9e3efce848 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:15.485693 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e104a-505d-46dd-836b-1a9e3efce848 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:15.486204 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e104a-505d-46dd-836b-1a9e3efce848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:15.522477 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-260e104a-505d-46dd-836b-1a9e3efce848 None None] MFA Rules not processed for user `acf25d5cfbd64b1280555810aa0f815d`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:15.523676 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-260e104a-505d-46dd-836b-1a9e3efce848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:15.596163 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 935/1865] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:15 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:00:15.606503 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f79bc-89ba-428d-8138-cdfed952ee03 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:15.608209 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-4a3f79bc-89ba-428d-8138-cdfed952ee03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:15.667518 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f79bc-89ba-428d-8138-cdfed952ee03 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:15.671834 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9cc81-30b4-44bd-a96a-1497a48b6845 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:15.672481 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9cc81-30b4-44bd-a96a-1497a48b6845 service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:15.672764 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9cc81-30b4-44bd-a96a-1497a48b6845 service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:15.673038 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9cc81-30b4-44bd-a96a-1497a48b6845 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:15.683572 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9cc81-30b4-44bd-a96a-1497a48b6845 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:15.685276 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9cc81-30b4-44bd-a96a-1497a48b6845 service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:15.696555 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 931/1866] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:00:15 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:00:16.125179 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e104a-505d-46dd-836b-1a9e3efce848 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:16.134474 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e104a-505d-46dd-836b-1a9e3efce848 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:16.138151 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc63037-06ee-4423-8730-355d9c6ac0cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:16.138806 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc63037-06ee-4423-8730-355d9c6ac0cf service cinder] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:16.139181 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc63037-06ee-4423-8730-355d9c6ac0cf service cinder] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:16.139464 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc63037-06ee-4423-8730-355d9c6ac0cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:16.200142 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc63037-06ee-4423-8730-355d9c6ac0cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:16.202864 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc63037-06ee-4423-8730-355d9c6ac0cf service cinder] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:16.212305 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 936/1867] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:00:16 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:00:22.731822 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9cc81-30b4-44bd-a96a-1497a48b6845 service cinder] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:22.798527 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9cc81-30b4-44bd-a96a-1497a48b6845 service cinder] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:22.809810 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6289f-d7ec-4708-9d90-433fc8ef17ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:22.810709 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6289f-d7ec-4708-9d90-433fc8ef17ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:22.810995 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6289f-d7ec-4708-9d90-433fc8ef17ac admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:22.811273 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6289f-d7ec-4708-9d90-433fc8ef17ac admin admin] PATH_INFO: `/v3/users/54356e9db8fb4820b632b10848715ded` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:22.812816 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6289f-d7ec-4708-9d90-433fc8ef17ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=54356e9db8fb4820b632b10848715ded)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:22.815092 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6289f-d7ec-4708-9d90-433fc8ef17ac admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:23.075280 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-05d6289f-d7ec-4708-9d90-433fc8ef17ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54356e9db8fb4820b632b10848715ded'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:23.083232 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-05d6289f-d7ec-4708-9d90-433fc8ef17ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54356e9db8fb4820b632b10848715ded'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:23.083978 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-05d6289f-d7ec-4708-9d90-433fc8ef17ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54356e9db8fb4820b632b10848715ded'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:23.176890 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-05d6289f-d7ec-4708-9d90-433fc8ef17ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54356e9db8fb4820b632b10848715ded'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:23.188911 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-05d6289f-d7ec-4708-9d90-433fc8ef17ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54356e9db8fb4820b632b10848715ded'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:23.194786 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 932/1868] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:00:22 2022] DELETE /identity/v3/users/54356e9db8fb4820b632b10848715ded => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:23.199745 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9997d-2879-4b06-a586-51a54931335d None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:23.200280 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9997d-2879-4b06-a586-51a54931335d None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:23.200436 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9997d-2879-4b06-a586-51a54931335d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:23.217476 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-3ec9997d-2879-4b06-a586-51a54931335d None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:23.220200 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-3ec9997d-2879-4b06-a586-51a54931335d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:23.276747 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 937/1869] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:00:23.286624 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6289f-d7ec-4708-9d90-433fc8ef17ac admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:23.288016 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-05d6289f-d7ec-4708-9d90-433fc8ef17ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:23.345233 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6289f-d7ec-4708-9d90-433fc8ef17ac admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:23.349277 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39125dcc-96d7-4fd7-98d8-48d3778c152e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:23.350053 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39125dcc-96d7-4fd7-98d8-48d3778c152e service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:23.350376 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39125dcc-96d7-4fd7-98d8-48d3778c152e service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:23.350706 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39125dcc-96d7-4fd7-98d8-48d3778c152e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:23.361774 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39125dcc-96d7-4fd7-98d8-48d3778c152e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:23.363517 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39125dcc-96d7-4fd7-98d8-48d3778c152e service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:23.374462 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 933/1870] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:00:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:00:23.805209 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9997d-2879-4b06-a586-51a54931335d None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:23.811457 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-3ec9997d-2879-4b06-a586-51a54931335d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:23.828399 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9997d-2879-4b06-a586-51a54931335d None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:23.835617 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb3dac-c54f-473a-a3a8-39458a78ba95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:23.836776 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb3dac-c54f-473a-a3a8-39458a78ba95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:23.837239 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb3dac-c54f-473a-a3a8-39458a78ba95 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:23.837711 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb3dac-c54f-473a-a3a8-39458a78ba95 admin admin] PATH_INFO: `/v3/projects/29572d5cbb0847bab8664679e31ad7b5` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:23.840552 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb3dac-c54f-473a-a3a8-39458a78ba95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29572d5cbb0847bab8664679e31ad7b5)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:23.843308 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb3dac-c54f-473a-a3a8-39458a78ba95 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:24.003118 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-aacb3dac-c54f-473a-a3a8-39458a78ba95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29572d5cbb0847bab8664679e31ad7b5', 'request_id': 'req-aacb3dac-c54f-473a-a3a8-39458a78ba95'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:24.018180 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-aacb3dac-c54f-473a-a3a8-39458a78ba95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29572d5cbb0847bab8664679e31ad7b5', 'request_id': 'req-aacb3dac-c54f-473a-a3a8-39458a78ba95'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:24.133821 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-aacb3dac-c54f-473a-a3a8-39458a78ba95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29572d5cbb0847bab8664679e31ad7b5', 'request_id': 'req-aacb3dac-c54f-473a-a3a8-39458a78ba95'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:24.146224 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-aacb3dac-c54f-473a-a3a8-39458a78ba95 admin admin] The token cache is being invalidate because project 29572d5cbb0847bab8664679e31ad7b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:00:24.146644 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-aacb3dac-c54f-473a-a3a8-39458a78ba95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:24.147444 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-aacb3dac-c54f-473a-a3a8-39458a78ba95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:24.151873 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 938/1871] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:00:23 2022] DELETE /identity/v3/projects/29572d5cbb0847bab8664679e31ad7b5 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:24.153300 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39125dcc-96d7-4fd7-98d8-48d3778c152e service neutron] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:24.164925 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39125dcc-96d7-4fd7-98d8-48d3778c152e service neutron] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:24.223209 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f19e0a-94e8-4fab-adf6-e677c14abd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:24.224014 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f19e0a-94e8-4fab-adf6-e677c14abd34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:24.224297 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f19e0a-94e8-4fab-adf6-e677c14abd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:24.224577 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f19e0a-94e8-4fab-adf6-e677c14abd34 admin admin] PATH_INFO: `/v3/users/acf25d5cfbd64b1280555810aa0f815d` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:24.225799 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f19e0a-94e8-4fab-adf6-e677c14abd34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acf25d5cfbd64b1280555810aa0f815d)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:24.227728 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f19e0a-94e8-4fab-adf6-e677c14abd34 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:24.496759 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-d9f19e0a-94e8-4fab-adf6-e677c14abd34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acf25d5cfbd64b1280555810aa0f815d'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:24.504354 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-d9f19e0a-94e8-4fab-adf6-e677c14abd34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acf25d5cfbd64b1280555810aa0f815d'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:24.505147 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-d9f19e0a-94e8-4fab-adf6-e677c14abd34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acf25d5cfbd64b1280555810aa0f815d'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:24.582443 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-d9f19e0a-94e8-4fab-adf6-e677c14abd34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acf25d5cfbd64b1280555810aa0f815d'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:24.595426 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-d9f19e0a-94e8-4fab-adf6-e677c14abd34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acf25d5cfbd64b1280555810aa0f815d'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:24.601528 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 934/1872] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:00:24 2022] DELETE /identity/v3/users/acf25d5cfbd64b1280555810aa0f815d => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:25.233147 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb3dac-c54f-473a-a3a8-39458a78ba95 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:25.236622 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-aacb3dac-c54f-473a-a3a8-39458a78ba95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:25.253700 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb3dac-c54f-473a-a3a8-39458a78ba95 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:25.309566 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a82fcc-23ea-400c-9f14-1bf8242df71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:25.310334 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a82fcc-23ea-400c-9f14-1bf8242df71a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:25.310614 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a82fcc-23ea-400c-9f14-1bf8242df71a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:25.310885 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a82fcc-23ea-400c-9f14-1bf8242df71a admin admin] PATH_INFO: `/v3/projects/1a02745c139b45baa1fd9d5289f9599e` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:25.312606 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a82fcc-23ea-400c-9f14-1bf8242df71a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a02745c139b45baa1fd9d5289f9599e)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:25.314552 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a82fcc-23ea-400c-9f14-1bf8242df71a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:25.541911 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-87a82fcc-23ea-400c-9f14-1bf8242df71a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a02745c139b45baa1fd9d5289f9599e', 'request_id': 'req-87a82fcc-23ea-400c-9f14-1bf8242df71a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:25.548977 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-87a82fcc-23ea-400c-9f14-1bf8242df71a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a02745c139b45baa1fd9d5289f9599e', 'request_id': 'req-87a82fcc-23ea-400c-9f14-1bf8242df71a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:25.622365 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-87a82fcc-23ea-400c-9f14-1bf8242df71a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a02745c139b45baa1fd9d5289f9599e', 'request_id': 'req-87a82fcc-23ea-400c-9f14-1bf8242df71a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:25.634389 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-87a82fcc-23ea-400c-9f14-1bf8242df71a admin admin] The token cache is being invalidate because project 1a02745c139b45baa1fd9d5289f9599e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:00:25.640525 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-87a82fcc-23ea-400c-9f14-1bf8242df71a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:25.640525 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-87a82fcc-23ea-400c-9f14-1bf8242df71a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:25.640525 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 939/1873] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:00:25 2022] DELETE /identity/v3/projects/1a02745c139b45baa1fd9d5289f9599e => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:25.645234 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55681cd-fa2f-45c9-9312-7df9c20058f8 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:25.645732 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55681cd-fa2f-45c9-9312-7df9c20058f8 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:25.645835 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55681cd-fa2f-45c9-9312-7df9c20058f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:25.664640 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-d55681cd-fa2f-45c9-9312-7df9c20058f8 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:25.665896 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-d55681cd-fa2f-45c9-9312-7df9c20058f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:25.727512 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 935/1874] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:00:25.735592 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b72fb8-af6b-403c-ac5f-c243a09c117d None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:25.735886 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b72fb8-af6b-403c-ac5f-c243a09c117d None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:25.736181 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b72fb8-af6b-403c-ac5f-c243a09c117d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:25.754862 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-22b72fb8-af6b-403c-ac5f-c243a09c117d None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:25.760734 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-22b72fb8-af6b-403c-ac5f-c243a09c117d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:25.764082 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 940/1875] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:00:25.768927 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55681cd-fa2f-45c9-9312-7df9c20058f8 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:25.778771 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55681cd-fa2f-45c9-9312-7df9c20058f8 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:25.785605 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28cd07-4cff-44ce-93ec-b775bdda5a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:25.786280 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28cd07-4cff-44ce-93ec-b775bdda5a8e admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:25.786562 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28cd07-4cff-44ce-93ec-b775bdda5a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:25.786837 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28cd07-4cff-44ce-93ec-b775bdda5a8e admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:25.787573 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28cd07-4cff-44ce-93ec-b775bdda5a8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:00:25.787887 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28cd07-4cff-44ce-93ec-b775bdda5a8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:25.789546 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28cd07-4cff-44ce-93ec-b775bdda5a8e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:25.809775 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 936/1876] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 15:00:25.811008 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b72fb8-af6b-403c-ac5f-c243a09c117d None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:25.824612 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b72fb8-af6b-403c-ac5f-c243a09c117d None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:25.829955 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c297111-4b95-4fec-992b-397f65579585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:25.835898 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c297111-4b95-4fec-992b-397f65579585 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:25.835898 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c297111-4b95-4fec-992b-397f65579585 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:25.835898 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c297111-4b95-4fec-992b-397f65579585 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:25.835898 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c297111-4b95-4fec-992b-397f65579585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:25.835898 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c297111-4b95-4fec-992b-397f65579585 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:26.021708 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 941/1877] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:00:25 2022] POST /identity/v3/projects => generated 381 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:00:26.025629 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28cd07-4cff-44ce-93ec-b775bdda5a8e admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:26.038100 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28cd07-4cff-44ce-93ec-b775bdda5a8e admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:26.105302 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a53e1-f41f-4c2d-9b40-7db4e7b4844e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:26.105978 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a53e1-f41f-4c2d-9b40-7db4e7b4844e admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:26.106262 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a53e1-f41f-4c2d-9b40-7db4e7b4844e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:26.106540 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a53e1-f41f-4c2d-9b40-7db4e7b4844e admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:26.107253 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a53e1-f41f-4c2d-9b40-7db4e7b4844e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:26.109469 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a53e1-f41f-4c2d-9b40-7db4e7b4844e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:26.242046 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c297111-4b95-4fec-992b-397f65579585 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:26.246388 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 937/1878] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:00:26 2022] POST /identity/v3/users => generated 291 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:00:26.254340 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c297111-4b95-4fec-992b-397f65579585 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:26.260861 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15843581-489b-40e7-bc82-f5cd3a610f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:26.261818 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15843581-489b-40e7-bc82-f5cd3a610f4e admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:26.262247 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15843581-489b-40e7-bc82-f5cd3a610f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:26.262621 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15843581-489b-40e7-bc82-f5cd3a610f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:26.263587 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15843581-489b-40e7-bc82-f5cd3a610f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:26.265956 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15843581-489b-40e7-bc82-f5cd3a610f4e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:26.283366 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 942/1879] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:00:26.284903 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a53e1-f41f-4c2d-9b40-7db4e7b4844e admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:26.295525 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a53e1-f41f-4c2d-9b40-7db4e7b4844e admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:26.300193 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f17de-dd95-4c94-898b-6b33dc4c8aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:26.300846 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f17de-dd95-4c94-898b-6b33dc4c8aec admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:26.301272 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f17de-dd95-4c94-898b-6b33dc4c8aec admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:26.301523 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f17de-dd95-4c94-898b-6b33dc4c8aec admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:26.302283 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f17de-dd95-4c94-898b-6b33dc4c8aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:26.303869 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f17de-dd95-4c94-898b-6b33dc4c8aec admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:26.314657 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 938/1880] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:00:26.318837 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15843581-489b-40e7-bc82-f5cd3a610f4e admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:26.330009 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15843581-489b-40e7-bc82-f5cd3a610f4e admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:26.334727 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4013bd-e03c-4106-abbd-1ef59763c151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:26.335703 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4013bd-e03c-4106-abbd-1ef59763c151 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:26.335994 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4013bd-e03c-4106-abbd-1ef59763c151 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:26.336266 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4013bd-e03c-4106-abbd-1ef59763c151 admin admin] PATH_INFO: `/v3/projects/d2e70120e3df4e20809c528d5ec9b559/users/cfe67740b0bd4119abbda24750f8ab16/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:26.351381 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4013bd-e03c-4106-abbd-1ef59763c151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e70120e3df4e20809c528d5ec9b559, user_id=cfe67740b0bd4119abbda24750f8ab16, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:26.354108 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4013bd-e03c-4106-abbd-1ef59763c151 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:26.460346 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 943/1881] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:00:26 2022] PUT /identity/v3/projects/d2e70120e3df4e20809c528d5ec9b559/users/cfe67740b0bd4119abbda24750f8ab16/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:00:26.471773 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81637795-f24d-4770-9996-a7850ff5e183 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:26.472163 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81637795-f24d-4770-9996-a7850ff5e183 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:26.472536 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81637795-f24d-4770-9996-a7850ff5e183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:26.501866 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-81637795-f24d-4770-9996-a7850ff5e183 None None] MFA Rules not processed for user `cfe67740b0bd4119abbda24750f8ab16`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:26.503071 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-81637795-f24d-4770-9996-a7850ff5e183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:26.564439 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 939/1882] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:00:26.568871 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4013bd-e03c-4106-abbd-1ef59763c151 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:26.630401 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4013bd-e03c-4106-abbd-1ef59763c151 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:26.635586 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdbcce-0b37-490c-a85d-3b7ef5e5995b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:26.636274 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdbcce-0b37-490c-a85d-3b7ef5e5995b admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:26.636563 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdbcce-0b37-490c-a85d-3b7ef5e5995b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:26.636845 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdbcce-0b37-490c-a85d-3b7ef5e5995b admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:26.637593 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fdbcce-0b37-490c-a85d-3b7ef5e5995b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:26.639524 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fdbcce-0b37-490c-a85d-3b7ef5e5995b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:26.717221 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 944/1883] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:00:26 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:00:26.717332 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81637795-f24d-4770-9996-a7850ff5e183 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:26.727950 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81637795-f24d-4770-9996-a7850ff5e183 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:26.788953 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36117248-6310-49b5-9c5b-feccc627befe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:26.789693 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36117248-6310-49b5-9c5b-feccc627befe admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:26.789978 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36117248-6310-49b5-9c5b-feccc627befe admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:26.790249 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36117248-6310-49b5-9c5b-feccc627befe admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:26.790952 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36117248-6310-49b5-9c5b-feccc627befe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:26.792839 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36117248-6310-49b5-9c5b-feccc627befe admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:26.915767 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 940/1884] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:00:26 2022] POST /identity/v3/users => generated 298 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:00:26.924369 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdbcce-0b37-490c-a85d-3b7ef5e5995b admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:26.934500 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdbcce-0b37-490c-a85d-3b7ef5e5995b admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:26.939783 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6b32c-4668-4bd2-9bad-92ada5c24220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:26.944958 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6b32c-4668-4bd2-9bad-92ada5c24220 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:26.944958 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6b32c-4668-4bd2-9bad-92ada5c24220 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:26.944958 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6b32c-4668-4bd2-9bad-92ada5c24220 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:26.944958 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6b32c-4668-4bd2-9bad-92ada5c24220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:26.944958 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6b32c-4668-4bd2-9bad-92ada5c24220 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:26.967825 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 945/1885] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:00:26.971942 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36117248-6310-49b5-9c5b-feccc627befe admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:26.983515 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36117248-6310-49b5-9c5b-feccc627befe admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:26.988779 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5f6b7-4182-4736-b3c1-da23acb700ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:26.989950 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5f6b7-4182-4736-b3c1-da23acb700ae admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:26.990551 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5f6b7-4182-4736-b3c1-da23acb700ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:26.990630 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5f6b7-4182-4736-b3c1-da23acb700ae admin admin] PATH_INFO: `/v3/projects/ac43553375354afcbd485036bcf06400/users/d834baab35b948a3a649b12bdc812e5a/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:27.006945 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f5f6b7-4182-4736-b3c1-da23acb700ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac43553375354afcbd485036bcf06400, user_id=d834baab35b948a3a649b12bdc812e5a, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:27.009629 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f5f6b7-4182-4736-b3c1-da23acb700ae admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:27.110109 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 941/1886] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:00:26 2022] PUT /identity/v3/projects/ac43553375354afcbd485036bcf06400/users/d834baab35b948a3a649b12bdc812e5a/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:00:27.128091 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6b32c-4668-4bd2-9bad-92ada5c24220 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:27.128091 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6b32c-4668-4bd2-9bad-92ada5c24220 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:27.130906 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5f6b7-4182-4736-b3c1-da23acb700ae admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:27.132572 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-c8f5f6b7-4182-4736-b3c1-da23acb700ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:27.178688 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc74235-5a43-4fb7-903d-959dcd21a478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:27.179359 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc74235-5a43-4fb7-903d-959dcd21a478 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:27.179643 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc74235-5a43-4fb7-903d-959dcd21a478 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:27.179921 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc74235-5a43-4fb7-903d-959dcd21a478 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:27.180651 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc74235-5a43-4fb7-903d-959dcd21a478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:27.182287 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc74235-5a43-4fb7-903d-959dcd21a478 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:27.195738 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 946/1887] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:00:27.195927 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5f6b7-4182-4736-b3c1-da23acb700ae admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:27.196873 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc74235-5a43-4fb7-903d-959dcd21a478 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:27.200235 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d341b-cbc9-456e-be47-c7dc4775cfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:27.201136 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d341b-cbc9-456e-be47-c7dc4775cfb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:27.201428 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d341b-cbc9-456e-be47-c7dc4775cfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:27.201706 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d341b-cbc9-456e-be47-c7dc4775cfb4 admin admin] PATH_INFO: `/v3/users/a85b78846e454dbdad0fae1778d6c144` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:27.202984 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d341b-cbc9-456e-be47-c7dc4775cfb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a85b78846e454dbdad0fae1778d6c144)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:27.205038 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d341b-cbc9-456e-be47-c7dc4775cfb4 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:27.207264 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc74235-5a43-4fb7-903d-959dcd21a478 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:27.212115 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a3a72-223e-48ab-a31a-716fca09fa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:27.213664 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a3a72-223e-48ab-a31a-716fca09fa5c admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:27.213951 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a3a72-223e-48ab-a31a-716fca09fa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:27.214240 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a3a72-223e-48ab-a31a-716fca09fa5c admin admin] PATH_INFO: `/v3/projects/ac43553375354afcbd485036bcf06400/users/d834baab35b948a3a649b12bdc812e5a/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:27.216316 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a3a72-223e-48ab-a31a-716fca09fa5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac43553375354afcbd485036bcf06400, user_id=d834baab35b948a3a649b12bdc812e5a, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:27.218934 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a3a72-223e-48ab-a31a-716fca09fa5c admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:27.229622 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 947/1888] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:00:27 2022] PUT /identity/v3/projects/ac43553375354afcbd485036bcf06400/users/d834baab35b948a3a649b12bdc812e5a/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:27.244412 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcaf6a0-6579-4cec-8e75-d70fd3c53b47 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:27.244970 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcaf6a0-6579-4cec-8e75-d70fd3c53b47 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:27.244970 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcaf6a0-6579-4cec-8e75-d70fd3c53b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:27.271601 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-1fcaf6a0-6579-4cec-8e75-d70fd3c53b47 None None] MFA Rules not processed for user `d834baab35b948a3a649b12bdc812e5a`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:27.272770 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-1fcaf6a0-6579-4cec-8e75-d70fd3c53b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:27.344271 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 948/1889] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:00:27.355248 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcaf6a0-6579-4cec-8e75-d70fd3c53b47 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:27.356687 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-1fcaf6a0-6579-4cec-8e75-d70fd3c53b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:27.422773 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcaf6a0-6579-4cec-8e75-d70fd3c53b47 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:27.426700 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831ea1b-0e3f-4df2-a1c1-be0d82cd5355 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:27.427344 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831ea1b-0e3f-4df2-a1c1-be0d82cd5355 service cinder] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:27.427664 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831ea1b-0e3f-4df2-a1c1-be0d82cd5355 service cinder] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:27.427951 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831ea1b-0e3f-4df2-a1c1-be0d82cd5355 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:27.443572 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831ea1b-0e3f-4df2-a1c1-be0d82cd5355 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:27.443572 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831ea1b-0e3f-4df2-a1c1-be0d82cd5355 service cinder] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:27.451722 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 949/1890] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:00:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 15:00:27.538612 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-906d341b-cbc9-456e-be47-c7dc4775cfb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a85b78846e454dbdad0fae1778d6c144'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:27.545338 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-906d341b-cbc9-456e-be47-c7dc4775cfb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a85b78846e454dbdad0fae1778d6c144'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:27.546041 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-906d341b-cbc9-456e-be47-c7dc4775cfb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a85b78846e454dbdad0fae1778d6c144'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:27.653380 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-906d341b-cbc9-456e-be47-c7dc4775cfb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a85b78846e454dbdad0fae1778d6c144'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:27.665578 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-906d341b-cbc9-456e-be47-c7dc4775cfb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a85b78846e454dbdad0fae1778d6c144'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:27.671980 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 942/1891] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:00:27 2022] DELETE /identity/v3/users/a85b78846e454dbdad0fae1778d6c144 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:27.674146 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831ea1b-0e3f-4df2-a1c1-be0d82cd5355 service cinder] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:27.680378 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc4872-4f03-4a18-8a4e-ff8913efe086 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:27.680378 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc4872-4f03-4a18-8a4e-ff8913efe086 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:27.680378 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc4872-4f03-4a18-8a4e-ff8913efe086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:27.683308 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831ea1b-0e3f-4df2-a1c1-be0d82cd5355 service cinder] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:27.696764 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-5fcc4872-4f03-4a18-8a4e-ff8913efe086 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:27.698083 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-5fcc4872-4f03-4a18-8a4e-ff8913efe086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:27.738714 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b2fed-c7cd-49b1-a5e4-3b2e6636f163 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:27.739367 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b2fed-c7cd-49b1-a5e4-3b2e6636f163 service cinder] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:27.739656 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b2fed-c7cd-49b1-a5e4-3b2e6636f163 service cinder] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:27.739930 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b2fed-c7cd-49b1-a5e4-3b2e6636f163 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:27.741904 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-2e2b2fed-c7cd-49b1-a5e4-3b2e6636f163 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:27.763895 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 943/1892] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:00:27.777812 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc4872-4f03-4a18-8a4e-ff8913efe086 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:27.779473 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-5fcc4872-4f03-4a18-8a4e-ff8913efe086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:27.809266 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b2fed-c7cd-49b1-a5e4-3b2e6636f163 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:27.810716 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b2fed-c7cd-49b1-a5e4-3b2e6636f163 service cinder] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:27.820295 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 950/1893] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:00:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:00:27.846487 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc4872-4f03-4a18-8a4e-ff8913efe086 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:27.851638 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96895b-db0d-4acd-bb46-a0d138e4d0f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:27.852296 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96895b-db0d-4acd-bb46-a0d138e4d0f2 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:27.852576 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96895b-db0d-4acd-bb46-a0d138e4d0f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:27.852948 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96895b-db0d-4acd-bb46-a0d138e4d0f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:27.868049 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d96895b-db0d-4acd-bb46-a0d138e4d0f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:27.887260 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d96895b-db0d-4acd-bb46-a0d138e4d0f2 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:27.887260 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 944/1894] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:00:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:00:28.523288 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b2fed-c7cd-49b1-a5e4-3b2e6636f163 service cinder] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:28.524735 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-2e2b2fed-c7cd-49b1-a5e4-3b2e6636f163 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:28.539441 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b2fed-c7cd-49b1-a5e4-3b2e6636f163 service cinder] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:28.541018 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96895b-db0d-4acd-bb46-a0d138e4d0f2 service neutron] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:28.542930 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-4d96895b-db0d-4acd-bb46-a0d138e4d0f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:28.546312 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f8166-9882-4dbb-abbb-e876bd587e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:28.547283 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f8166-9882-4dbb-abbb-e876bd587e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:28.547674 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f8166-9882-4dbb-abbb-e876bd587e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:28.548077 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f8166-9882-4dbb-abbb-e876bd587e09 admin admin] PATH_INFO: `/v3/users/cfe67740b0bd4119abbda24750f8ab16` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:28.549333 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f8166-9882-4dbb-abbb-e876bd587e09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfe67740b0bd4119abbda24750f8ab16)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:28.553282 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f8166-9882-4dbb-abbb-e876bd587e09 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:28.564211 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96895b-db0d-4acd-bb46-a0d138e4d0f2 service neutron] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:28.577056 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13692cda-10c5-40a2-9215-ffabd06ea9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:28.578450 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13692cda-10c5-40a2-9215-ffabd06ea9dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:28.578680 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13692cda-10c5-40a2-9215-ffabd06ea9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:28.578948 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13692cda-10c5-40a2-9215-ffabd06ea9dd admin admin] PATH_INFO: `/v3/projects/9516c82e7cd04567a9518309976f2a68` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:28.581379 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13692cda-10c5-40a2-9215-ffabd06ea9dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9516c82e7cd04567a9518309976f2a68)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:28.583409 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13692cda-10c5-40a2-9215-ffabd06ea9dd admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:28.787145 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-13692cda-10c5-40a2-9215-ffabd06ea9dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9516c82e7cd04567a9518309976f2a68', 'request_id': 'req-13692cda-10c5-40a2-9215-ffabd06ea9dd'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:28.788122 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-905f8166-9882-4dbb-abbb-e876bd587e09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfe67740b0bd4119abbda24750f8ab16'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:28.793341 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-13692cda-10c5-40a2-9215-ffabd06ea9dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9516c82e7cd04567a9518309976f2a68', 'request_id': 'req-13692cda-10c5-40a2-9215-ffabd06ea9dd'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:28.795429 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-905f8166-9882-4dbb-abbb-e876bd587e09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfe67740b0bd4119abbda24750f8ab16'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:28.796653 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-905f8166-9882-4dbb-abbb-e876bd587e09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfe67740b0bd4119abbda24750f8ab16'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:28.797312 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-905f8166-9882-4dbb-abbb-e876bd587e09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfe67740b0bd4119abbda24750f8ab16'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:28.799339 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-13692cda-10c5-40a2-9215-ffabd06ea9dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9516c82e7cd04567a9518309976f2a68', 'request_id': 'req-13692cda-10c5-40a2-9215-ffabd06ea9dd'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:28.876605 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-905f8166-9882-4dbb-abbb-e876bd587e09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfe67740b0bd4119abbda24750f8ab16'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:28.893747 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 951/1895] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:00:28 2022] DELETE /identity/v3/users/cfe67740b0bd4119abbda24750f8ab16 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:28.897982 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2b73a-0de9-4e2c-bb33-3b6e92b09a4c None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:28.898275 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2b73a-0de9-4e2c-bb33-3b6e92b09a4c None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:28.898554 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2b73a-0de9-4e2c-bb33-3b6e92b09a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:28.914524 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-2ce2b73a-0de9-4e2c-bb33-3b6e92b09a4c None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:28.915700 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-2ce2b73a-0de9-4e2c-bb33-3b6e92b09a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:28.954000 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-13692cda-10c5-40a2-9215-ffabd06ea9dd admin admin] The token cache is being invalidate because project 9516c82e7cd04567a9518309976f2a68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:00:28.954296 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-13692cda-10c5-40a2-9215-ffabd06ea9dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:28.954970 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-13692cda-10c5-40a2-9215-ffabd06ea9dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:28.956577 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 945/1896] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:00:28 2022] DELETE /identity/v3/projects/9516c82e7cd04567a9518309976f2a68 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:00:28.962239 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fca4c-cd8f-48e7-b05d-8f3f1e988d84 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:28.962534 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fca4c-cd8f-48e7-b05d-8f3f1e988d84 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:28.962959 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fca4c-cd8f-48e7-b05d-8f3f1e988d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:28.973281 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 952/1897] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:00:28.980753 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-134fca4c-cd8f-48e7-b05d-8f3f1e988d84 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:28.981990 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-134fca4c-cd8f-48e7-b05d-8f3f1e988d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:28.984429 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2b73a-0de9-4e2c-bb33-3b6e92b09a4c None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:28.985750 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-2ce2b73a-0de9-4e2c-bb33-3b6e92b09a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:28.991043 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 946/1898] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:00:28.998550 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06751ac-f886-4aa5-9eb9-c479b4fe4dc6 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:28.998862 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06751ac-f886-4aa5-9eb9-c479b4fe4dc6 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:28.999785 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06751ac-f886-4aa5-9eb9-c479b4fe4dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:29.017126 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-f06751ac-f886-4aa5-9eb9-c479b4fe4dc6 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:29.018308 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-f06751ac-f886-4aa5-9eb9-c479b4fe4dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:29.026299 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 947/1899] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:00:29.030863 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06751ac-f886-4aa5-9eb9-c479b4fe4dc6 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:29.039616 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06751ac-f886-4aa5-9eb9-c479b4fe4dc6 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:29.040823 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2b73a-0de9-4e2c-bb33-3b6e92b09a4c None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:29.044258 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c41685-8721-4b99-a07a-12605d80720a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:29.044456 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed603775-5f38-4e4b-845e-6fa13986be33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:29.044899 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c41685-8721-4b99-a07a-12605d80720a admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:29.045129 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed603775-5f38-4e4b-845e-6fa13986be33 service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:29.045238 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c41685-8721-4b99-a07a-12605d80720a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:29.045418 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed603775-5f38-4e4b-845e-6fa13986be33 service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:29.045510 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c41685-8721-4b99-a07a-12605d80720a admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:29.045693 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed603775-5f38-4e4b-845e-6fa13986be33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:29.046284 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c41685-8721-4b99-a07a-12605d80720a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:00:29.046591 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c41685-8721-4b99-a07a-12605d80720a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:29.048208 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c41685-8721-4b99-a07a-12605d80720a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:29.054730 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed603775-5f38-4e4b-845e-6fa13986be33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:29.056164 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed603775-5f38-4e4b-845e-6fa13986be33 service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:29.059486 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 948/1900] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 15:00:29.066506 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 953/1901] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:00:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 15:00:29.068131 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c41685-8721-4b99-a07a-12605d80720a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:29.079043 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c41685-8721-4b99-a07a-12605d80720a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:29.084908 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cde53-305a-4aee-b164-8da9eeb46099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:29.086058 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cde53-305a-4aee-b164-8da9eeb46099 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:29.086058 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cde53-305a-4aee-b164-8da9eeb46099 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:29.086466 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cde53-305a-4aee-b164-8da9eeb46099 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:29.087793 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695cde53-305a-4aee-b164-8da9eeb46099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:29.091712 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695cde53-305a-4aee-b164-8da9eeb46099 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:29.267246 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 949/1902] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:00:29 2022] POST /identity/v3/projects => generated 359 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:00:29.271329 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed603775-5f38-4e4b-845e-6fa13986be33 service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:29.280756 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed603775-5f38-4e4b-845e-6fa13986be33 service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:29.336629 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdcfd9b-fd31-4e82-9f8f-cd1c6be1c595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:29.337341 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdcfd9b-fd31-4e82-9f8f-cd1c6be1c595 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:29.337632 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdcfd9b-fd31-4e82-9f8f-cd1c6be1c595 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:29.338039 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdcfd9b-fd31-4e82-9f8f-cd1c6be1c595 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:29.338725 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdcfd9b-fd31-4e82-9f8f-cd1c6be1c595 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:29.341829 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdcfd9b-fd31-4e82-9f8f-cd1c6be1c595 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:29.423481 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 954/1903] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:00:29 2022] POST /identity/v3/users => generated 280 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:00:29.427660 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cde53-305a-4aee-b164-8da9eeb46099 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:29.446859 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cde53-305a-4aee-b164-8da9eeb46099 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:29.452238 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df41776-4323-433c-8410-fe521313adaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:29.453040 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df41776-4323-433c-8410-fe521313adaf admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:29.453483 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df41776-4323-433c-8410-fe521313adaf admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:29.453958 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df41776-4323-433c-8410-fe521313adaf admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:29.454799 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df41776-4323-433c-8410-fe521313adaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:29.456560 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df41776-4323-433c-8410-fe521313adaf admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:29.466383 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 950/1904] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:00:29.470362 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdcfd9b-fd31-4e82-9f8f-cd1c6be1c595 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:29.481200 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdcfd9b-fd31-4e82-9f8f-cd1c6be1c595 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:29.486275 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69e66a-dff0-4f39-9086-48b1629058c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:29.486921 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69e66a-dff0-4f39-9086-48b1629058c8 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:29.487204 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69e66a-dff0-4f39-9086-48b1629058c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:29.487480 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69e66a-dff0-4f39-9086-48b1629058c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:29.488213 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69e66a-dff0-4f39-9086-48b1629058c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:29.493098 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69e66a-dff0-4f39-9086-48b1629058c8 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:29.501269 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 955/1905] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:00:29.504874 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df41776-4323-433c-8410-fe521313adaf admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:29.514909 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df41776-4323-433c-8410-fe521313adaf admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:29.519552 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528638d-8290-479a-ade3-82d89e3abc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:29.520423 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528638d-8290-479a-ade3-82d89e3abc21 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:29.520702 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528638d-8290-479a-ade3-82d89e3abc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:29.520974 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528638d-8290-479a-ade3-82d89e3abc21 admin admin] PATH_INFO: `/v3/projects/32fe48e21f974e40a2572958509e896b/users/34441259811e404dbb0726b8d6a29b59/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:29.535072 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528638d-8290-479a-ade3-82d89e3abc21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32fe48e21f974e40a2572958509e896b, user_id=34441259811e404dbb0726b8d6a29b59, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:29.537741 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528638d-8290-479a-ade3-82d89e3abc21 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:29.544715 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69e66a-dff0-4f39-9086-48b1629058c8 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:29.547127 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-9b69e66a-dff0-4f39-9086-48b1629058c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:29.561278 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69e66a-dff0-4f39-9086-48b1629058c8 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:29.567761 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c368c0-8e58-4fa0-91b3-276c4ad79bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:29.568659 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c368c0-8e58-4fa0-91b3-276c4ad79bf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:29.568957 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c368c0-8e58-4fa0-91b3-276c4ad79bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:29.569251 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c368c0-8e58-4fa0-91b3-276c4ad79bf6 admin admin] PATH_INFO: `/v3/projects/d2e70120e3df4e20809c528d5ec9b559` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:29.570461 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c368c0-8e58-4fa0-91b3-276c4ad79bf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2e70120e3df4e20809c528d5ec9b559)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:29.572552 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c368c0-8e58-4fa0-91b3-276c4ad79bf6 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:29.671648 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 951/1906] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:00:29 2022] PUT /identity/v3/projects/32fe48e21f974e40a2572958509e896b/users/34441259811e404dbb0726b8d6a29b59/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:29.681800 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769e0b5-3fd7-4236-add0-2c6f1b85bc83 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:29.682087 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769e0b5-3fd7-4236-add0-2c6f1b85bc83 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:29.682364 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769e0b5-3fd7-4236-add0-2c6f1b85bc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:29.707285 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-8769e0b5-3fd7-4236-add0-2c6f1b85bc83 None None] MFA Rules not processed for user `34441259811e404dbb0726b8d6a29b59`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:29.708468 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-8769e0b5-3fd7-4236-add0-2c6f1b85bc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:29.720310 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-25c368c0-8e58-4fa0-91b3-276c4ad79bf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2e70120e3df4e20809c528d5ec9b559', 'request_id': 'req-25c368c0-8e58-4fa0-91b3-276c4ad79bf6'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:29.728190 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-25c368c0-8e58-4fa0-91b3-276c4ad79bf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2e70120e3df4e20809c528d5ec9b559', 'request_id': 'req-25c368c0-8e58-4fa0-91b3-276c4ad79bf6'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:29.769265 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 952/1907] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:29 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:00:29.795595 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769e0b5-3fd7-4236-add0-2c6f1b85bc83 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:29.796958 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-8769e0b5-3fd7-4236-add0-2c6f1b85bc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:29.850369 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769e0b5-3fd7-4236-add0-2c6f1b85bc83 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:29.854004 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1820db0-3fd6-4cfb-bf77-4fea136a2dbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:29.854670 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1820db0-3fd6-4cfb-bf77-4fea136a2dbc service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:29.855215 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1820db0-3fd6-4cfb-bf77-4fea136a2dbc service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:29.855537 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1820db0-3fd6-4cfb-bf77-4fea136a2dbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:29.862171 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-25c368c0-8e58-4fa0-91b3-276c4ad79bf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2e70120e3df4e20809c528d5ec9b559', 'request_id': 'req-25c368c0-8e58-4fa0-91b3-276c4ad79bf6'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:29.863670 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1820db0-3fd6-4cfb-bf77-4fea136a2dbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:29.865184 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1820db0-3fd6-4cfb-bf77-4fea136a2dbc service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:29.873015 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-25c368c0-8e58-4fa0-91b3-276c4ad79bf6 admin admin] The token cache is being invalidate because project d2e70120e3df4e20809c528d5ec9b559 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:00:29.873340 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-25c368c0-8e58-4fa0-91b3-276c4ad79bf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:29.874580 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-25c368c0-8e58-4fa0-91b3-276c4ad79bf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:29.874874 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 953/1908] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:00:29 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 15:00:29.876414 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 956/1909] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:00:29 2022] DELETE /identity/v3/projects/d2e70120e3df4e20809c528d5ec9b559 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:00:29.881554 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1820db0-3fd6-4cfb-bf77-4fea136a2dbc service cinder] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:29.888738 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c368c0-8e58-4fa0-91b3-276c4ad79bf6 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:29.890852 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-25c368c0-8e58-4fa0-91b3-276c4ad79bf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:29.944802 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1820db0-3fd6-4cfb-bf77-4fea136a2dbc service cinder] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:29.949518 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308826f9-6336-486e-93a3-47c4a93c90c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:29.950390 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308826f9-6336-486e-93a3-47c4a93c90c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:29.950673 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308826f9-6336-486e-93a3-47c4a93c90c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:29.950950 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308826f9-6336-486e-93a3-47c4a93c90c1 admin admin] PATH_INFO: `/v3/users/d834baab35b948a3a649b12bdc812e5a` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:29.952332 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308826f9-6336-486e-93a3-47c4a93c90c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d834baab35b948a3a649b12bdc812e5a)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:29.953190 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c368c0-8e58-4fa0-91b3-276c4ad79bf6 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:29.954880 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308826f9-6336-486e-93a3-47c4a93c90c1 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:29.964245 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec5fa2-64a4-45a0-89ce-205b1f0ee69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:29.964245 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec5fa2-64a4-45a0-89ce-205b1f0ee69f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:29.964245 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec5fa2-64a4-45a0-89ce-205b1f0ee69f admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:29.964245 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec5fa2-64a4-45a0-89ce-205b1f0ee69f admin admin] PATH_INFO: `/v3/users/34441259811e404dbb0726b8d6a29b59` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:29.964547 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec5fa2-64a4-45a0-89ce-205b1f0ee69f admin admin] RBAC: Authorizing `identity:delete_user(user_id=34441259811e404dbb0726b8d6a29b59)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:29.964547 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec5fa2-64a4-45a0-89ce-205b1f0ee69f admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:30.241772 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-308826f9-6336-486e-93a3-47c4a93c90c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd834baab35b948a3a649b12bdc812e5a'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:30.248249 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-308826f9-6336-486e-93a3-47c4a93c90c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd834baab35b948a3a649b12bdc812e5a'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:30.248925 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-308826f9-6336-486e-93a3-47c4a93c90c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd834baab35b948a3a649b12bdc812e5a'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:30.292620 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-20ec5fa2-64a4-45a0-89ce-205b1f0ee69f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34441259811e404dbb0726b8d6a29b59'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:30.300678 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-20ec5fa2-64a4-45a0-89ce-205b1f0ee69f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34441259811e404dbb0726b8d6a29b59'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:30.301554 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-20ec5fa2-64a4-45a0-89ce-205b1f0ee69f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34441259811e404dbb0726b8d6a29b59'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:30.302182 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-20ec5fa2-64a4-45a0-89ce-205b1f0ee69f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34441259811e404dbb0726b8d6a29b59'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:30.337120 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-308826f9-6336-486e-93a3-47c4a93c90c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd834baab35b948a3a649b12bdc812e5a'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:30.349255 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-308826f9-6336-486e-93a3-47c4a93c90c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd834baab35b948a3a649b12bdc812e5a'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:30.355326 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 954/1910] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:00:29 2022] DELETE /identity/v3/users/d834baab35b948a3a649b12bdc812e5a => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:30.437151 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-20ec5fa2-64a4-45a0-89ce-205b1f0ee69f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34441259811e404dbb0726b8d6a29b59'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:30.455062 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 957/1911] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:00:29 2022] DELETE /identity/v3/users/34441259811e404dbb0726b8d6a29b59 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:00:30.459440 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b557806-686c-48ec-9d73-856daaf9d252 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:30.459763 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b557806-686c-48ec-9d73-856daaf9d252 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:30.460046 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b557806-686c-48ec-9d73-856daaf9d252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:30.477019 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-3b557806-686c-48ec-9d73-856daaf9d252 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:30.482390 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-3b557806-686c-48ec-9d73-856daaf9d252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:30.537400 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 955/1912] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:00:30.547710 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec5fa2-64a4-45a0-89ce-205b1f0ee69f admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:30.549133 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-20ec5fa2-64a4-45a0-89ce-205b1f0ee69f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:30.606147 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec5fa2-64a4-45a0-89ce-205b1f0ee69f admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:30.610332 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43745a12-5f2e-4b30-8f2f-05cd4b3f6afa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:30.610975 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43745a12-5f2e-4b30-8f2f-05cd4b3f6afa service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:30.611256 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43745a12-5f2e-4b30-8f2f-05cd4b3f6afa service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:30.611533 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43745a12-5f2e-4b30-8f2f-05cd4b3f6afa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:30.620860 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43745a12-5f2e-4b30-8f2f-05cd4b3f6afa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:30.622350 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43745a12-5f2e-4b30-8f2f-05cd4b3f6afa service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:30.633968 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 958/1913] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:00:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:00:30.767036 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b557806-686c-48ec-9d73-856daaf9d252 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:30.768680 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-3b557806-686c-48ec-9d73-856daaf9d252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:30.781512 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b557806-686c-48ec-9d73-856daaf9d252 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:30.786225 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b839b81-3134-4de9-80b9-bfc675b1d69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:30.787091 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b839b81-3134-4de9-80b9-bfc675b1d69c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:30.787374 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b839b81-3134-4de9-80b9-bfc675b1d69c admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:30.787654 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b839b81-3134-4de9-80b9-bfc675b1d69c admin admin] PATH_INFO: `/v3/projects/ac43553375354afcbd485036bcf06400` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:30.788856 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b839b81-3134-4de9-80b9-bfc675b1d69c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac43553375354afcbd485036bcf06400)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:30.790919 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b839b81-3134-4de9-80b9-bfc675b1d69c admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:30.914669 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-0b839b81-3134-4de9-80b9-bfc675b1d69c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac43553375354afcbd485036bcf06400', 'request_id': 'req-0b839b81-3134-4de9-80b9-bfc675b1d69c'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:30.920931 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-0b839b81-3134-4de9-80b9-bfc675b1d69c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac43553375354afcbd485036bcf06400', 'request_id': 'req-0b839b81-3134-4de9-80b9-bfc675b1d69c'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:30.926650 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-0b839b81-3134-4de9-80b9-bfc675b1d69c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac43553375354afcbd485036bcf06400', 'request_id': 'req-0b839b81-3134-4de9-80b9-bfc675b1d69c'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:31.053309 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-0b839b81-3134-4de9-80b9-bfc675b1d69c admin admin] The token cache is being invalidate because project ac43553375354afcbd485036bcf06400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:00:31.053562 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-0b839b81-3134-4de9-80b9-bfc675b1d69c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:31.054224 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-0b839b81-3134-4de9-80b9-bfc675b1d69c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:31.055785 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 956/1914] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:00:30 2022] DELETE /identity/v3/projects/ac43553375354afcbd485036bcf06400 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:31.061590 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76817d96-a315-40c3-a85a-cf67bc42b61d None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:31.061884 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76817d96-a315-40c3-a85a-cf67bc42b61d None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:31.062161 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76817d96-a315-40c3-a85a-cf67bc42b61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:31.079750 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-76817d96-a315-40c3-a85a-cf67bc42b61d None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:31.080927 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-76817d96-a315-40c3-a85a-cf67bc42b61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:31.095680 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b839b81-3134-4de9-80b9-bfc675b1d69c admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:31.097125 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-0b839b81-3134-4de9-80b9-bfc675b1d69c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:31.142539 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 959/1915] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:00:31.150356 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5f0e4-7f7c-427b-97c0-48eec6c8559b None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:31.150665 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5f0e4-7f7c-427b-97c0-48eec6c8559b None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:31.150945 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5f0e4-7f7c-427b-97c0-48eec6c8559b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:31.168259 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b839b81-3134-4de9-80b9-bfc675b1d69c admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:31.169283 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-07c5f0e4-7f7c-427b-97c0-48eec6c8559b None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:31.170472 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-07c5f0e4-7f7c-427b-97c0-48eec6c8559b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:31.173038 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd6860-3e73-4895-b53c-ebecb6d131fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:31.173956 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd6860-3e73-4895-b53c-ebecb6d131fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:31.174241 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd6860-3e73-4895-b53c-ebecb6d131fc admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:31.174515 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd6860-3e73-4895-b53c-ebecb6d131fc admin admin] PATH_INFO: `/v3/projects/32fe48e21f974e40a2572958509e896b` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:31.175696 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd6860-3e73-4895-b53c-ebecb6d131fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=32fe48e21f974e40a2572958509e896b)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:31.177639 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd6860-3e73-4895-b53c-ebecb6d131fc admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:31.178614 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 960/1916] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:00:31.182638 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5f0e4-7f7c-427b-97c0-48eec6c8559b None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:31.191471 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5f0e4-7f7c-427b-97c0-48eec6c8559b None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:31.196170 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f52c83-910e-4b24-a370-56edb35da114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:31.196802 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f52c83-910e-4b24-a370-56edb35da114 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:31.197107 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f52c83-910e-4b24-a370-56edb35da114 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:31.197389 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f52c83-910e-4b24-a370-56edb35da114 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:31.198111 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f52c83-910e-4b24-a370-56edb35da114 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:00:31.198416 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f52c83-910e-4b24-a370-56edb35da114 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:31.200061 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f52c83-910e-4b24-a370-56edb35da114 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:31.211782 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 961/1917] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 15:00:31.216019 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f52c83-910e-4b24-a370-56edb35da114 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:31.227432 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f52c83-910e-4b24-a370-56edb35da114 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:31.232339 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde25eef-ed63-47e0-a566-60270271ef88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:31.234450 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde25eef-ed63-47e0-a566-60270271ef88 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:31.234450 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde25eef-ed63-47e0-a566-60270271ef88 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:31.234450 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde25eef-ed63-47e0-a566-60270271ef88 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:31.234450 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde25eef-ed63-47e0-a566-60270271ef88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:31.236198 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde25eef-ed63-47e0-a566-60270271ef88 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:31.310643 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-59cd6860-3e73-4895-b53c-ebecb6d131fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32fe48e21f974e40a2572958509e896b', 'request_id': 'req-59cd6860-3e73-4895-b53c-ebecb6d131fc'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:31.317046 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-59cd6860-3e73-4895-b53c-ebecb6d131fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32fe48e21f974e40a2572958509e896b', 'request_id': 'req-59cd6860-3e73-4895-b53c-ebecb6d131fc'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:31.322172 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-59cd6860-3e73-4895-b53c-ebecb6d131fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32fe48e21f974e40a2572958509e896b', 'request_id': 'req-59cd6860-3e73-4895-b53c-ebecb6d131fc'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:31.343658 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 962/1918] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:00:31 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:00:31.348928 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde25eef-ed63-47e0-a566-60270271ef88 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:31.406174 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde25eef-ed63-47e0-a566-60270271ef88 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:31.410974 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711cb21-0b59-47ed-ace1-1c0e5b55632a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:31.412049 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711cb21-0b59-47ed-ace1-1c0e5b55632a admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:31.412378 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711cb21-0b59-47ed-ace1-1c0e5b55632a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:31.412673 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711cb21-0b59-47ed-ace1-1c0e5b55632a admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:31.413405 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711cb21-0b59-47ed-ace1-1c0e5b55632a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:31.415345 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711cb21-0b59-47ed-ace1-1c0e5b55632a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:31.418771 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-59cd6860-3e73-4895-b53c-ebecb6d131fc admin admin] The token cache is being invalidate because project 32fe48e21f974e40a2572958509e896b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:00:31.419059 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-59cd6860-3e73-4895-b53c-ebecb6d131fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:31.419747 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-59cd6860-3e73-4895-b53c-ebecb6d131fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:31.421976 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 957/1919] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:00:31 2022] DELETE /identity/v3/projects/32fe48e21f974e40a2572958509e896b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:00:31.427386 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03330056-6b5d-4237-8290-964784bae08a None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:31.427673 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03330056-6b5d-4237-8290-964784bae08a None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:31.427949 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03330056-6b5d-4237-8290-964784bae08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:31.445222 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-03330056-6b5d-4237-8290-964784bae08a None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:31.446478 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-03330056-6b5d-4237-8290-964784bae08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:31.454296 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 958/1920] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:00:31.462723 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7572134-17e2-4546-8dfa-9228e53b255b None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:31.464279 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7572134-17e2-4546-8dfa-9228e53b255b None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:31.464279 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7572134-17e2-4546-8dfa-9228e53b255b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:31.481216 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-b7572134-17e2-4546-8dfa-9228e53b255b None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:31.482373 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-b7572134-17e2-4546-8dfa-9228e53b255b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:31.490856 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 959/1921] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:00:31.494781 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7572134-17e2-4546-8dfa-9228e53b255b None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:31.503636 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7572134-17e2-4546-8dfa-9228e53b255b None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:31.508300 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547d004-604c-45f7-a931-fe9287d07ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:31.508948 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547d004-604c-45f7-a931-fe9287d07ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:31.509262 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547d004-604c-45f7-a931-fe9287d07ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:31.509545 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547d004-604c-45f7-a931-fe9287d07ed8 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:31.510276 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547d004-604c-45f7-a931-fe9287d07ed8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:00:31.510586 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547d004-604c-45f7-a931-fe9287d07ed8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:31.512179 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547d004-604c-45f7-a931-fe9287d07ed8 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:31.523652 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 960/1922] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 15:00:31.527865 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547d004-604c-45f7-a931-fe9287d07ed8 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:31.529875 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 963/1923] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:00:31 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:00:31.535869 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711cb21-0b59-47ed-ace1-1c0e5b55632a admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:31.537508 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-8711cb21-0b59-47ed-ace1-1c0e5b55632a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:31.538215 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547d004-604c-45f7-a931-fe9287d07ed8 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:31.542833 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfce8a-4cef-4af9-9ad1-ea07e546ca28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:31.543468 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfce8a-4cef-4af9-9ad1-ea07e546ca28 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:31.543751 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfce8a-4cef-4af9-9ad1-ea07e546ca28 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:31.544027 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfce8a-4cef-4af9-9ad1-ea07e546ca28 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:31.544722 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacfce8a-4cef-4af9-9ad1-ea07e546ca28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:31.547265 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacfce8a-4cef-4af9-9ad1-ea07e546ca28 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:31.550004 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711cb21-0b59-47ed-ace1-1c0e5b55632a admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:31.555006 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98767ee4-5d3c-497b-a87d-d1cf1d97761d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:31.555674 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98767ee4-5d3c-497b-a87d-d1cf1d97761d admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:31.555955 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98767ee4-5d3c-497b-a87d-d1cf1d97761d admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:31.556229 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98767ee4-5d3c-497b-a87d-d1cf1d97761d admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:31.556988 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98767ee4-5d3c-497b-a87d-d1cf1d97761d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:31.558606 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98767ee4-5d3c-497b-a87d-d1cf1d97761d admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:31.572708 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 964/1924] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:00:31.575334 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98767ee4-5d3c-497b-a87d-d1cf1d97761d admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:31.584698 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98767ee4-5d3c-497b-a87d-d1cf1d97761d admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:31.589361 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5fa6d-8f31-43de-a9c3-ae322730c442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:31.589975 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5fa6d-8f31-43de-a9c3-ae322730c442 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:31.590257 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5fa6d-8f31-43de-a9c3-ae322730c442 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:31.590533 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5fa6d-8f31-43de-a9c3-ae322730c442 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:31.591236 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5fa6d-8f31-43de-a9c3-ae322730c442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:31.593364 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5fa6d-8f31-43de-a9c3-ae322730c442 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:31.602902 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 965/1925] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:00:31.606991 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5fa6d-8f31-43de-a9c3-ae322730c442 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:31.616855 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5fa6d-8f31-43de-a9c3-ae322730c442 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:31.621560 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3630f7-55fd-4477-ba7b-6a27b28365b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:31.622433 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3630f7-55fd-4477-ba7b-6a27b28365b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:31.622707 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3630f7-55fd-4477-ba7b-6a27b28365b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:31.622979 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3630f7-55fd-4477-ba7b-6a27b28365b1 admin admin] PATH_INFO: `/v3/projects/8dc0fa7c67174eccbd2eb42b56354626/users/4ae7a44d6a7f43b0ba2b09232f99c78a/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:31.637598 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3630f7-55fd-4477-ba7b-6a27b28365b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc0fa7c67174eccbd2eb42b56354626, user_id=4ae7a44d6a7f43b0ba2b09232f99c78a, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:31.642124 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 961/1926] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:00:31 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:00:31.642572 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3630f7-55fd-4477-ba7b-6a27b28365b1 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:31.643230 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfce8a-4cef-4af9-9ad1-ea07e546ca28 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:31.702948 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfce8a-4cef-4af9-9ad1-ea07e546ca28 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:31.707838 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f893e-1038-46b1-b99b-a2aca71bb78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:31.708511 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f893e-1038-46b1-b99b-a2aca71bb78c admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:31.708791 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f893e-1038-46b1-b99b-a2aca71bb78c admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:31.709118 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f893e-1038-46b1-b99b-a2aca71bb78c admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:31.710025 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f893e-1038-46b1-b99b-a2aca71bb78c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:31.711947 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f893e-1038-46b1-b99b-a2aca71bb78c admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:31.739892 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 966/1927] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:00:31 2022] PUT /identity/v3/projects/8dc0fa7c67174eccbd2eb42b56354626/users/4ae7a44d6a7f43b0ba2b09232f99c78a/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:00:31.750635 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca7373-66eb-47f2-bf58-e9aa57f6a19e None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:31.750922 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca7373-66eb-47f2-bf58-e9aa57f6a19e None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:31.751197 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca7373-66eb-47f2-bf58-e9aa57f6a19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:31.777360 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-b2ca7373-66eb-47f2-bf58-e9aa57f6a19e None None] MFA Rules not processed for user `4ae7a44d6a7f43b0ba2b09232f99c78a`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:31.779190 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-b2ca7373-66eb-47f2-bf58-e9aa57f6a19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:31.815438 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 962/1928] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:00:31 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:00:31.819632 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f893e-1038-46b1-b99b-a2aca71bb78c admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:31.834884 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f893e-1038-46b1-b99b-a2aca71bb78c admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:31.854532 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 967/1929] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:00:31.867349 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca7373-66eb-47f2-bf58-e9aa57f6a19e None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:31.868854 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-b2ca7373-66eb-47f2-bf58-e9aa57f6a19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:31.901139 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe31cc-2b4e-454b-94ea-a855285aff4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:31.901820 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe31cc-2b4e-454b-94ea-a855285aff4f admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:31.902165 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe31cc-2b4e-454b-94ea-a855285aff4f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:31.902447 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe31cc-2b4e-454b-94ea-a855285aff4f admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:31.903377 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe31cc-2b4e-454b-94ea-a855285aff4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:31.906422 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe31cc-2b4e-454b-94ea-a855285aff4f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:31.917349 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 963/1930] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:00:31.921767 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe31cc-2b4e-454b-94ea-a855285aff4f admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:31.932142 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe31cc-2b4e-454b-94ea-a855285aff4f admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:31.936961 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd10f7-f0e9-4b3c-9119-6b07663e8f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:31.937651 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd10f7-f0e9-4b3c-9119-6b07663e8f40 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:31.937935 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd10f7-f0e9-4b3c-9119-6b07663e8f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:31.938421 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd10f7-f0e9-4b3c-9119-6b07663e8f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:31.939244 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd10f7-f0e9-4b3c-9119-6b07663e8f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:31.939539 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca7373-66eb-47f2-bf58-e9aa57f6a19e None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:31.940870 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd10f7-f0e9-4b3c-9119-6b07663e8f40 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:31.943610 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a79b6f-b90b-4f3e-8814-7d71e80b897e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935ad716e4624c25bc34308f05eb1526', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:31.944312 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a79b6f-b90b-4f3e-8814-7d71e80b897e service glance] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:31.944784 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a79b6f-b90b-4f3e-8814-7d71e80b897e service glance] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:31.945263 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a79b6f-b90b-4f3e-8814-7d71e80b897e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:31.951535 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 964/1931] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:00:31.956273 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd10f7-f0e9-4b3c-9119-6b07663e8f40 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:31.956407 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a79b6f-b90b-4f3e-8814-7d71e80b897e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:31.957507 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a79b6f-b90b-4f3e-8814-7d71e80b897e service glance] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:31.967319 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 968/1932] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:00:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:00:31.969503 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd10f7-f0e9-4b3c-9119-6b07663e8f40 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:31.975280 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7a142-f258-4839-99b6-60210f5196c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:31.978760 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7a142-f258-4839-99b6-60210f5196c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:31.979491 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7a142-f258-4839-99b6-60210f5196c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:31.979491 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7a142-f258-4839-99b6-60210f5196c8 admin admin] PATH_INFO: `/v3/projects/ebb844dd6232470fa17f96fec5472992/users/fb751ce0e1714efab270030ca9b46d6a/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:31.996075 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7a142-f258-4839-99b6-60210f5196c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebb844dd6232470fa17f96fec5472992, user_id=fb751ce0e1714efab270030ca9b46d6a, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:32.000154 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7a142-f258-4839-99b6-60210f5196c8 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:32.109055 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 965/1933] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:00:31 2022] PUT /identity/v3/projects/ebb844dd6232470fa17f96fec5472992/users/fb751ce0e1714efab270030ca9b46d6a/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:00:32.120889 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dcf95-ca24-45c9-9d85-6860acb19e99 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:32.121218 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dcf95-ca24-45c9-9d85-6860acb19e99 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:32.121502 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dcf95-ca24-45c9-9d85-6860acb19e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:32.151738 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-b64dcf95-ca24-45c9-9d85-6860acb19e99 None None] MFA Rules not processed for user `fb751ce0e1714efab270030ca9b46d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:32.152927 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-b64dcf95-ca24-45c9-9d85-6860acb19e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:32.220842 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 969/1934] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:00:32.230643 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7a142-f258-4839-99b6-60210f5196c8 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:32.232328 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-f0e7a142-f258-4839-99b6-60210f5196c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:32.288709 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7a142-f258-4839-99b6-60210f5196c8 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:32.292369 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae08ecd-2199-432c-b61a-776f3b518299 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:32.293036 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae08ecd-2199-432c-b61a-776f3b518299 service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:32.293361 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae08ecd-2199-432c-b61a-776f3b518299 service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:32.293640 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae08ecd-2199-432c-b61a-776f3b518299 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:32.302192 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae08ecd-2199-432c-b61a-776f3b518299 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:32.303383 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae08ecd-2199-432c-b61a-776f3b518299 service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:32.312429 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 966/1935] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:00:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:00:42.310071 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64dcf95-ca24-45c9-9d85-6860acb19e99 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:42.390247 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64dcf95-ca24-45c9-9d85-6860acb19e99 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:42.396475 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f73876-ed5c-43f3-b6ec-93abbc348af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:42.397403 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f73876-ed5c-43f3-b6ec-93abbc348af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:42.397693 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f73876-ed5c-43f3-b6ec-93abbc348af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:42.397972 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f73876-ed5c-43f3-b6ec-93abbc348af0 admin admin] PATH_INFO: `/v3/users/fb751ce0e1714efab270030ca9b46d6a` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:42.399359 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f73876-ed5c-43f3-b6ec-93abbc348af0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb751ce0e1714efab270030ca9b46d6a)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:42.401676 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f73876-ed5c-43f3-b6ec-93abbc348af0 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:42.657439 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-39f73876-ed5c-43f3-b6ec-93abbc348af0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb751ce0e1714efab270030ca9b46d6a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:42.664163 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-39f73876-ed5c-43f3-b6ec-93abbc348af0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb751ce0e1714efab270030ca9b46d6a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:42.664835 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-39f73876-ed5c-43f3-b6ec-93abbc348af0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb751ce0e1714efab270030ca9b46d6a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:42.665525 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-39f73876-ed5c-43f3-b6ec-93abbc348af0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb751ce0e1714efab270030ca9b46d6a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:42.744689 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-39f73876-ed5c-43f3-b6ec-93abbc348af0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb751ce0e1714efab270030ca9b46d6a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:42.762214 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 970/1936] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:00:42 2022] DELETE /identity/v3/users/fb751ce0e1714efab270030ca9b46d6a => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:42.767317 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad8dbf-933b-4809-80f2-14550371d6d5 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:42.767826 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad8dbf-933b-4809-80f2-14550371d6d5 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:42.767918 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad8dbf-933b-4809-80f2-14550371d6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:42.784677 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-27ad8dbf-933b-4809-80f2-14550371d6d5 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:42.785888 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-27ad8dbf-933b-4809-80f2-14550371d6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:42.849457 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 967/1937] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:00:42.859288 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f73876-ed5c-43f3-b6ec-93abbc348af0 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:42.860669 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-39f73876-ed5c-43f3-b6ec-93abbc348af0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:42.915811 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f73876-ed5c-43f3-b6ec-93abbc348af0 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:42.919498 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e26c0e-f073-4c53-8775-26491f9fe85b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:42.920182 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e26c0e-f073-4c53-8775-26491f9fe85b service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:42.920458 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e26c0e-f073-4c53-8775-26491f9fe85b service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:42.920737 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e26c0e-f073-4c53-8775-26491f9fe85b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:42.930350 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e26c0e-f073-4c53-8775-26491f9fe85b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:42.931841 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e26c0e-f073-4c53-8775-26491f9fe85b service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:42.941988 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 971/1938] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:00:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:00:43.347212 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad8dbf-933b-4809-80f2-14550371d6d5 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:43.348721 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-27ad8dbf-933b-4809-80f2-14550371d6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:43.362343 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad8dbf-933b-4809-80f2-14550371d6d5 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:43.367849 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ba3a9-7282-40e5-9887-e5e290b1517a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:43.368645 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ba3a9-7282-40e5-9887-e5e290b1517a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:43.368933 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ba3a9-7282-40e5-9887-e5e290b1517a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:43.369259 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ba3a9-7282-40e5-9887-e5e290b1517a admin admin] PATH_INFO: `/v3/projects/ebb844dd6232470fa17f96fec5472992` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:43.370483 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ba3a9-7282-40e5-9887-e5e290b1517a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebb844dd6232470fa17f96fec5472992)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:43.372627 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ba3a9-7282-40e5-9887-e5e290b1517a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:43.493794 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ec3ba3a9-7282-40e5-9887-e5e290b1517a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebb844dd6232470fa17f96fec5472992', 'request_id': 'req-ec3ba3a9-7282-40e5-9887-e5e290b1517a'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:43.500033 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ec3ba3a9-7282-40e5-9887-e5e290b1517a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebb844dd6232470fa17f96fec5472992', 'request_id': 'req-ec3ba3a9-7282-40e5-9887-e5e290b1517a'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:43.505531 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ec3ba3a9-7282-40e5-9887-e5e290b1517a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebb844dd6232470fa17f96fec5472992', 'request_id': 'req-ec3ba3a9-7282-40e5-9887-e5e290b1517a'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:43.611534 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ec3ba3a9-7282-40e5-9887-e5e290b1517a admin admin] The token cache is being invalidate because project ebb844dd6232470fa17f96fec5472992 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:00:43.611534 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ec3ba3a9-7282-40e5-9887-e5e290b1517a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:43.611534 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ec3ba3a9-7282-40e5-9887-e5e290b1517a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:43.626077 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 968/1939] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:00:43 2022] DELETE /identity/v3/projects/ebb844dd6232470fa17f96fec5472992 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:48.571303 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e26c0e-f073-4c53-8775-26491f9fe85b service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:48.572725 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-96e26c0e-f073-4c53-8775-26491f9fe85b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:48.585975 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e26c0e-f073-4c53-8775-26491f9fe85b service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:48.647177 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a8578-9a65-4f8a-be10-dffa8623949e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:48.647177 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a8578-9a65-4f8a-be10-dffa8623949e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:48.647177 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a8578-9a65-4f8a-be10-dffa8623949e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:48.647177 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a8578-9a65-4f8a-be10-dffa8623949e admin admin] PATH_INFO: `/v3/users/42105480c9a24e599b1fb4f0a88d40c7` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:48.647698 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9a8578-9a65-4f8a-be10-dffa8623949e admin admin] RBAC: Authorizing `identity:delete_user(user_id=42105480c9a24e599b1fb4f0a88d40c7)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:48.647698 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9a8578-9a65-4f8a-be10-dffa8623949e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:48.910404 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-ff9a8578-9a65-4f8a-be10-dffa8623949e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42105480c9a24e599b1fb4f0a88d40c7'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:48.921662 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-ff9a8578-9a65-4f8a-be10-dffa8623949e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42105480c9a24e599b1fb4f0a88d40c7'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:48.922510 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-ff9a8578-9a65-4f8a-be10-dffa8623949e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42105480c9a24e599b1fb4f0a88d40c7'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:48.923183 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-ff9a8578-9a65-4f8a-be10-dffa8623949e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42105480c9a24e599b1fb4f0a88d40c7'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:49.082199 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-ff9a8578-9a65-4f8a-be10-dffa8623949e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42105480c9a24e599b1fb4f0a88d40c7'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:49.101298 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 972/1940] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:00:48 2022] DELETE /identity/v3/users/42105480c9a24e599b1fb4f0a88d40c7 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:49.106360 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115cd1b-7bf6-4824-8c0a-04c3fe660a4f None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:49.106831 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115cd1b-7bf6-4824-8c0a-04c3fe660a4f None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:49.106931 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115cd1b-7bf6-4824-8c0a-04c3fe660a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:49.128237 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-6115cd1b-7bf6-4824-8c0a-04c3fe660a4f None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:49.129930 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-6115cd1b-7bf6-4824-8c0a-04c3fe660a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:49.195689 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 969/1941] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:00:49.205573 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a8578-9a65-4f8a-be10-dffa8623949e admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:49.206970 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-ff9a8578-9a65-4f8a-be10-dffa8623949e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:49.281644 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a8578-9a65-4f8a-be10-dffa8623949e admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:49.285320 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddcacd-f5e9-4732-8205-051a0c42230e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:49.285978 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddcacd-f5e9-4732-8205-051a0c42230e service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:49.286255 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddcacd-f5e9-4732-8205-051a0c42230e service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:49.286541 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddcacd-f5e9-4732-8205-051a0c42230e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:49.301587 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddcacd-f5e9-4732-8205-051a0c42230e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:49.305048 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddcacd-f5e9-4732-8205-051a0c42230e service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:49.313869 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 973/1942] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:00:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:00:50.026030 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115cd1b-7bf6-4824-8c0a-04c3fe660a4f None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:50.027580 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-6115cd1b-7bf6-4824-8c0a-04c3fe660a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:50.040029 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115cd1b-7bf6-4824-8c0a-04c3fe660a4f None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:50.044739 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5306a89-dc0e-43ef-ae94-a2af30053326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:50.045644 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5306a89-dc0e-43ef-ae94-a2af30053326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:50.045951 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5306a89-dc0e-43ef-ae94-a2af30053326 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:50.046227 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5306a89-dc0e-43ef-ae94-a2af30053326 admin admin] PATH_INFO: `/v3/users/c439b7ebe2d44b4ca60a269bd60520e8` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:50.047468 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5306a89-dc0e-43ef-ae94-a2af30053326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c439b7ebe2d44b4ca60a269bd60520e8)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:50.049437 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5306a89-dc0e-43ef-ae94-a2af30053326 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:50.174105 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddcacd-f5e9-4732-8205-051a0c42230e service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:50.177432 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-ceddcacd-f5e9-4732-8205-051a0c42230e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:50.194035 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddcacd-f5e9-4732-8205-051a0c42230e service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:50.198716 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfb13b-2833-45ac-b1a3-a92040467181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:50.199625 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfb13b-2833-45ac-b1a3-a92040467181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:50.199853 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfb13b-2833-45ac-b1a3-a92040467181 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:50.200131 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfb13b-2833-45ac-b1a3-a92040467181 admin admin] PATH_INFO: `/v3/projects/a58a92493d354f4c93ae830af1fd6fd6` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:50.201386 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febfb13b-2833-45ac-b1a3-a92040467181 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a58a92493d354f4c93ae830af1fd6fd6)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:50.203993 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febfb13b-2833-45ac-b1a3-a92040467181 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:50.321401 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-a5306a89-dc0e-43ef-ae94-a2af30053326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c439b7ebe2d44b4ca60a269bd60520e8'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:50.328497 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-a5306a89-dc0e-43ef-ae94-a2af30053326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c439b7ebe2d44b4ca60a269bd60520e8'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:50.329230 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-a5306a89-dc0e-43ef-ae94-a2af30053326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c439b7ebe2d44b4ca60a269bd60520e8'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:50.359687 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-febfb13b-2833-45ac-b1a3-a92040467181 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a58a92493d354f4c93ae830af1fd6fd6', 'request_id': 'req-febfb13b-2833-45ac-b1a3-a92040467181'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:50.366188 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-febfb13b-2833-45ac-b1a3-a92040467181 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a58a92493d354f4c93ae830af1fd6fd6', 'request_id': 'req-febfb13b-2833-45ac-b1a3-a92040467181'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:50.476743 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-a5306a89-dc0e-43ef-ae94-a2af30053326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c439b7ebe2d44b4ca60a269bd60520e8'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:50.493726 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-a5306a89-dc0e-43ef-ae94-a2af30053326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c439b7ebe2d44b4ca60a269bd60520e8'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:50.503637 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 970/1943] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:00:50 2022] DELETE /identity/v3/users/c439b7ebe2d44b4ca60a269bd60520e8 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:50.548621 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-febfb13b-2833-45ac-b1a3-a92040467181 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a58a92493d354f4c93ae830af1fd6fd6', 'request_id': 'req-febfb13b-2833-45ac-b1a3-a92040467181'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:50.559812 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-febfb13b-2833-45ac-b1a3-a92040467181 admin admin] The token cache is being invalidate because project a58a92493d354f4c93ae830af1fd6fd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:00:50.560101 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-febfb13b-2833-45ac-b1a3-a92040467181 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:50.560831 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-febfb13b-2833-45ac-b1a3-a92040467181 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:50.563147 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 974/1944] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:00:50 2022] DELETE /identity/v3/projects/a58a92493d354f4c93ae830af1fd6fd6 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:00:50.569202 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b34bb-4ba5-49c2-956b-9383ee328936 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:50.569500 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b34bb-4ba5-49c2-956b-9383ee328936 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:50.569982 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b34bb-4ba5-49c2-956b-9383ee328936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:50.589098 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-771b34bb-4ba5-49c2-956b-9383ee328936 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:50.590311 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-771b34bb-4ba5-49c2-956b-9383ee328936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:50.651913 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 971/1945] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:00:50.660150 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf74652-b28f-4505-9a7b-1dacd79e65d2 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:50.660150 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf74652-b28f-4505-9a7b-1dacd79e65d2 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:50.660369 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf74652-b28f-4505-9a7b-1dacd79e65d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:50.682028 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-3cf74652-b28f-4505-9a7b-1dacd79e65d2 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:50.683259 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-3cf74652-b28f-4505-9a7b-1dacd79e65d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:50.691991 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 975/1946] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:00:50.696193 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b34bb-4ba5-49c2-956b-9383ee328936 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:50.705673 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b34bb-4ba5-49c2-956b-9383ee328936 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:50.710323 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a8beb-0a5c-48fe-824e-3214608cb6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:50.710970 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a8beb-0a5c-48fe-824e-3214608cb6ec admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:50.711256 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a8beb-0a5c-48fe-824e-3214608cb6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:50.711530 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a8beb-0a5c-48fe-824e-3214608cb6ec admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:50.712284 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a8beb-0a5c-48fe-824e-3214608cb6ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:00:50.712589 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a8beb-0a5c-48fe-824e-3214608cb6ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:50.714238 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a8beb-0a5c-48fe-824e-3214608cb6ec admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:50.725473 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 972/1947] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 15:00:50.730830 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf74652-b28f-4505-9a7b-1dacd79e65d2 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:50.741420 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf74652-b28f-4505-9a7b-1dacd79e65d2 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:50.746185 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc176e-9470-481f-ba98-aebeb8319cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:50.746880 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc176e-9470-481f-ba98-aebeb8319cfd admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:50.747163 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc176e-9470-481f-ba98-aebeb8319cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:50.747469 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc176e-9470-481f-ba98-aebeb8319cfd admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:50.748179 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc176e-9470-481f-ba98-aebeb8319cfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:50.752000 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc176e-9470-481f-ba98-aebeb8319cfd admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:50.760484 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a8beb-0a5c-48fe-824e-3214608cb6ec admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:50.762321 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-ed7a8beb-0a5c-48fe-824e-3214608cb6ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:50.782650 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a8beb-0a5c-48fe-824e-3214608cb6ec admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:50.787492 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e9f9b-ee72-4e4d-9552-e1bf4dd3e48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:50.788352 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e9f9b-ee72-4e4d-9552-e1bf4dd3e48e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:50.788639 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e9f9b-ee72-4e4d-9552-e1bf4dd3e48e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:50.788920 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e9f9b-ee72-4e4d-9552-e1bf4dd3e48e admin admin] PATH_INFO: `/v3/projects/fc623d81b10e491ab3a65d62b99bf7c7` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:50.790317 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e9f9b-ee72-4e4d-9552-e1bf4dd3e48e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc623d81b10e491ab3a65d62b99bf7c7)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:50.792291 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e9f9b-ee72-4e4d-9552-e1bf4dd3e48e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:50.868871 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 976/1948] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:00:50 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:00:50.870292 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc176e-9470-481f-ba98-aebeb8319cfd admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:50.910487 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4d0e9f9b-ee72-4e4d-9552-e1bf4dd3e48e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc623d81b10e491ab3a65d62b99bf7c7', 'request_id': 'req-4d0e9f9b-ee72-4e4d-9552-e1bf4dd3e48e'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:50.918245 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4d0e9f9b-ee72-4e4d-9552-e1bf4dd3e48e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc623d81b10e491ab3a65d62b99bf7c7', 'request_id': 'req-4d0e9f9b-ee72-4e4d-9552-e1bf4dd3e48e'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:50.925823 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4d0e9f9b-ee72-4e4d-9552-e1bf4dd3e48e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc623d81b10e491ab3a65d62b99bf7c7', 'request_id': 'req-4d0e9f9b-ee72-4e4d-9552-e1bf4dd3e48e'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:50.946148 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc176e-9470-481f-ba98-aebeb8319cfd admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:51.008292 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dee877-330c-494b-837e-2977a01a0997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:51.008881 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dee877-330c-494b-837e-2977a01a0997 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:51.009195 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dee877-330c-494b-837e-2977a01a0997 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:51.009475 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dee877-330c-494b-837e-2977a01a0997 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:51.010220 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dee877-330c-494b-837e-2977a01a0997 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:51.012184 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dee877-330c-494b-837e-2977a01a0997 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:51.092490 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4d0e9f9b-ee72-4e4d-9552-e1bf4dd3e48e admin admin] The token cache is being invalidate because project fc623d81b10e491ab3a65d62b99bf7c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:00:51.093312 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4d0e9f9b-ee72-4e4d-9552-e1bf4dd3e48e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:51.094191 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4d0e9f9b-ee72-4e4d-9552-e1bf4dd3e48e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:51.096046 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 973/1949] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:00:50 2022] DELETE /identity/v3/projects/fc623d81b10e491ab3a65d62b99bf7c7 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:00:51.101865 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a058e0-2105-470a-ba0a-da8a3a01f01c None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:51.102204 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a058e0-2105-470a-ba0a-da8a3a01f01c None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:51.102453 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a058e0-2105-470a-ba0a-da8a3a01f01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:51.122630 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-e3a058e0-2105-470a-ba0a-da8a3a01f01c None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:51.123820 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-e3a058e0-2105-470a-ba0a-da8a3a01f01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:51.131975 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 974/1950] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:00:51.140489 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b07ef0-e08c-40fc-821e-c902100a479e None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:51.140777 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b07ef0-e08c-40fc-821e-c902100a479e None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:51.141053 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b07ef0-e08c-40fc-821e-c902100a479e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:51.157802 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 977/1951] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:00:50 2022] POST /identity/v3/users => generated 293 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:00:51.158943 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-a8b07ef0-e08c-40fc-821e-c902100a479e None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:51.160123 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-a8b07ef0-e08c-40fc-821e-c902100a479e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:51.161783 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dee877-330c-494b-837e-2977a01a0997 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:51.163492 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-32dee877-330c-494b-837e-2977a01a0997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:51.168342 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 975/1952] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:00:51.172229 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b07ef0-e08c-40fc-821e-c902100a479e None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:51.175797 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dee877-330c-494b-837e-2977a01a0997 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:51.180476 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0831c1-deae-4c46-a143-80397988595f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:51.180848 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b07ef0-e08c-40fc-821e-c902100a479e None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:51.181166 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0831c1-deae-4c46-a143-80397988595f admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:51.181437 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0831c1-deae-4c46-a143-80397988595f admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:51.181714 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0831c1-deae-4c46-a143-80397988595f admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:51.182448 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0831c1-deae-4c46-a143-80397988595f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:51.184151 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0831c1-deae-4c46-a143-80397988595f admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:51.185543 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce987aec-e9f3-4980-bc90-a0393925529d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:51.186173 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce987aec-e9f3-4980-bc90-a0393925529d admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:51.186478 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce987aec-e9f3-4980-bc90-a0393925529d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:51.186752 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce987aec-e9f3-4980-bc90-a0393925529d admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:51.187472 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce987aec-e9f3-4980-bc90-a0393925529d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:00:51.187774 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce987aec-e9f3-4980-bc90-a0393925529d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:51.189497 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce987aec-e9f3-4980-bc90-a0393925529d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:51.195697 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 978/1953] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:00:51.202764 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 976/1954] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 15:00:51.204204 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0831c1-deae-4c46-a143-80397988595f admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:51.205233 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce987aec-e9f3-4980-bc90-a0393925529d admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:51.214009 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0831c1-deae-4c46-a143-80397988595f admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:51.214462 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce987aec-e9f3-4980-bc90-a0393925529d admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:51.219221 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71ba2d-a14b-4d93-9f38-35e328eac988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:51.223339 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a4fff-8138-4bd8-9137-bd42098b0943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:51.223455 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71ba2d-a14b-4d93-9f38-35e328eac988 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:51.223455 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71ba2d-a14b-4d93-9f38-35e328eac988 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:51.223643 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a4fff-8138-4bd8-9137-bd42098b0943 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:51.223735 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71ba2d-a14b-4d93-9f38-35e328eac988 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:51.223826 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a4fff-8138-4bd8-9137-bd42098b0943 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:51.223826 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a4fff-8138-4bd8-9137-bd42098b0943 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:51.223982 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71ba2d-a14b-4d93-9f38-35e328eac988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:51.224063 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a4fff-8138-4bd8-9137-bd42098b0943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:51.224142 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71ba2d-a14b-4d93-9f38-35e328eac988 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:51.224231 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a4fff-8138-4bd8-9137-bd42098b0943 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:51.235252 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 979/1955] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:00:51.239384 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71ba2d-a14b-4d93-9f38-35e328eac988 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:51.249112 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71ba2d-a14b-4d93-9f38-35e328eac988 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:51.253747 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94509c4-9551-478f-8972-9d2bbb7d9e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:51.257755 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94509c4-9551-478f-8972-9d2bbb7d9e0f admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:51.257755 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94509c4-9551-478f-8972-9d2bbb7d9e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:51.257755 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94509c4-9551-478f-8972-9d2bbb7d9e0f admin admin] PATH_INFO: `/v3/projects/2e549d08f1824c45a9dea7b2e6e88c6a/users/697af3f379bc4af3971aee40b858b81c/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:51.272160 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94509c4-9551-478f-8972-9d2bbb7d9e0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e549d08f1824c45a9dea7b2e6e88c6a, user_id=697af3f379bc4af3971aee40b858b81c, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:51.274904 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94509c4-9551-478f-8972-9d2bbb7d9e0f admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:51.323313 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 977/1956] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:00:51 2022] POST /identity/v3/projects => generated 405 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:00:51.327798 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a4fff-8138-4bd8-9137-bd42098b0943 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:51.350974 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 980/1957] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:00:51 2022] PUT /identity/v3/projects/2e549d08f1824c45a9dea7b2e6e88c6a/users/697af3f379bc4af3971aee40b858b81c/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:00:51.363125 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098181aa-4f40-4504-8d57-ebcc10131b57 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:51.363502 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098181aa-4f40-4504-8d57-ebcc10131b57 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:51.363845 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098181aa-4f40-4504-8d57-ebcc10131b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:51.391919 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-098181aa-4f40-4504-8d57-ebcc10131b57 None None] MFA Rules not processed for user `697af3f379bc4af3971aee40b858b81c`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:51.392784 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a4fff-8138-4bd8-9137-bd42098b0943 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:51.393327 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-098181aa-4f40-4504-8d57-ebcc10131b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:51.451824 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8399d4-76f2-49f4-84ba-16357213d3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:51.453068 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8399d4-76f2-49f4-84ba-16357213d3ed admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:51.453465 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8399d4-76f2-49f4-84ba-16357213d3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:51.453754 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8399d4-76f2-49f4-84ba-16357213d3ed admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:51.454465 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8399d4-76f2-49f4-84ba-16357213d3ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:51.456011 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 981/1958] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:00:51.456519 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8399d4-76f2-49f4-84ba-16357213d3ed admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:51.460378 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098181aa-4f40-4504-8d57-ebcc10131b57 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:51.476525 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098181aa-4f40-4504-8d57-ebcc10131b57 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:51.481504 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908581f0-7fce-4624-8c26-a0bbbea5753f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:51.482157 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908581f0-7fce-4624-8c26-a0bbbea5753f admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:51.482462 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908581f0-7fce-4624-8c26-a0bbbea5753f admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:51.482737 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908581f0-7fce-4624-8c26-a0bbbea5753f admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:51.483461 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908581f0-7fce-4624-8c26-a0bbbea5753f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:51.485408 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908581f0-7fce-4624-8c26-a0bbbea5753f admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:51.551325 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 978/1959] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:00:51 2022] POST /identity/v3/users => generated 303 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:00:51.556084 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8399d4-76f2-49f4-84ba-16357213d3ed admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:51.565317 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8399d4-76f2-49f4-84ba-16357213d3ed admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:51.569959 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a169b-064c-48ed-af1c-8f0acb8cbc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:51.570586 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a169b-064c-48ed-af1c-8f0acb8cbc7b admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:51.570869 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a169b-064c-48ed-af1c-8f0acb8cbc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:51.571144 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a169b-064c-48ed-af1c-8f0acb8cbc7b admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:51.571866 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a169b-064c-48ed-af1c-8f0acb8cbc7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:51.573507 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a169b-064c-48ed-af1c-8f0acb8cbc7b admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:51.584182 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 979/1960] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:00:51.588079 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a169b-064c-48ed-af1c-8f0acb8cbc7b admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:51.589542 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 982/1961] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:00:51 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:00:51.593664 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908581f0-7fce-4624-8c26-a0bbbea5753f admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:51.602005 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a169b-064c-48ed-af1c-8f0acb8cbc7b admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:51.656274 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172de707-43fe-4d90-9db7-3fffd8d8bc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:51.656937 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172de707-43fe-4d90-9db7-3fffd8d8bc6a admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:51.657251 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172de707-43fe-4d90-9db7-3fffd8d8bc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:51.657529 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172de707-43fe-4d90-9db7-3fffd8d8bc6a admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:51.658259 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172de707-43fe-4d90-9db7-3fffd8d8bc6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:51.658718 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908581f0-7fce-4624-8c26-a0bbbea5753f admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:51.659887 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172de707-43fe-4d90-9db7-3fffd8d8bc6a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:51.663443 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61134acb-d094-43fb-b3c2-995765f4bbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:51.664106 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61134acb-d094-43fb-b3c2-995765f4bbf6 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:51.664391 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61134acb-d094-43fb-b3c2-995765f4bbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:51.664669 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61134acb-d094-43fb-b3c2-995765f4bbf6 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:51.665406 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61134acb-d094-43fb-b3c2-995765f4bbf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:51.667391 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61134acb-d094-43fb-b3c2-995765f4bbf6 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:51.673001 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 980/1962] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:00:51.673952 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172de707-43fe-4d90-9db7-3fffd8d8bc6a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:51.683078 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172de707-43fe-4d90-9db7-3fffd8d8bc6a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:51.687685 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49188c12-b77a-4d91-8df5-bc0502b77714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:51.689130 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49188c12-b77a-4d91-8df5-bc0502b77714 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:51.689130 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49188c12-b77a-4d91-8df5-bc0502b77714 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:51.689130 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49188c12-b77a-4d91-8df5-bc0502b77714 admin admin] PATH_INFO: `/v3/projects/18f9c22e3f1946ef85a79918829056ae/users/8914cc2f277243beab050f230a5adb23/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:51.703236 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49188c12-b77a-4d91-8df5-bc0502b77714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18f9c22e3f1946ef85a79918829056ae, user_id=8914cc2f277243beab050f230a5adb23, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:51.705987 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49188c12-b77a-4d91-8df5-bc0502b77714 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:51.748608 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 983/1963] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:00:51 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:00:51.752423 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61134acb-d094-43fb-b3c2-995765f4bbf6 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:51.762267 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61134acb-d094-43fb-b3c2-995765f4bbf6 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:51.767941 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5be2c-252e-489a-b1c0-e43856496315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:51.768616 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5be2c-252e-489a-b1c0-e43856496315 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:51.768934 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5be2c-252e-489a-b1c0-e43856496315 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:51.769253 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5be2c-252e-489a-b1c0-e43856496315 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:51.770168 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5be2c-252e-489a-b1c0-e43856496315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:51.771822 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5be2c-252e-489a-b1c0-e43856496315 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:51.784810 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 984/1964] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:00:51.786429 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5be2c-252e-489a-b1c0-e43856496315 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:51.790424 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 981/1965] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:00:51 2022] PUT /identity/v3/projects/18f9c22e3f1946ef85a79918829056ae/users/8914cc2f277243beab050f230a5adb23/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:51.796789 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5be2c-252e-489a-b1c0-e43856496315 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:51.803159 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b91f14-d59e-4cc3-bc77-7f295394e0da None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:51.803382 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b91f14-d59e-4cc3-bc77-7f295394e0da None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:51.803655 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b91f14-d59e-4cc3-bc77-7f295394e0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:51.820583 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-33b91f14-d59e-4cc3-bc77-7f295394e0da None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:51.821835 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-33b91f14-d59e-4cc3-bc77-7f295394e0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:51.855822 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45481fd2-849b-4f6b-8db3-25aa24a941b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:51.856496 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45481fd2-849b-4f6b-8db3-25aa24a941b0 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:51.856781 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45481fd2-849b-4f6b-8db3-25aa24a941b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:51.857059 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45481fd2-849b-4f6b-8db3-25aa24a941b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:51.857824 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45481fd2-849b-4f6b-8db3-25aa24a941b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:51.859969 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45481fd2-849b-4f6b-8db3-25aa24a941b0 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:51.872911 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 985/1966] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:00:51.873946 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45481fd2-849b-4f6b-8db3-25aa24a941b0 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:51.881125 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 982/1967] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:00:51.883375 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45481fd2-849b-4f6b-8db3-25aa24a941b0 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:51.887971 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a9e05-7f25-4f8b-bc14-aa349e7c8979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:51.888831 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a9e05-7f25-4f8b-bc14-aa349e7c8979 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:51.889130 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a9e05-7f25-4f8b-bc14-aa349e7c8979 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:51.889974 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a9e05-7f25-4f8b-bc14-aa349e7c8979 admin admin] PATH_INFO: `/v3/projects/b45d2f7e2a94435d959a10458af476a6/users/3309d8d8019d45909cd1c68b892bc99c/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:51.891020 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b91f14-d59e-4cc3-bc77-7f295394e0da None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:51.896859 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-33b91f14-d59e-4cc3-bc77-7f295394e0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:51.904823 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a9e05-7f25-4f8b-bc14-aa349e7c8979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b45d2f7e2a94435d959a10458af476a6, user_id=3309d8d8019d45909cd1c68b892bc99c, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:51.908187 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a9e05-7f25-4f8b-bc14-aa349e7c8979 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:51.945626 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b91f14-d59e-4cc3-bc77-7f295394e0da None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:51.949347 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1e3eb-7c70-4b62-abe9-a2d6d8707264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:51.949980 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1e3eb-7c70-4b62-abe9-a2d6d8707264 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:51.950263 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1e3eb-7c70-4b62-abe9-a2d6d8707264 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:51.950538 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1e3eb-7c70-4b62-abe9-a2d6d8707264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:51.962325 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1e3eb-7c70-4b62-abe9-a2d6d8707264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:51.962325 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1e3eb-7c70-4b62-abe9-a2d6d8707264 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:51.971973 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 983/1968] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:00:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:00:51.985032 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 986/1969] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:00:51 2022] PUT /identity/v3/projects/b45d2f7e2a94435d959a10458af476a6/users/3309d8d8019d45909cd1c68b892bc99c/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:51.996093 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f1e8c-b059-4ecc-a043-da42d95f68f3 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:51.996386 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f1e8c-b059-4ecc-a043-da42d95f68f3 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:51.996671 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f1e8c-b059-4ecc-a043-da42d95f68f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:52.022134 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-ee2f1e8c-b059-4ecc-a043-da42d95f68f3 None None] MFA Rules not processed for user `3309d8d8019d45909cd1c68b892bc99c`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:52.023309 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-ee2f1e8c-b059-4ecc-a043-da42d95f68f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:52.084849 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 984/1970] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:00:52.089370 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a9e05-7f25-4f8b-bc14-aa349e7c8979 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:52.151982 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a9e05-7f25-4f8b-bc14-aa349e7c8979 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:52.163925 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03528bbb-98b9-415c-b482-519280954878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:52.164758 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03528bbb-98b9-415c-b482-519280954878 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:52.165139 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03528bbb-98b9-415c-b482-519280954878 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:52.165423 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03528bbb-98b9-415c-b482-519280954878 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:52.166316 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03528bbb-98b9-415c-b482-519280954878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:52.168186 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03528bbb-98b9-415c-b482-519280954878 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:52.277958 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 987/1971] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:00:52 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:00:52.282370 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f1e8c-b059-4ecc-a043-da42d95f68f3 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:52.292756 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f1e8c-b059-4ecc-a043-da42d95f68f3 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:52.351626 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60663ea8-dc67-4d7c-8753-27a6f280b598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:52.352357 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60663ea8-dc67-4d7c-8753-27a6f280b598 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:52.352645 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60663ea8-dc67-4d7c-8753-27a6f280b598 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:52.352922 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60663ea8-dc67-4d7c-8753-27a6f280b598 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:52.353680 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60663ea8-dc67-4d7c-8753-27a6f280b598 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:52.359766 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60663ea8-dc67-4d7c-8753-27a6f280b598 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:52.460596 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 985/1972] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:00:52 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:00:52.464403 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03528bbb-98b9-415c-b482-519280954878 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:52.475501 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03528bbb-98b9-415c-b482-519280954878 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:52.480318 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07898fa2-6b7f-44f8-86c0-6170d87b2c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:52.480974 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07898fa2-6b7f-44f8-86c0-6170d87b2c09 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:52.481294 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07898fa2-6b7f-44f8-86c0-6170d87b2c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:52.481572 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07898fa2-6b7f-44f8-86c0-6170d87b2c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:52.486631 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07898fa2-6b7f-44f8-86c0-6170d87b2c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:52.486631 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07898fa2-6b7f-44f8-86c0-6170d87b2c09 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:52.496360 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 988/1973] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:00:52.500484 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60663ea8-dc67-4d7c-8753-27a6f280b598 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:52.510742 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60663ea8-dc67-4d7c-8753-27a6f280b598 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:52.515437 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353937ef-e52e-40e1-ade5-875a6b2f9cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:52.516326 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353937ef-e52e-40e1-ade5-875a6b2f9cfc admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:52.516612 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353937ef-e52e-40e1-ade5-875a6b2f9cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:52.516887 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353937ef-e52e-40e1-ade5-875a6b2f9cfc admin admin] PATH_INFO: `/v3/projects/89da0307929e47cdbf926456d3198b86/users/8850538474bb4fbeba75e0ad61700afc/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:52.532597 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353937ef-e52e-40e1-ade5-875a6b2f9cfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=89da0307929e47cdbf926456d3198b86, user_id=8850538474bb4fbeba75e0ad61700afc, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:52.535304 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353937ef-e52e-40e1-ade5-875a6b2f9cfc admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:52.648056 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 986/1974] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:00:52 2022] PUT /identity/v3/projects/89da0307929e47cdbf926456d3198b86/users/8850538474bb4fbeba75e0ad61700afc/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:52.652117 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07898fa2-6b7f-44f8-86c0-6170d87b2c09 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:52.662933 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07898fa2-6b7f-44f8-86c0-6170d87b2c09 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:52.721401 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947b2ef-d711-423e-acdf-a92d3aeb5b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:52.722067 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947b2ef-d711-423e-acdf-a92d3aeb5b03 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:52.722348 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947b2ef-d711-423e-acdf-a92d3aeb5b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:52.722624 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947b2ef-d711-423e-acdf-a92d3aeb5b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:52.723354 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947b2ef-d711-423e-acdf-a92d3aeb5b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:52.724980 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947b2ef-d711-423e-acdf-a92d3aeb5b03 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:52.735350 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 989/1975] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:00:52.739535 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353937ef-e52e-40e1-ade5-875a6b2f9cfc admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:52.750101 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353937ef-e52e-40e1-ade5-875a6b2f9cfc admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:52.755383 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae908b-21f4-4c04-a14a-29f635caab9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:52.756337 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae908b-21f4-4c04-a14a-29f635caab9f admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:52.756616 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae908b-21f4-4c04-a14a-29f635caab9f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:52.756893 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae908b-21f4-4c04-a14a-29f635caab9f admin admin] PATH_INFO: `/v3/projects/89da0307929e47cdbf926456d3198b86/users/8850538474bb4fbeba75e0ad61700afc/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:52.759201 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae908b-21f4-4c04-a14a-29f635caab9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=89da0307929e47cdbf926456d3198b86, user_id=8850538474bb4fbeba75e0ad61700afc, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:52.762087 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae908b-21f4-4c04-a14a-29f635caab9f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:52.774030 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 987/1976] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:00:52 2022] PUT /identity/v3/projects/89da0307929e47cdbf926456d3198b86/users/8850538474bb4fbeba75e0ad61700afc/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:52.785074 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a54c1f-7da1-4547-8e4f-a27bcf9d5ab1 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:52.785395 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a54c1f-7da1-4547-8e4f-a27bcf9d5ab1 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:52.785681 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a54c1f-7da1-4547-8e4f-a27bcf9d5ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:52.813473 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-96a54c1f-7da1-4547-8e4f-a27bcf9d5ab1 None None] MFA Rules not processed for user `8850538474bb4fbeba75e0ad61700afc`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:52.814690 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-96a54c1f-7da1-4547-8e4f-a27bcf9d5ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:52.885847 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 990/1977] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:00:52.896688 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae908b-21f4-4c04-a14a-29f635caab9f admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:52.898549 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-d2ae908b-21f4-4c04-a14a-29f635caab9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:52.954194 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae908b-21f4-4c04-a14a-29f635caab9f admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:52.958075 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ed545-5783-4ed5-84cd-f7fbf043a494 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:52.958727 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ed545-5783-4ed5-84cd-f7fbf043a494 service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:52.959008 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ed545-5783-4ed5-84cd-f7fbf043a494 service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:52.959283 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ed545-5783-4ed5-84cd-f7fbf043a494 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:53.027987 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ed545-5783-4ed5-84cd-f7fbf043a494 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:53.029519 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ed545-5783-4ed5-84cd-f7fbf043a494 service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:53.039689 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 988/1978] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:00:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:00:53.509174 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0de3ad-042a-4ad9-b4e2-0aff35d6f63b None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:53.509174 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0de3ad-042a-4ad9-b4e2-0aff35d6f63b None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:53.509174 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0de3ad-042a-4ad9-b4e2-0aff35d6f63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:53.542707 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-9c0de3ad-042a-4ad9-b4e2-0aff35d6f63b None None] MFA Rules not processed for user `8914cc2f277243beab050f230a5adb23`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:53.543924 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-9c0de3ad-042a-4ad9-b4e2-0aff35d6f63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:53.609705 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 991/1979] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:53 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:00:53.613832 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ed545-5783-4ed5-84cd-f7fbf043a494 service cinder] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:53.675555 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ed545-5783-4ed5-84cd-f7fbf043a494 service cinder] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:53.680772 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88580208-769e-498c-898a-343ff5156f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:53.681492 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88580208-769e-498c-898a-343ff5156f89 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:53.681868 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88580208-769e-498c-898a-343ff5156f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:53.682149 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88580208-769e-498c-898a-343ff5156f89 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:53.682863 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88580208-769e-498c-898a-343ff5156f89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:53.684840 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88580208-769e-498c-898a-343ff5156f89 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:53.815001 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 989/1980] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:00:53 2022] POST /identity/v3/projects => generated 405 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:00:53.818770 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0de3ad-042a-4ad9-b4e2-0aff35d6f63b None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:53.835509 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0de3ad-042a-4ad9-b4e2-0aff35d6f63b None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:53.898776 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcd148-27f7-4069-a329-e93338197f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:53.899446 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcd148-27f7-4069-a329-e93338197f55 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:53.899730 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcd148-27f7-4069-a329-e93338197f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:53.900005 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcd148-27f7-4069-a329-e93338197f55 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:53.900718 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcd148-27f7-4069-a329-e93338197f55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:53.902706 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcd148-27f7-4069-a329-e93338197f55 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:54.084695 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 992/1981] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:00:53 2022] POST /identity/v3/users => generated 309 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:00:54.084812 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88580208-769e-498c-898a-343ff5156f89 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:54.094396 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88580208-769e-498c-898a-343ff5156f89 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:54.099001 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f1809-fc1a-4414-8b81-7ce4916a6b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:54.099651 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f1809-fc1a-4414-8b81-7ce4916a6b32 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:54.099953 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f1809-fc1a-4414-8b81-7ce4916a6b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:54.100219 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f1809-fc1a-4414-8b81-7ce4916a6b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:54.100952 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f1809-fc1a-4414-8b81-7ce4916a6b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:54.102704 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f1809-fc1a-4414-8b81-7ce4916a6b32 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:54.113722 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 990/1982] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:00:54.117802 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcd148-27f7-4069-a329-e93338197f55 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:54.127928 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcd148-27f7-4069-a329-e93338197f55 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:54.133871 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3be85-b5c4-4244-b67f-6d0fef3bdd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:54.133871 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3be85-b5c4-4244-b67f-6d0fef3bdd17 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:54.134162 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3be85-b5c4-4244-b67f-6d0fef3bdd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:54.134643 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3be85-b5c4-4244-b67f-6d0fef3bdd17 admin admin] PATH_INFO: `/v3/projects/61aeb98b59034b41b0749332052760c7/users/988f6c6b7a4746d8a73fbbab50c1297b/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:54.150993 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3be85-b5c4-4244-b67f-6d0fef3bdd17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61aeb98b59034b41b0749332052760c7, user_id=988f6c6b7a4746d8a73fbbab50c1297b, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:54.153900 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3be85-b5c4-4244-b67f-6d0fef3bdd17 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:54.265824 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 993/1983] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:00:54 2022] PUT /identity/v3/projects/61aeb98b59034b41b0749332052760c7/users/988f6c6b7a4746d8a73fbbab50c1297b/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:00:54.269784 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f1809-fc1a-4414-8b81-7ce4916a6b32 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:54.279764 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f1809-fc1a-4414-8b81-7ce4916a6b32 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:54.333986 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b63ac-574b-4700-9641-88cd9060e1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:54.334572 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b63ac-574b-4700-9641-88cd9060e1cf admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:54.334855 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b63ac-574b-4700-9641-88cd9060e1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:54.335132 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b63ac-574b-4700-9641-88cd9060e1cf admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:54.335893 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b63ac-574b-4700-9641-88cd9060e1cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:54.337530 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b63ac-574b-4700-9641-88cd9060e1cf admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:54.347391 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 991/1984] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:00:54.351580 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3be85-b5c4-4244-b67f-6d0fef3bdd17 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:54.362121 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3be85-b5c4-4244-b67f-6d0fef3bdd17 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:54.366764 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0dc20-787f-437b-8400-3d46116967e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:54.371263 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0dc20-787f-437b-8400-3d46116967e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:54.371263 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0dc20-787f-437b-8400-3d46116967e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:54.371263 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0dc20-787f-437b-8400-3d46116967e7 admin admin] PATH_INFO: `/v3/projects/61aeb98b59034b41b0749332052760c7/users/988f6c6b7a4746d8a73fbbab50c1297b/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:54.371263 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0dc20-787f-437b-8400-3d46116967e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61aeb98b59034b41b0749332052760c7, user_id=988f6c6b7a4746d8a73fbbab50c1297b, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:54.372790 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0dc20-787f-437b-8400-3d46116967e7 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:54.383038 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 994/1985] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:00:54 2022] PUT /identity/v3/projects/61aeb98b59034b41b0749332052760c7/users/988f6c6b7a4746d8a73fbbab50c1297b/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:55.493381 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b63ac-574b-4700-9641-88cd9060e1cf admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:55.495751 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-885b63ac-574b-4700-9641-88cd9060e1cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:55.560460 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b63ac-574b-4700-9641-88cd9060e1cf admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:55.609347 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2b889-ab1e-4b23-b547-8824790796a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:55.610010 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2b889-ab1e-4b23-b547-8824790796a4 service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:55.610294 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2b889-ab1e-4b23-b547-8824790796a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:55.610572 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2b889-ab1e-4b23-b547-8824790796a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:55.664859 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2b889-ab1e-4b23-b547-8824790796a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:55.666249 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2b889-ab1e-4b23-b547-8824790796a4 service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:55.674862 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 992/1986] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:00:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:00:56.022761 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda7566-bc05-443f-8227-b729aef805c2 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:56.023257 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda7566-bc05-443f-8227-b729aef805c2 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:56.023358 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda7566-bc05-443f-8227-b729aef805c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:56.049189 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-6dda7566-bc05-443f-8227-b729aef805c2 None None] MFA Rules not processed for user `988f6c6b7a4746d8a73fbbab50c1297b`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:56.050407 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-6dda7566-bc05-443f-8227-b729aef805c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:56.118049 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 995/1987] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:56 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:00:57.620344 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2b889-ab1e-4b23-b547-8824790796a4 service cinder] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:57.668321 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda7566-bc05-443f-8227-b729aef805c2 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:57.677484 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda7566-bc05-443f-8227-b729aef805c2 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:57.681568 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff870d0-eefa-41c9-a820-29c5a2b8db02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:57.682217 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff870d0-eefa-41c9-a820-29c5a2b8db02 service cinder] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:57.682505 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff870d0-eefa-41c9-a820-29c5a2b8db02 service cinder] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:57.682789 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff870d0-eefa-41c9-a820-29c5a2b8db02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:57.707051 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2b889-ab1e-4b23-b547-8824790796a4 service cinder] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:57.712194 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f319f9e-a6ea-48fd-9693-79419945634d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:57.713287 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f319f9e-a6ea-48fd-9693-79419945634d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:57.713725 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f319f9e-a6ea-48fd-9693-79419945634d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:57.714012 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f319f9e-a6ea-48fd-9693-79419945634d admin admin] PATH_INFO: `/v3/users/8914cc2f277243beab050f230a5adb23` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:57.715335 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f319f9e-a6ea-48fd-9693-79419945634d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8914cc2f277243beab050f230a5adb23)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:57.717579 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f319f9e-a6ea-48fd-9693-79419945634d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:57.749740 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff870d0-eefa-41c9-a820-29c5a2b8db02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:57.751327 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff870d0-eefa-41c9-a820-29c5a2b8db02 service cinder] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:57.761025 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 996/1988] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:00:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:00:57.997809 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-9f319f9e-a6ea-48fd-9693-79419945634d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8914cc2f277243beab050f230a5adb23'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:58.004411 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-9f319f9e-a6ea-48fd-9693-79419945634d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8914cc2f277243beab050f230a5adb23'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:58.005090 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-9f319f9e-a6ea-48fd-9693-79419945634d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8914cc2f277243beab050f230a5adb23'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:58.279251 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-9f319f9e-a6ea-48fd-9693-79419945634d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8914cc2f277243beab050f230a5adb23'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:58.291085 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-9f319f9e-a6ea-48fd-9693-79419945634d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8914cc2f277243beab050f230a5adb23'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:58.296893 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 993/1989] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:00:57 2022] DELETE /identity/v3/users/8914cc2f277243beab050f230a5adb23 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:58.532486 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff870d0-eefa-41c9-a820-29c5a2b8db02 service cinder] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:58.547200 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff870d0-eefa-41c9-a820-29c5a2b8db02 service cinder] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:58.607289 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4fc0a-c0c9-4257-8f30-91d637941d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:58.608234 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4fc0a-c0c9-4257-8f30-91d637941d27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:58.608519 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4fc0a-c0c9-4257-8f30-91d637941d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:58.608796 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4fc0a-c0c9-4257-8f30-91d637941d27 admin admin] PATH_INFO: `/v3/projects/18f9c22e3f1946ef85a79918829056ae` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:58.610213 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4fc0a-c0c9-4257-8f30-91d637941d27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18f9c22e3f1946ef85a79918829056ae)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:58.612273 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4fc0a-c0c9-4257-8f30-91d637941d27 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:58.767963 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-54b4fc0a-c0c9-4257-8f30-91d637941d27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18f9c22e3f1946ef85a79918829056ae', 'request_id': 'req-54b4fc0a-c0c9-4257-8f30-91d637941d27'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:58.773981 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-54b4fc0a-c0c9-4257-8f30-91d637941d27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18f9c22e3f1946ef85a79918829056ae', 'request_id': 'req-54b4fc0a-c0c9-4257-8f30-91d637941d27'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:58.859562 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-54b4fc0a-c0c9-4257-8f30-91d637941d27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18f9c22e3f1946ef85a79918829056ae', 'request_id': 'req-54b4fc0a-c0c9-4257-8f30-91d637941d27'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:58.870851 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-54b4fc0a-c0c9-4257-8f30-91d637941d27 admin admin] The token cache is being invalidate because project 18f9c22e3f1946ef85a79918829056ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:00:58.871141 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-54b4fc0a-c0c9-4257-8f30-91d637941d27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:58.871777 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-54b4fc0a-c0c9-4257-8f30-91d637941d27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:58.873348 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 997/1990] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:00:58 2022] DELETE /identity/v3/projects/18f9c22e3f1946ef85a79918829056ae => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:58.878166 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f319f9e-a6ea-48fd-9693-79419945634d admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:58.879589 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-9f319f9e-a6ea-48fd-9693-79419945634d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:58.892694 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f319f9e-a6ea-48fd-9693-79419945634d admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:58.948767 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9d24d-4178-48de-8e84-0b02974b732c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:58.949682 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9d24d-4178-48de-8e84-0b02974b732c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:58.949964 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9d24d-4178-48de-8e84-0b02974b732c admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:58.950239 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9d24d-4178-48de-8e84-0b02974b732c admin admin] PATH_INFO: `/v3/users/988f6c6b7a4746d8a73fbbab50c1297b` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:58.951468 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9d24d-4178-48de-8e84-0b02974b732c admin admin] RBAC: Authorizing `identity:delete_user(user_id=988f6c6b7a4746d8a73fbbab50c1297b)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:58.955760 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9d24d-4178-48de-8e84-0b02974b732c admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:59.194959 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-69b9d24d-4178-48de-8e84-0b02974b732c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '988f6c6b7a4746d8a73fbbab50c1297b'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:59.201560 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-69b9d24d-4178-48de-8e84-0b02974b732c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '988f6c6b7a4746d8a73fbbab50c1297b'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:59.202148 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-69b9d24d-4178-48de-8e84-0b02974b732c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '988f6c6b7a4746d8a73fbbab50c1297b'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:59.333441 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-69b9d24d-4178-48de-8e84-0b02974b732c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '988f6c6b7a4746d8a73fbbab50c1297b'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:59.345938 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-69b9d24d-4178-48de-8e84-0b02974b732c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '988f6c6b7a4746d8a73fbbab50c1297b'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:59.351854 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 994/1991] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:00:58 2022] DELETE /identity/v3/users/988f6c6b7a4746d8a73fbbab50c1297b => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:59.593601 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4fc0a-c0c9-4257-8f30-91d637941d27 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:00:59.595535 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-54b4fc0a-c0c9-4257-8f30-91d637941d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:00:59.616708 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4fc0a-c0c9-4257-8f30-91d637941d27 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:00:59.677804 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20e81b-70e4-4702-81ec-9f9dc1ffaf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:00:59.678670 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20e81b-70e4-4702-81ec-9f9dc1ffaf63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:59.679064 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20e81b-70e4-4702-81ec-9f9dc1ffaf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:59.679215 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20e81b-70e4-4702-81ec-9f9dc1ffaf63 admin admin] PATH_INFO: `/v3/projects/61aeb98b59034b41b0749332052760c7` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:59.680811 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20e81b-70e4-4702-81ec-9f9dc1ffaf63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61aeb98b59034b41b0749332052760c7)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:00:59.682373 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20e81b-70e4-4702-81ec-9f9dc1ffaf63 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:00:59.843477 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-0e20e81b-70e4-4702-81ec-9f9dc1ffaf63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61aeb98b59034b41b0749332052760c7', 'request_id': 'req-0e20e81b-70e4-4702-81ec-9f9dc1ffaf63'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:59.851183 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-0e20e81b-70e4-4702-81ec-9f9dc1ffaf63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61aeb98b59034b41b0749332052760c7', 'request_id': 'req-0e20e81b-70e4-4702-81ec-9f9dc1ffaf63'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:59.948345 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-0e20e81b-70e4-4702-81ec-9f9dc1ffaf63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61aeb98b59034b41b0749332052760c7', 'request_id': 'req-0e20e81b-70e4-4702-81ec-9f9dc1ffaf63'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:59.960410 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-0e20e81b-70e4-4702-81ec-9f9dc1ffaf63 admin admin] The token cache is being invalidate because project 61aeb98b59034b41b0749332052760c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:00:59.960703 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-0e20e81b-70e4-4702-81ec-9f9dc1ffaf63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:59.961362 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-0e20e81b-70e4-4702-81ec-9f9dc1ffaf63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:00:59.963083 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 998/1992] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:00:59 2022] DELETE /identity/v3/projects/61aeb98b59034b41b0749332052760c7 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:00:59.968859 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ccd50-8fce-401f-9454-d83e8de87c45 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:00:59.969338 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ccd50-8fce-401f-9454-d83e8de87c45 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:00:59.969481 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ccd50-8fce-401f-9454-d83e8de87c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:00:59.987596 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-e70ccd50-8fce-401f-9454-d83e8de87c45 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:00:59.988789 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-e70ccd50-8fce-401f-9454-d83e8de87c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:00.047709 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 995/1993] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:00.056591 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84a961-493d-4434-b6f9-acac86d55ebb None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:00.057199 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84a961-493d-4434-b6f9-acac86d55ebb None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:00.057482 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84a961-493d-4434-b6f9-acac86d55ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:00.079788 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-cf84a961-493d-4434-b6f9-acac86d55ebb None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:00.080423 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ccd50-8fce-401f-9454-d83e8de87c45 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:00.081452 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-cf84a961-493d-4434-b6f9-acac86d55ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:00.081970 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-e70ccd50-8fce-401f-9454-d83e8de87c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:00.089834 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 999/1994] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:00.099548 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ccd50-8fce-401f-9454-d83e8de87c45 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:00.100263 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84a961-493d-4434-b6f9-acac86d55ebb None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:00.105416 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87499f9c-3db0-42c0-a50c-64c43e81459d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:00.106301 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87499f9c-3db0-42c0-a50c-64c43e81459d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:00.106769 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87499f9c-3db0-42c0-a50c-64c43e81459d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:00.107191 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87499f9c-3db0-42c0-a50c-64c43e81459d admin admin] PATH_INFO: `/v3/users/7086a7d0a79f4bc8aa184ed1e8ad3348` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:00.108691 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87499f9c-3db0-42c0-a50c-64c43e81459d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7086a7d0a79f4bc8aa184ed1e8ad3348)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:00.110880 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84a961-493d-4434-b6f9-acac86d55ebb None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:00.111001 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87499f9c-3db0-42c0-a50c-64c43e81459d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:00.117665 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9fd87-55c7-4460-ae1d-485b1e1210c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:00.118418 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9fd87-55c7-4460-ae1d-485b1e1210c3 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:00.118797 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9fd87-55c7-4460-ae1d-485b1e1210c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:00.119546 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9fd87-55c7-4460-ae1d-485b1e1210c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:00.119951 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9fd87-55c7-4460-ae1d-485b1e1210c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:01:00.120317 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9fd87-55c7-4460-ae1d-485b1e1210c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:00.122189 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9fd87-55c7-4460-ae1d-485b1e1210c3 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:00.137053 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1000/1995] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 15:01:00.141823 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9fd87-55c7-4460-ae1d-485b1e1210c3 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:00.151894 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9fd87-55c7-4460-ae1d-485b1e1210c3 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:00.156954 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902838e1-3bc5-4eaf-9bf9-b06b6a04133a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:00.157651 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902838e1-3bc5-4eaf-9bf9-b06b6a04133a admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:00.157930 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902838e1-3bc5-4eaf-9bf9-b06b6a04133a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:00.158214 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902838e1-3bc5-4eaf-9bf9-b06b6a04133a admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:00.158911 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902838e1-3bc5-4eaf-9bf9-b06b6a04133a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:00.160880 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902838e1-3bc5-4eaf-9bf9-b06b6a04133a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:00.307341 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1001/1996] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:01:00 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:01:00.311477 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902838e1-3bc5-4eaf-9bf9-b06b6a04133a admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:00.370279 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902838e1-3bc5-4eaf-9bf9-b06b6a04133a admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:00.374996 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfff2f5-8c1d-4621-a513-7f9ad991b711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:00.375654 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfff2f5-8c1d-4621-a513-7f9ad991b711 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:00.375937 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfff2f5-8c1d-4621-a513-7f9ad991b711 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:00.376211 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfff2f5-8c1d-4621-a513-7f9ad991b711 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:00.376903 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfff2f5-8c1d-4621-a513-7f9ad991b711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:00.378841 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfff2f5-8c1d-4621-a513-7f9ad991b711 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:00.440767 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-87499f9c-3db0-42c0-a50c-64c43e81459d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7086a7d0a79f4bc8aa184ed1e8ad3348'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:00.447229 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-87499f9c-3db0-42c0-a50c-64c43e81459d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7086a7d0a79f4bc8aa184ed1e8ad3348'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:00.447882 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-87499f9c-3db0-42c0-a50c-64c43e81459d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7086a7d0a79f4bc8aa184ed1e8ad3348'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:00.471628 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1002/1997] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:01:00 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:01:00.475698 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfff2f5-8c1d-4621-a513-7f9ad991b711 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:00.485209 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfff2f5-8c1d-4621-a513-7f9ad991b711 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:00.489814 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6730d1-df8d-41ca-bcee-32aca4aa3af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:00.490442 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6730d1-df8d-41ca-bcee-32aca4aa3af9 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:00.490719 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6730d1-df8d-41ca-bcee-32aca4aa3af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:00.490996 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6730d1-df8d-41ca-bcee-32aca4aa3af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:00.491715 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6730d1-df8d-41ca-bcee-32aca4aa3af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:00.493434 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6730d1-df8d-41ca-bcee-32aca4aa3af9 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:00.503624 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1003/1998] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:01:00.507349 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6730d1-df8d-41ca-bcee-32aca4aa3af9 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:00.517335 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6730d1-df8d-41ca-bcee-32aca4aa3af9 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:00.521927 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89360b-334a-4989-b006-8e7440f0b16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:00.522551 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89360b-334a-4989-b006-8e7440f0b16d admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:00.522831 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89360b-334a-4989-b006-8e7440f0b16d admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:00.523102 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89360b-334a-4989-b006-8e7440f0b16d admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:00.523813 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89360b-334a-4989-b006-8e7440f0b16d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:00.525396 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89360b-334a-4989-b006-8e7440f0b16d admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:00.535139 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1004/1999] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:01:00.542468 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89360b-334a-4989-b006-8e7440f0b16d admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:00.551748 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89360b-334a-4989-b006-8e7440f0b16d admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:00.556370 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b1c21-19d7-4802-ad40-da44979506b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:00.557229 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b1c21-19d7-4802-ad40-da44979506b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:00.557559 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b1c21-19d7-4802-ad40-da44979506b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:00.557785 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b1c21-19d7-4802-ad40-da44979506b3 admin admin] PATH_INFO: `/v3/projects/2c3197b7d48d41c4ae8b136141120bff/users/d3d1dc23cfbe470ca8f60eed25cdf7f9/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:00.567530 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-87499f9c-3db0-42c0-a50c-64c43e81459d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7086a7d0a79f4bc8aa184ed1e8ad3348'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:00.572619 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b1c21-19d7-4802-ad40-da44979506b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c3197b7d48d41c4ae8b136141120bff, user_id=d3d1dc23cfbe470ca8f60eed25cdf7f9, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:00.575294 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b1c21-19d7-4802-ad40-da44979506b3 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:00.580385 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-87499f9c-3db0-42c0-a50c-64c43e81459d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7086a7d0a79f4bc8aa184ed1e8ad3348'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:00.586838 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 996/2000] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:01:00 2022] DELETE /identity/v3/users/7086a7d0a79f4bc8aa184ed1e8ad3348 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:01:00.591243 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5158623-dc0d-4caa-827a-fd344dca2902 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:00.591532 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5158623-dc0d-4caa-827a-fd344dca2902 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:00.591812 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5158623-dc0d-4caa-827a-fd344dca2902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:00.609449 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-a5158623-dc0d-4caa-827a-fd344dca2902 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:00.610676 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-a5158623-dc0d-4caa-827a-fd344dca2902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:00.670789 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 997/2001] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:01:00.687418 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5158623-dc0d-4caa-827a-fd344dca2902 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:00.689183 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-a5158623-dc0d-4caa-827a-fd344dca2902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:00.707506 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1005/2002] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:01:00 2022] PUT /identity/v3/projects/2c3197b7d48d41c4ae8b136141120bff/users/d3d1dc23cfbe470ca8f60eed25cdf7f9/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:01:00.717852 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf45b9-6c20-4c71-9165-4df6c815acb6 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:00.718473 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf45b9-6c20-4c71-9165-4df6c815acb6 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:00.719024 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf45b9-6c20-4c71-9165-4df6c815acb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:00.749894 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-36cf45b9-6c20-4c71-9165-4df6c815acb6 None None] MFA Rules not processed for user `d3d1dc23cfbe470ca8f60eed25cdf7f9`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:00.751249 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-36cf45b9-6c20-4c71-9165-4df6c815acb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:00.751391 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5158623-dc0d-4caa-827a-fd344dca2902 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:00.802928 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7920e-25bf-4bcd-bc07-86cb04d27246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:00.805792 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7920e-25bf-4bcd-bc07-86cb04d27246 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:00.806195 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7920e-25bf-4bcd-bc07-86cb04d27246 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:00.806549 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7920e-25bf-4bcd-bc07-86cb04d27246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:00.833494 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1006/2003] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:00.834985 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf45b9-6c20-4c71-9165-4df6c815acb6 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:00.837225 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-36cf45b9-6c20-4c71-9165-4df6c815acb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:00.888402 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7920e-25bf-4bcd-bc07-86cb04d27246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:00.890143 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7920e-25bf-4bcd-bc07-86cb04d27246 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:00.900643 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 998/2004] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:01:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:01:00.950101 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf45b9-6c20-4c71-9165-4df6c815acb6 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:00.957833 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0d2ca-03aa-417a-8c22-9293d960538e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:00.963722 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0d2ca-03aa-417a-8c22-9293d960538e admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:00.964062 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0d2ca-03aa-417a-8c22-9293d960538e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:00.964347 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0d2ca-03aa-417a-8c22-9293d960538e admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:00.967072 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0d2ca-03aa-417a-8c22-9293d960538e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:00.969189 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0d2ca-03aa-417a-8c22-9293d960538e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:01.113302 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1007/2005] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:01:00 2022] POST /identity/v3/projects => generated 379 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:01:01.117343 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7920e-25bf-4bcd-bc07-86cb04d27246 service neutron] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:01.127525 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7920e-25bf-4bcd-bc07-86cb04d27246 service neutron] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:01.190438 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0f3d3-2aff-44e9-86da-03bd3589ecee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:01.191170 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0f3d3-2aff-44e9-86da-03bd3589ecee admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:01.191585 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0f3d3-2aff-44e9-86da-03bd3589ecee admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:01.191759 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0f3d3-2aff-44e9-86da-03bd3589ecee admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:01.192555 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0f3d3-2aff-44e9-86da-03bd3589ecee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:01.194370 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0f3d3-2aff-44e9-86da-03bd3589ecee admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:01.311121 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 999/2006] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:01:01 2022] POST /identity/v3/users => generated 296 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:01:01.312448 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0d2ca-03aa-417a-8c22-9293d960538e admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:01.322915 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0d2ca-03aa-417a-8c22-9293d960538e admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:01.327662 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a1952-e448-4203-a505-7e318a20181f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:01.328382 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a1952-e448-4203-a505-7e318a20181f admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:01.328626 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a1952-e448-4203-a505-7e318a20181f admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:01.328905 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a1952-e448-4203-a505-7e318a20181f admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:01.329764 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a1952-e448-4203-a505-7e318a20181f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:01.331373 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a1952-e448-4203-a505-7e318a20181f admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:01.342161 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1008/2007] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:01:01.346804 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0f3d3-2aff-44e9-86da-03bd3589ecee admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:01.357713 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0f3d3-2aff-44e9-86da-03bd3589ecee admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:01.363090 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb77012-b787-4b90-88ea-5f1324fd1a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:01.364128 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb77012-b787-4b90-88ea-5f1324fd1a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:01.364416 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb77012-b787-4b90-88ea-5f1324fd1a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:01.364696 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb77012-b787-4b90-88ea-5f1324fd1a1c admin admin] PATH_INFO: `/v3/projects/016f36654d1643969d70d98d42da0f29/users/a454796801d347d0b535c08a247fb77e/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:01.379638 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb77012-b787-4b90-88ea-5f1324fd1a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=016f36654d1643969d70d98d42da0f29, user_id=a454796801d347d0b535c08a247fb77e, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:01.382482 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb77012-b787-4b90-88ea-5f1324fd1a1c admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:01.412612 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a1952-e448-4203-a505-7e318a20181f admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:01.414395 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-a08a1952-e448-4203-a505-7e318a20181f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:01.429114 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a1952-e448-4203-a505-7e318a20181f admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:01.433847 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71938d20-cc9a-49c1-8db9-e5a40b14e892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:01.434720 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71938d20-cc9a-49c1-8db9-e5a40b14e892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:01.435007 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71938d20-cc9a-49c1-8db9-e5a40b14e892 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:01.435287 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71938d20-cc9a-49c1-8db9-e5a40b14e892 admin admin] PATH_INFO: `/v3/projects/b9b647a359ef4133b4a04e6309bfcf66` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:01.436612 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71938d20-cc9a-49c1-8db9-e5a40b14e892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9b647a359ef4133b4a04e6309bfcf66)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:01.438551 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71938d20-cc9a-49c1-8db9-e5a40b14e892 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:01.510881 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1000/2008] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:01:01 2022] PUT /identity/v3/projects/016f36654d1643969d70d98d42da0f29/users/a454796801d347d0b535c08a247fb77e/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:01:01.515235 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb77012-b787-4b90-88ea-5f1324fd1a1c admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:01.566592 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-71938d20-cc9a-49c1-8db9-e5a40b14e892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9b647a359ef4133b4a04e6309bfcf66', 'request_id': 'req-71938d20-cc9a-49c1-8db9-e5a40b14e892'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:01.576127 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb77012-b787-4b90-88ea-5f1324fd1a1c admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:01.577738 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-71938d20-cc9a-49c1-8db9-e5a40b14e892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9b647a359ef4133b4a04e6309bfcf66', 'request_id': 'req-71938d20-cc9a-49c1-8db9-e5a40b14e892'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:01.633507 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e4118-9978-4ad6-82dc-9631fff17dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:01.634181 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e4118-9978-4ad6-82dc-9631fff17dbc admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:01.634471 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e4118-9978-4ad6-82dc-9631fff17dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:01.634749 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e4118-9978-4ad6-82dc-9631fff17dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:01.635489 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e4118-9978-4ad6-82dc-9631fff17dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:01.637109 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e4118-9978-4ad6-82dc-9631fff17dbc admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:01.645114 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-71938d20-cc9a-49c1-8db9-e5a40b14e892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9b647a359ef4133b4a04e6309bfcf66', 'request_id': 'req-71938d20-cc9a-49c1-8db9-e5a40b14e892'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:01.647384 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1001/2009] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:01:01.651742 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e4118-9978-4ad6-82dc-9631fff17dbc admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:01.660186 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-71938d20-cc9a-49c1-8db9-e5a40b14e892 admin admin] The token cache is being invalidate because project b9b647a359ef4133b4a04e6309bfcf66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:01:01.660477 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-71938d20-cc9a-49c1-8db9-e5a40b14e892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:01.661179 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-71938d20-cc9a-49c1-8db9-e5a40b14e892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:01.661495 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e4118-9978-4ad6-82dc-9631fff17dbc admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:01.662900 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1009/2010] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:01:01 2022] DELETE /identity/v3/projects/b9b647a359ef4133b4a04e6309bfcf66 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:01:01.666619 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71938d20-cc9a-49c1-8db9-e5a40b14e892 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:01.667725 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa0b21-1f1f-46b8-9748-2ff87910847f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:01.668196 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-71938d20-cc9a-49c1-8db9-e5a40b14e892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:01.668317 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa0b21-1f1f-46b8-9748-2ff87910847f admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:01.668478 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa0b21-1f1f-46b8-9748-2ff87910847f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:01.668754 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa0b21-1f1f-46b8-9748-2ff87910847f admin admin] PATH_INFO: `/v3/projects/016f36654d1643969d70d98d42da0f29/users/a454796801d347d0b535c08a247fb77e/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:01.671275 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa0b21-1f1f-46b8-9748-2ff87910847f admin admin] RBAC: Authorizing `identity:create_grant(project_id=016f36654d1643969d70d98d42da0f29, user_id=a454796801d347d0b535c08a247fb77e, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:01.674029 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa0b21-1f1f-46b8-9748-2ff87910847f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:01.683822 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71938d20-cc9a-49c1-8db9-e5a40b14e892 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:01.684292 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1002/2011] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:01:01 2022] PUT /identity/v3/projects/016f36654d1643969d70d98d42da0f29/users/a454796801d347d0b535c08a247fb77e/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:01:01.695566 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e0fc7-b9d9-46c3-95d3-48f0dd0b86e4 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:01.695818 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e0fc7-b9d9-46c3-95d3-48f0dd0b86e4 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:01.696103 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e0fc7-b9d9-46c3-95d3-48f0dd0b86e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:01.724631 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-e37e0fc7-b9d9-46c3-95d3-48f0dd0b86e4 None None] MFA Rules not processed for user `a454796801d347d0b535c08a247fb77e`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:01.726112 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-e37e0fc7-b9d9-46c3-95d3-48f0dd0b86e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:01.741915 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46136ba3-3a91-41ab-9323-7df18f9ac98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:01.742789 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46136ba3-3a91-41ab-9323-7df18f9ac98e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:01.743140 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46136ba3-3a91-41ab-9323-7df18f9ac98e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:01.743427 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46136ba3-3a91-41ab-9323-7df18f9ac98e admin admin] PATH_INFO: `/v3/users/f5b6e874f2644fd8af4e947e010667df` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:01.744634 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46136ba3-3a91-41ab-9323-7df18f9ac98e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5b6e874f2644fd8af4e947e010667df)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:01.746588 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46136ba3-3a91-41ab-9323-7df18f9ac98e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:01.796570 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1003/2012] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:01:01.808259 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e0fc7-b9d9-46c3-95d3-48f0dd0b86e4 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:01.808259 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-e37e0fc7-b9d9-46c3-95d3-48f0dd0b86e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:01.863976 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e0fc7-b9d9-46c3-95d3-48f0dd0b86e4 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:01.867668 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14fa13-c13d-4bbb-9539-30aa2ee6b9e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:01.868458 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14fa13-c13d-4bbb-9539-30aa2ee6b9e8 service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:01.868741 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14fa13-c13d-4bbb-9539-30aa2ee6b9e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:01.869049 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14fa13-c13d-4bbb-9539-30aa2ee6b9e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:01.878618 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14fa13-c13d-4bbb-9539-30aa2ee6b9e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:01.880150 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14fa13-c13d-4bbb-9539-30aa2ee6b9e8 service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:01.889431 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1004/2013] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:01:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 15:01:01.998538 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-46136ba3-3a91-41ab-9323-7df18f9ac98e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5b6e874f2644fd8af4e947e010667df'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:02.006487 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-46136ba3-3a91-41ab-9323-7df18f9ac98e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5b6e874f2644fd8af4e947e010667df'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:02.007266 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-46136ba3-3a91-41ab-9323-7df18f9ac98e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5b6e874f2644fd8af4e947e010667df'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:02.007952 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-46136ba3-3a91-41ab-9323-7df18f9ac98e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5b6e874f2644fd8af4e947e010667df'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:02.125022 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-46136ba3-3a91-41ab-9323-7df18f9ac98e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5b6e874f2644fd8af4e947e010667df'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:02.144010 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1010/2014] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:01:01 2022] DELETE /identity/v3/users/f5b6e874f2644fd8af4e947e010667df => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:01:02.167761 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14fa13-c13d-4bbb-9539-30aa2ee6b9e8 service cinder] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:02.169375 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-da14fa13-c13d-4bbb-9539-30aa2ee6b9e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:02.181896 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14fa13-c13d-4bbb-9539-30aa2ee6b9e8 service cinder] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:02.241288 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301d8c3-f4e4-4f5f-b9e4-5066f28f8129 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:02.242244 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301d8c3-f4e4-4f5f-b9e4-5066f28f8129 service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:02.242678 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301d8c3-f4e4-4f5f-b9e4-5066f28f8129 service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:02.242960 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301d8c3-f4e4-4f5f-b9e4-5066f28f8129 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:02.244811 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-6301d8c3-f4e4-4f5f-b9e4-5066f28f8129 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:02.304717 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6301d8c3-f4e4-4f5f-b9e4-5066f28f8129 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:02.306199 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6301d8c3-f4e4-4f5f-b9e4-5066f28f8129 service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:02.315067 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1005/2015] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:01:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:01:02.618436 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46136ba3-3a91-41ab-9323-7df18f9ac98e admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:02.620317 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-46136ba3-3a91-41ab-9323-7df18f9ac98e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:02.689770 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46136ba3-3a91-41ab-9323-7df18f9ac98e admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:02.694513 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1324931-72f2-4751-b7f4-3a5906811541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:02.695412 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1324931-72f2-4751-b7f4-3a5906811541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:02.695698 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1324931-72f2-4751-b7f4-3a5906811541 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:02.695981 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1324931-72f2-4751-b7f4-3a5906811541 admin admin] PATH_INFO: `/v3/projects/eac26a94175d43c6af67bb9748275a55` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:02.697331 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1324931-72f2-4751-b7f4-3a5906811541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eac26a94175d43c6af67bb9748275a55)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:02.699251 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1324931-72f2-4751-b7f4-3a5906811541 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:02.836248 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b1324931-72f2-4751-b7f4-3a5906811541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eac26a94175d43c6af67bb9748275a55', 'request_id': 'req-b1324931-72f2-4751-b7f4-3a5906811541'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:02.843796 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b1324931-72f2-4751-b7f4-3a5906811541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eac26a94175d43c6af67bb9748275a55', 'request_id': 'req-b1324931-72f2-4751-b7f4-3a5906811541'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:02.932744 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301d8c3-f4e4-4f5f-b9e4-5066f28f8129 service cinder] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:02.934180 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-6301d8c3-f4e4-4f5f-b9e4-5066f28f8129 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:02.947403 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301d8c3-f4e4-4f5f-b9e4-5066f28f8129 service cinder] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:02.959515 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b1324931-72f2-4751-b7f4-3a5906811541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eac26a94175d43c6af67bb9748275a55', 'request_id': 'req-b1324931-72f2-4751-b7f4-3a5906811541'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:02.970967 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b1324931-72f2-4751-b7f4-3a5906811541 admin admin] The token cache is being invalidate because project eac26a94175d43c6af67bb9748275a55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:01:02.971255 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b1324931-72f2-4751-b7f4-3a5906811541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:02.971905 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b1324931-72f2-4751-b7f4-3a5906811541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:02.973525 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1011/2016] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:01:02 2022] DELETE /identity/v3/projects/eac26a94175d43c6af67bb9748275a55 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:02.979338 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c007337-76fe-4d21-a114-7de03fc616a4 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:02.979627 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c007337-76fe-4d21-a114-7de03fc616a4 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:02.980221 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c007337-76fe-4d21-a114-7de03fc616a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:03.004419 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43679e-b904-4c9a-889a-f9671fbe0f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:03.005356 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43679e-b904-4c9a-889a-f9671fbe0f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:03.005638 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43679e-b904-4c9a-889a-f9671fbe0f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:03.005931 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43679e-b904-4c9a-889a-f9671fbe0f73 admin admin] PATH_INFO: `/v3/users/697af3f379bc4af3971aee40b858b81c` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:03.007214 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-1c007337-76fe-4d21-a114-7de03fc616a4 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:03.007778 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43679e-b904-4c9a-889a-f9671fbe0f73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=697af3f379bc4af3971aee40b858b81c)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:03.008490 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-1c007337-76fe-4d21-a114-7de03fc616a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:03.009881 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43679e-b904-4c9a-889a-f9671fbe0f73 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:03.017417 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1012/2017] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:03.026259 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a428203-17b3-41ac-928d-f70f078388dd None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:03.026591 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a428203-17b3-41ac-928d-f70f078388dd None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:03.026873 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a428203-17b3-41ac-928d-f70f078388dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:03.047036 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-8a428203-17b3-41ac-928d-f70f078388dd None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:03.048287 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-8a428203-17b3-41ac-928d-f70f078388dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:03.056338 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1013/2018] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:03.060463 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a428203-17b3-41ac-928d-f70f078388dd None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:03.069167 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a428203-17b3-41ac-928d-f70f078388dd None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:03.073829 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4b214-eabe-4efb-b88e-d8240fd4b11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:03.074491 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4b214-eabe-4efb-b88e-d8240fd4b11a admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:03.074799 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4b214-eabe-4efb-b88e-d8240fd4b11a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:03.075106 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4b214-eabe-4efb-b88e-d8240fd4b11a admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:03.075825 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4b214-eabe-4efb-b88e-d8240fd4b11a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:01:03.076127 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4b214-eabe-4efb-b88e-d8240fd4b11a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:03.077791 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4b214-eabe-4efb-b88e-d8240fd4b11a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:03.088933 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1014/2019] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 15:01:03.093456 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4b214-eabe-4efb-b88e-d8240fd4b11a admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:03.102625 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4b214-eabe-4efb-b88e-d8240fd4b11a admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:03.107599 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444667e-62f1-4488-9e55-9dac08a06ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:03.108835 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444667e-62f1-4488-9e55-9dac08a06ee4 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:03.109269 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444667e-62f1-4488-9e55-9dac08a06ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:03.109833 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444667e-62f1-4488-9e55-9dac08a06ee4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:03.110511 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444667e-62f1-4488-9e55-9dac08a06ee4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:03.112348 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444667e-62f1-4488-9e55-9dac08a06ee4 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:03.242550 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-5f43679e-b904-4c9a-889a-f9671fbe0f73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '697af3f379bc4af3971aee40b858b81c'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:03.251755 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-5f43679e-b904-4c9a-889a-f9671fbe0f73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '697af3f379bc4af3971aee40b858b81c'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:03.252468 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-5f43679e-b904-4c9a-889a-f9671fbe0f73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '697af3f379bc4af3971aee40b858b81c'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:03.261488 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1015/2020] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:01:03 2022] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:01:03.267386 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444667e-62f1-4488-9e55-9dac08a06ee4 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:03.329581 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444667e-62f1-4488-9e55-9dac08a06ee4 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:03.334330 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34c704-f5de-4ae4-9518-7a200d147d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:03.334993 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34c704-f5de-4ae4-9518-7a200d147d48 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:03.335277 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34c704-f5de-4ae4-9518-7a200d147d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:03.335556 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34c704-f5de-4ae4-9518-7a200d147d48 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:03.336254 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34c704-f5de-4ae4-9518-7a200d147d48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:03.338205 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34c704-f5de-4ae4-9518-7a200d147d48 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:03.359079 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-5f43679e-b904-4c9a-889a-f9671fbe0f73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '697af3f379bc4af3971aee40b858b81c'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:03.371162 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-5f43679e-b904-4c9a-889a-f9671fbe0f73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '697af3f379bc4af3971aee40b858b81c'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:03.377165 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1006/2021] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:01:02 2022] DELETE /identity/v3/users/697af3f379bc4af3971aee40b858b81c => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:01:03.381303 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416be65-df7c-408c-bbdd-19bf018e617a None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:03.381618 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416be65-df7c-408c-bbdd-19bf018e617a None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:03.381905 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416be65-df7c-408c-bbdd-19bf018e617a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:03.399720 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-5416be65-df7c-408c-bbdd-19bf018e617a None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:03.400923 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-5416be65-df7c-408c-bbdd-19bf018e617a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:03.457368 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1007/2022] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:01:03.466782 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1016/2023] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:01:03 2022] POST /identity/v3/users => generated 294 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:01:03.466966 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416be65-df7c-408c-bbdd-19bf018e617a None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:03.468939 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-5416be65-df7c-408c-bbdd-19bf018e617a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:03.470062 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34c704-f5de-4ae4-9518-7a200d147d48 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:03.471708 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-4e34c704-f5de-4ae4-9518-7a200d147d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:03.483811 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34c704-f5de-4ae4-9518-7a200d147d48 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:03.488861 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826bbb51-8ef7-419c-93c1-da8979c76576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:03.489557 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bbb51-8ef7-419c-93c1-da8979c76576 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:03.489843 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bbb51-8ef7-419c-93c1-da8979c76576 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:03.490121 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bbb51-8ef7-419c-93c1-da8979c76576 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:03.491139 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826bbb51-8ef7-419c-93c1-da8979c76576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:03.492859 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826bbb51-8ef7-419c-93c1-da8979c76576 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:03.507170 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1017/2024] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:01:03.509698 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826bbb51-8ef7-419c-93c1-da8979c76576 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:03.520778 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826bbb51-8ef7-419c-93c1-da8979c76576 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:03.525598 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bdeee-353d-48a7-8641-d7eb1f8550fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:03.526259 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bdeee-353d-48a7-8641-d7eb1f8550fe admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:03.526549 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bdeee-353d-48a7-8641-d7eb1f8550fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:03.526829 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bdeee-353d-48a7-8641-d7eb1f8550fe admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:03.527568 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bdeee-353d-48a7-8641-d7eb1f8550fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:03.529195 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bdeee-353d-48a7-8641-d7eb1f8550fe admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:03.530862 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416be65-df7c-408c-bbdd-19bf018e617a None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:03.535441 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd00aad-342c-45d8-8efd-143aed4dbc83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:03.536085 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd00aad-342c-45d8-8efd-143aed4dbc83 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:03.536517 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd00aad-342c-45d8-8efd-143aed4dbc83 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:03.536806 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd00aad-342c-45d8-8efd-143aed4dbc83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:03.542546 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1018/2025] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:01:03.543548 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bdeee-353d-48a7-8641-d7eb1f8550fe admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:03.546363 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd00aad-342c-45d8-8efd-143aed4dbc83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:03.547811 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd00aad-342c-45d8-8efd-143aed4dbc83 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:03.553956 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bdeee-353d-48a7-8641-d7eb1f8550fe admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:03.559078 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326c840-4cdb-4f90-9574-d0281da8c366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:03.559813 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1008/2026] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:01:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:01:03.560190 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326c840-4cdb-4f90-9574-d0281da8c366 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:03.560523 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326c840-4cdb-4f90-9574-d0281da8c366 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:03.561867 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326c840-4cdb-4f90-9574-d0281da8c366 admin admin] PATH_INFO: `/v3/projects/6ebbbd286498435ea74b69f256780fb1/users/638ba0253cb3496b8684423460194c0e/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:03.578143 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326c840-4cdb-4f90-9574-d0281da8c366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ebbbd286498435ea74b69f256780fb1, user_id=638ba0253cb3496b8684423460194c0e, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:03.581105 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326c840-4cdb-4f90-9574-d0281da8c366 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:03.699490 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1019/2027] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:01:03 2022] PUT /identity/v3/projects/6ebbbd286498435ea74b69f256780fb1/users/638ba0253cb3496b8684423460194c0e/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:03.710246 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf614de-5893-4f5b-a1f5-bc382d530f85 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:03.710539 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf614de-5893-4f5b-a1f5-bc382d530f85 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:03.710818 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf614de-5893-4f5b-a1f5-bc382d530f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:03.737930 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-abf614de-5893-4f5b-a1f5-bc382d530f85 None None] MFA Rules not processed for user `638ba0253cb3496b8684423460194c0e`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:03.739364 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-abf614de-5893-4f5b-a1f5-bc382d530f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:03.812104 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1009/2028] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:01:03.816695 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326c840-4cdb-4f90-9574-d0281da8c366 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:03.900390 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326c840-4cdb-4f90-9574-d0281da8c366 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:03.920407 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd42cc-6eb9-4bfb-9871-47f4a9ccd5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:03.921619 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd42cc-6eb9-4bfb-9871-47f4a9ccd5fb admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:03.921913 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd42cc-6eb9-4bfb-9871-47f4a9ccd5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:03.922194 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd42cc-6eb9-4bfb-9871-47f4a9ccd5fb admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:03.923086 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd42cc-6eb9-4bfb-9871-47f4a9ccd5fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:03.925091 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd42cc-6eb9-4bfb-9871-47f4a9ccd5fb admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:04.146827 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf614de-5893-4f5b-a1f5-bc382d530f85 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:04.148387 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-abf614de-5893-4f5b-a1f5-bc382d530f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:04.164167 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf614de-5893-4f5b-a1f5-bc382d530f85 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:04.170103 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02bd86-c8ad-46e2-b69c-13b7157502a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:04.171648 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02bd86-c8ad-46e2-b69c-13b7157502a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:04.172390 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02bd86-c8ad-46e2-b69c-13b7157502a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:04.172769 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02bd86-c8ad-46e2-b69c-13b7157502a0 admin admin] PATH_INFO: `/v3/projects/2e549d08f1824c45a9dea7b2e6e88c6a` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:04.174115 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02bd86-c8ad-46e2-b69c-13b7157502a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e549d08f1824c45a9dea7b2e6e88c6a)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:04.176053 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02bd86-c8ad-46e2-b69c-13b7157502a0 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:04.215386 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1020/2029] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:01:03 2022] POST /identity/v3/projects => generated 385 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:01:04.219559 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd42cc-6eb9-4bfb-9871-47f4a9ccd5fb admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:04.279450 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd42cc-6eb9-4bfb-9871-47f4a9ccd5fb admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:04.285005 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cba44-197c-495f-9e9d-334e99ff6a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:04.285727 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cba44-197c-495f-9e9d-334e99ff6a24 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:04.286009 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cba44-197c-495f-9e9d-334e99ff6a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:04.286282 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cba44-197c-495f-9e9d-334e99ff6a24 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:04.286976 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cba44-197c-495f-9e9d-334e99ff6a24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:04.288965 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cba44-197c-495f-9e9d-334e99ff6a24 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:04.373767 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-9d02bd86-c8ad-46e2-b69c-13b7157502a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e549d08f1824c45a9dea7b2e6e88c6a', 'request_id': 'req-9d02bd86-c8ad-46e2-b69c-13b7157502a0'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:04.379829 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-9d02bd86-c8ad-46e2-b69c-13b7157502a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e549d08f1824c45a9dea7b2e6e88c6a', 'request_id': 'req-9d02bd86-c8ad-46e2-b69c-13b7157502a0'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:04.385233 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-9d02bd86-c8ad-46e2-b69c-13b7157502a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e549d08f1824c45a9dea7b2e6e88c6a', 'request_id': 'req-9d02bd86-c8ad-46e2-b69c-13b7157502a0'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:04.479411 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-9d02bd86-c8ad-46e2-b69c-13b7157502a0 admin admin] The token cache is being invalidate because project 2e549d08f1824c45a9dea7b2e6e88c6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:01:04.479953 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-9d02bd86-c8ad-46e2-b69c-13b7157502a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:04.480795 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-9d02bd86-c8ad-46e2-b69c-13b7157502a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:04.484415 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1021/2030] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:01:04 2022] POST /identity/v3/users => generated 299 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:01:04.484544 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1010/2031] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:01:04 2022] DELETE /identity/v3/projects/2e549d08f1824c45a9dea7b2e6e88c6a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:01:04.487198 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02bd86-c8ad-46e2-b69c-13b7157502a0 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:04.487618 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cba44-197c-495f-9e9d-334e99ff6a24 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:04.489929 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-9d02bd86-c8ad-46e2-b69c-13b7157502a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:04.490055 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-b35cba44-197c-495f-9e9d-334e99ff6a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:04.502764 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cba44-197c-495f-9e9d-334e99ff6a24 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:04.561432 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02bd86-c8ad-46e2-b69c-13b7157502a0 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:04.563459 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bff9d3-659d-4f24-af8a-c8a20c7ab458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:04.564617 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bff9d3-659d-4f24-af8a-c8a20c7ab458 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:04.564988 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bff9d3-659d-4f24-af8a-c8a20c7ab458 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:04.565357 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bff9d3-659d-4f24-af8a-c8a20c7ab458 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:04.566967 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6cf2e-6534-4ba9-a2aa-ee47cdc6fd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:04.568050 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6cf2e-6534-4ba9-a2aa-ee47cdc6fd26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:04.568492 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6cf2e-6534-4ba9-a2aa-ee47cdc6fd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:04.568771 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6cf2e-6534-4ba9-a2aa-ee47cdc6fd26 admin admin] PATH_INFO: `/v3/users/3309d8d8019d45909cd1c68b892bc99c` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:04.569236 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bff9d3-659d-4f24-af8a-c8a20c7ab458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:04.570238 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b6cf2e-6534-4ba9-a2aa-ee47cdc6fd26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3309d8d8019d45909cd1c68b892bc99c)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:04.570916 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bff9d3-659d-4f24-af8a-c8a20c7ab458 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:04.572141 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b6cf2e-6534-4ba9-a2aa-ee47cdc6fd26 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:04.586123 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1022/2032] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:01:04.586997 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bff9d3-659d-4f24-af8a-c8a20c7ab458 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:04.597144 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bff9d3-659d-4f24-af8a-c8a20c7ab458 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:04.601959 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2414c-7290-4544-b83c-c2e8354862a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:04.602835 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2414c-7290-4544-b83c-c2e8354862a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:04.603113 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2414c-7290-4544-b83c-c2e8354862a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:04.603386 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2414c-7290-4544-b83c-c2e8354862a8 admin admin] PATH_INFO: `/v3/projects/dc99d4e713d3488f880b028753d48483/users/c71e1dccc0af4571a4ab31cc7d12dccf/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:04.618231 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b2414c-7290-4544-b83c-c2e8354862a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc99d4e713d3488f880b028753d48483, user_id=c71e1dccc0af4571a4ab31cc7d12dccf, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:04.620967 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b2414c-7290-4544-b83c-c2e8354862a8 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:04.751079 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1023/2033] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:01:04 2022] PUT /identity/v3/projects/dc99d4e713d3488f880b028753d48483/users/c71e1dccc0af4571a4ab31cc7d12dccf/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:04.756932 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2414c-7290-4544-b83c-c2e8354862a8 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:04.795288 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-93b6cf2e-6534-4ba9-a2aa-ee47cdc6fd26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3309d8d8019d45909cd1c68b892bc99c'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:04.803903 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-93b6cf2e-6534-4ba9-a2aa-ee47cdc6fd26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3309d8d8019d45909cd1c68b892bc99c'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:04.805121 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-93b6cf2e-6534-4ba9-a2aa-ee47cdc6fd26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3309d8d8019d45909cd1c68b892bc99c'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:04.828651 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2414c-7290-4544-b83c-c2e8354862a8 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:04.835930 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b69fa1-2132-4597-9b38-7b5a8b8cbac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:04.836617 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b69fa1-2132-4597-9b38-7b5a8b8cbac2 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:04.836897 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b69fa1-2132-4597-9b38-7b5a8b8cbac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:04.837210 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b69fa1-2132-4597-9b38-7b5a8b8cbac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:04.837978 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b69fa1-2132-4597-9b38-7b5a8b8cbac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:04.839631 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b69fa1-2132-4597-9b38-7b5a8b8cbac2 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:04.856913 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1024/2034] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:01:04.861558 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b69fa1-2132-4597-9b38-7b5a8b8cbac2 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:04.871719 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b69fa1-2132-4597-9b38-7b5a8b8cbac2 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:04.877800 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c95dfe-3527-4f59-8298-24d7e17573d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:04.880020 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c95dfe-3527-4f59-8298-24d7e17573d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:04.880484 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c95dfe-3527-4f59-8298-24d7e17573d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:04.880875 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c95dfe-3527-4f59-8298-24d7e17573d5 admin admin] PATH_INFO: `/v3/projects/dc99d4e713d3488f880b028753d48483/users/c71e1dccc0af4571a4ab31cc7d12dccf/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:04.882964 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-93b6cf2e-6534-4ba9-a2aa-ee47cdc6fd26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3309d8d8019d45909cd1c68b892bc99c'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:04.884335 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c95dfe-3527-4f59-8298-24d7e17573d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc99d4e713d3488f880b028753d48483, user_id=c71e1dccc0af4571a4ab31cc7d12dccf, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:04.887759 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c95dfe-3527-4f59-8298-24d7e17573d5 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:04.899339 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-93b6cf2e-6534-4ba9-a2aa-ee47cdc6fd26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3309d8d8019d45909cd1c68b892bc99c'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:04.901839 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1025/2035] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:01:04 2022] PUT /identity/v3/projects/dc99d4e713d3488f880b028753d48483/users/c71e1dccc0af4571a4ab31cc7d12dccf/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:04.905847 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1011/2036] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:01:04 2022] DELETE /identity/v3/users/3309d8d8019d45909cd1c68b892bc99c => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:01:04.926756 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f58d8-41eb-4d4d-aba2-50b71da7710b None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:04.927871 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f58d8-41eb-4d4d-aba2-50b71da7710b None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:04.932405 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f58d8-41eb-4d4d-aba2-50b71da7710b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:04.972950 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-f01f58d8-41eb-4d4d-aba2-50b71da7710b None None] MFA Rules not processed for user `c71e1dccc0af4571a4ab31cc7d12dccf`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:04.972950 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-f01f58d8-41eb-4d4d-aba2-50b71da7710b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:05.041166 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1026/2037] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:05.052568 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6cf2e-6534-4ba9-a2aa-ee47cdc6fd26 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:05.054219 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-93b6cf2e-6534-4ba9-a2aa-ee47cdc6fd26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:05.112111 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6cf2e-6534-4ba9-a2aa-ee47cdc6fd26 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:05.115692 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab115b7-d2b9-4efa-adf8-21affe8c8491 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:05.116332 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab115b7-d2b9-4efa-adf8-21affe8c8491 service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:05.116612 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab115b7-d2b9-4efa-adf8-21affe8c8491 service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:05.116886 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab115b7-d2b9-4efa-adf8-21affe8c8491 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:05.125800 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab115b7-d2b9-4efa-adf8-21affe8c8491 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:05.127228 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab115b7-d2b9-4efa-adf8-21affe8c8491 service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:05.136529 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1012/2038] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:01:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:01:05.163225 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f58d8-41eb-4d4d-aba2-50b71da7710b None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:05.164621 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-f01f58d8-41eb-4d4d-aba2-50b71da7710b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:05.230851 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f58d8-41eb-4d4d-aba2-50b71da7710b None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:05.236550 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0cbecc-3a5e-4c39-8ba1-2837ad7b481e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:05.237528 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0cbecc-3a5e-4c39-8ba1-2837ad7b481e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:05.237813 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0cbecc-3a5e-4c39-8ba1-2837ad7b481e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:05.238093 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0cbecc-3a5e-4c39-8ba1-2837ad7b481e admin admin] PATH_INFO: `/v3/users/638ba0253cb3496b8684423460194c0e` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:05.239460 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0cbecc-3a5e-4c39-8ba1-2837ad7b481e admin admin] RBAC: Authorizing `identity:delete_user(user_id=638ba0253cb3496b8684423460194c0e)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:05.241596 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0cbecc-3a5e-4c39-8ba1-2837ad7b481e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:05.426888 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab115b7-d2b9-4efa-adf8-21affe8c8491 service cinder] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:05.428626 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-5ab115b7-d2b9-4efa-adf8-21affe8c8491 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:05.444404 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab115b7-d2b9-4efa-adf8-21affe8c8491 service cinder] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:05.449413 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5dee7a-7b41-4c34-a1ad-4265f7181adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:05.450280 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dee7a-7b41-4c34-a1ad-4265f7181adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:05.450563 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dee7a-7b41-4c34-a1ad-4265f7181adb admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:05.450898 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dee7a-7b41-4c34-a1ad-4265f7181adb admin admin] PATH_INFO: `/v3/projects/b45d2f7e2a94435d959a10458af476a6` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:05.452995 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5dee7a-7b41-4c34-a1ad-4265f7181adb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b45d2f7e2a94435d959a10458af476a6)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:05.455296 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5dee7a-7b41-4c34-a1ad-4265f7181adb admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:05.456401 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-5f0cbecc-3a5e-4c39-8ba1-2837ad7b481e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '638ba0253cb3496b8684423460194c0e'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:05.463098 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-5f0cbecc-3a5e-4c39-8ba1-2837ad7b481e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '638ba0253cb3496b8684423460194c0e'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:05.463770 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-5f0cbecc-3a5e-4c39-8ba1-2837ad7b481e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '638ba0253cb3496b8684423460194c0e'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:05.464374 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-5f0cbecc-3a5e-4c39-8ba1-2837ad7b481e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '638ba0253cb3496b8684423460194c0e'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:05.570903 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-5f0cbecc-3a5e-4c39-8ba1-2837ad7b481e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '638ba0253cb3496b8684423460194c0e'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:05.588883 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-5a5dee7a-7b41-4c34-a1ad-4265f7181adb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b45d2f7e2a94435d959a10458af476a6', 'request_id': 'req-5a5dee7a-7b41-4c34-a1ad-4265f7181adb'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:05.591061 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1027/2039] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:01:05 2022] DELETE /identity/v3/users/638ba0253cb3496b8684423460194c0e => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:05.596367 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fef781-319e-4d11-bffb-83ac5f51c99d None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:05.596666 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fef781-319e-4d11-bffb-83ac5f51c99d None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:05.596955 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fef781-319e-4d11-bffb-83ac5f51c99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:05.599649 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-5a5dee7a-7b41-4c34-a1ad-4265f7181adb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b45d2f7e2a94435d959a10458af476a6', 'request_id': 'req-5a5dee7a-7b41-4c34-a1ad-4265f7181adb'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:05.605734 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-5a5dee7a-7b41-4c34-a1ad-4265f7181adb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b45d2f7e2a94435d959a10458af476a6', 'request_id': 'req-5a5dee7a-7b41-4c34-a1ad-4265f7181adb'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:05.614403 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-91fef781-319e-4d11-bffb-83ac5f51c99d None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:05.615622 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-91fef781-319e-4d11-bffb-83ac5f51c99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:05.676326 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1028/2040] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:01:05.685967 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fef781-319e-4d11-bffb-83ac5f51c99d None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:05.687498 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-91fef781-319e-4d11-bffb-83ac5f51c99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:05.698256 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-5a5dee7a-7b41-4c34-a1ad-4265f7181adb admin admin] The token cache is being invalidate because project b45d2f7e2a94435d959a10458af476a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:01:05.698684 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-5a5dee7a-7b41-4c34-a1ad-4265f7181adb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:05.699431 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-5a5dee7a-7b41-4c34-a1ad-4265f7181adb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:05.701103 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1013/2041] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:01:05 2022] DELETE /identity/v3/projects/b45d2f7e2a94435d959a10458af476a6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:01:05.705268 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5dee7a-7b41-4c34-a1ad-4265f7181adb admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:05.706599 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-5a5dee7a-7b41-4c34-a1ad-4265f7181adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:05.746805 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fef781-319e-4d11-bffb-83ac5f51c99d None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:05.752481 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4cfd9-68cd-436e-8dc2-e430ab7f4546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:05.753162 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4cfd9-68cd-436e-8dc2-e430ab7f4546 service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:05.753453 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4cfd9-68cd-436e-8dc2-e430ab7f4546 service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:05.753732 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4cfd9-68cd-436e-8dc2-e430ab7f4546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:05.755527 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-29a4cfd9-68cd-436e-8dc2-e430ab7f4546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:05.768475 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4cfd9-68cd-436e-8dc2-e430ab7f4546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:05.769986 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4cfd9-68cd-436e-8dc2-e430ab7f4546 service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:05.772655 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5dee7a-7b41-4c34-a1ad-4265f7181adb admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:05.777903 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d6ec3-b3ee-4669-aa05-bac6a6c4318e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:05.778781 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d6ec3-b3ee-4669-aa05-bac6a6c4318e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:05.779071 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d6ec3-b3ee-4669-aa05-bac6a6c4318e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:05.779346 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d6ec3-b3ee-4669-aa05-bac6a6c4318e admin admin] PATH_INFO: `/v3/users/8850538474bb4fbeba75e0ad61700afc` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:05.779947 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1029/2042] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:01:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 15:01:05.780926 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d6ec3-b3ee-4669-aa05-bac6a6c4318e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8850538474bb4fbeba75e0ad61700afc)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:05.783013 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d6ec3-b3ee-4669-aa05-bac6a6c4318e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:06.001546 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-8a8d6ec3-b3ee-4669-aa05-bac6a6c4318e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8850538474bb4fbeba75e0ad61700afc'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:06.008790 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-8a8d6ec3-b3ee-4669-aa05-bac6a6c4318e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8850538474bb4fbeba75e0ad61700afc'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:06.009528 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-8a8d6ec3-b3ee-4669-aa05-bac6a6c4318e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8850538474bb4fbeba75e0ad61700afc'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:06.118150 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-8a8d6ec3-b3ee-4669-aa05-bac6a6c4318e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8850538474bb4fbeba75e0ad61700afc'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:06.126848 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-8a8d6ec3-b3ee-4669-aa05-bac6a6c4318e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8850538474bb4fbeba75e0ad61700afc'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:06.132697 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1014/2043] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:01:05 2022] DELETE /identity/v3/users/8850538474bb4fbeba75e0ad61700afc => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:01:06.232601 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4cfd9-68cd-436e-8dc2-e430ab7f4546 service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:06.234608 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-29a4cfd9-68cd-436e-8dc2-e430ab7f4546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:06.247873 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4cfd9-68cd-436e-8dc2-e430ab7f4546 service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:06.305921 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f65916-1842-4b6d-bc85-0fc39447dc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:06.306813 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f65916-1842-4b6d-bc85-0fc39447dc24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:06.307094 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f65916-1842-4b6d-bc85-0fc39447dc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:06.307373 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f65916-1842-4b6d-bc85-0fc39447dc24 admin admin] PATH_INFO: `/v3/projects/6ebbbd286498435ea74b69f256780fb1` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:06.308609 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f65916-1842-4b6d-bc85-0fc39447dc24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ebbbd286498435ea74b69f256780fb1)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:06.310565 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f65916-1842-4b6d-bc85-0fc39447dc24 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:06.437733 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-13f65916-1842-4b6d-bc85-0fc39447dc24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ebbbd286498435ea74b69f256780fb1', 'request_id': 'req-13f65916-1842-4b6d-bc85-0fc39447dc24'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:06.443862 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-13f65916-1842-4b6d-bc85-0fc39447dc24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ebbbd286498435ea74b69f256780fb1', 'request_id': 'req-13f65916-1842-4b6d-bc85-0fc39447dc24'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:06.550527 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-13f65916-1842-4b6d-bc85-0fc39447dc24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ebbbd286498435ea74b69f256780fb1', 'request_id': 'req-13f65916-1842-4b6d-bc85-0fc39447dc24'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:06.561150 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-13f65916-1842-4b6d-bc85-0fc39447dc24 admin admin] The token cache is being invalidate because project 6ebbbd286498435ea74b69f256780fb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:01:06.561450 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-13f65916-1842-4b6d-bc85-0fc39447dc24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:06.562088 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-13f65916-1842-4b6d-bc85-0fc39447dc24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:06.563632 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1030/2044] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:01:06 2022] DELETE /identity/v3/projects/6ebbbd286498435ea74b69f256780fb1 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:06.567560 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d6ec3-b3ee-4669-aa05-bac6a6c4318e admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:06.569005 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-8a8d6ec3-b3ee-4669-aa05-bac6a6c4318e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:06.581731 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d6ec3-b3ee-4669-aa05-bac6a6c4318e admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:06.615839 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f65916-1842-4b6d-bc85-0fc39447dc24 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:06.623787 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-13f65916-1842-4b6d-bc85-0fc39447dc24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:06.643884 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08719d9-3c89-46b4-96ac-70858bc3cf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:06.644961 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08719d9-3c89-46b4-96ac-70858bc3cf2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:06.645280 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08719d9-3c89-46b4-96ac-70858bc3cf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:06.645606 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08719d9-3c89-46b4-96ac-70858bc3cf2d admin admin] PATH_INFO: `/v3/users/c71e1dccc0af4571a4ab31cc7d12dccf` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:06.647017 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08719d9-3c89-46b4-96ac-70858bc3cf2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c71e1dccc0af4571a4ab31cc7d12dccf)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:06.649580 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08719d9-3c89-46b4-96ac-70858bc3cf2d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:06.690270 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f65916-1842-4b6d-bc85-0fc39447dc24 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:06.695110 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c93ed-8ba4-4929-a6fc-18c7105be099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:06.695992 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c93ed-8ba4-4929-a6fc-18c7105be099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:06.696273 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c93ed-8ba4-4929-a6fc-18c7105be099 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:06.696544 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c93ed-8ba4-4929-a6fc-18c7105be099 admin admin] PATH_INFO: `/v3/projects/89da0307929e47cdbf926456d3198b86` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:06.697790 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c93ed-8ba4-4929-a6fc-18c7105be099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89da0307929e47cdbf926456d3198b86)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:06.699706 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c93ed-8ba4-4929-a6fc-18c7105be099 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:06.893295 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-a08719d9-3c89-46b4-96ac-70858bc3cf2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c71e1dccc0af4571a4ab31cc7d12dccf'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:06.893505 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-996c93ed-8ba4-4929-a6fc-18c7105be099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89da0307929e47cdbf926456d3198b86', 'request_id': 'req-996c93ed-8ba4-4929-a6fc-18c7105be099'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:06.902669 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-996c93ed-8ba4-4929-a6fc-18c7105be099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89da0307929e47cdbf926456d3198b86', 'request_id': 'req-996c93ed-8ba4-4929-a6fc-18c7105be099'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:06.902833 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-a08719d9-3c89-46b4-96ac-70858bc3cf2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c71e1dccc0af4571a4ab31cc7d12dccf'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:06.902833 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-a08719d9-3c89-46b4-96ac-70858bc3cf2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c71e1dccc0af4571a4ab31cc7d12dccf'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:06.984647 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-996c93ed-8ba4-4929-a6fc-18c7105be099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89da0307929e47cdbf926456d3198b86', 'request_id': 'req-996c93ed-8ba4-4929-a6fc-18c7105be099'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:06.995666 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-996c93ed-8ba4-4929-a6fc-18c7105be099 admin admin] The token cache is being invalidate because project 89da0307929e47cdbf926456d3198b86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:01:06.995954 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-996c93ed-8ba4-4929-a6fc-18c7105be099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:06.996594 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-996c93ed-8ba4-4929-a6fc-18c7105be099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:06.998166 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1031/2045] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:01:06 2022] DELETE /identity/v3/projects/89da0307929e47cdbf926456d3198b86 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:07.003483 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d65be-0a7d-436d-9920-ae47e86be9e3 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:07.003755 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d65be-0a7d-436d-9920-ae47e86be9e3 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:07.004031 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d65be-0a7d-436d-9920-ae47e86be9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:07.021884 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-177d65be-0a7d-436d-9920-ae47e86be9e3 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:07.023066 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-177d65be-0a7d-436d-9920-ae47e86be9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:07.075833 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-a08719d9-3c89-46b4-96ac-70858bc3cf2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c71e1dccc0af4571a4ab31cc7d12dccf'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:07.089057 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-a08719d9-3c89-46b4-96ac-70858bc3cf2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c71e1dccc0af4571a4ab31cc7d12dccf'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:07.090457 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1032/2046] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:01:07.096103 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1015/2047] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:01:06 2022] DELETE /identity/v3/users/c71e1dccc0af4571a4ab31cc7d12dccf => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:07.099663 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80323f9-e3b6-410e-84c1-59541d245404 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:07.099785 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80323f9-e3b6-410e-84c1-59541d245404 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:07.100063 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80323f9-e3b6-410e-84c1-59541d245404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:07.118436 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-c80323f9-e3b6-410e-84c1-59541d245404 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:07.119664 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-c80323f9-e3b6-410e-84c1-59541d245404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:07.178288 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1033/2048] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:07.182375 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08719d9-3c89-46b4-96ac-70858bc3cf2d admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:07.192109 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08719d9-3c89-46b4-96ac-70858bc3cf2d admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:07.196988 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a261f-19ce-4be3-98ce-ba7628de423f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:07.197677 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a261f-19ce-4be3-98ce-ba7628de423f admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:07.197961 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a261f-19ce-4be3-98ce-ba7628de423f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:07.198255 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a261f-19ce-4be3-98ce-ba7628de423f admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:07.199042 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a261f-19ce-4be3-98ce-ba7628de423f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:01:07.199344 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a261f-19ce-4be3-98ce-ba7628de423f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:07.200977 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a261f-19ce-4be3-98ce-ba7628de423f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:07.212786 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1016/2049] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 15:01:07.217201 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80323f9-e3b6-410e-84c1-59541d245404 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:07.227001 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80323f9-e3b6-410e-84c1-59541d245404 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:07.231936 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939cd45-4d25-4d2d-8bf0-bed8cdb56c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:07.232575 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939cd45-4d25-4d2d-8bf0-bed8cdb56c09 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:07.232863 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939cd45-4d25-4d2d-8bf0-bed8cdb56c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:07.233404 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939cd45-4d25-4d2d-8bf0-bed8cdb56c09 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:07.233911 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939cd45-4d25-4d2d-8bf0-bed8cdb56c09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:07.235831 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939cd45-4d25-4d2d-8bf0-bed8cdb56c09 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:07.358276 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1034/2050] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:01:07 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:01:07.362335 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a261f-19ce-4be3-98ce-ba7628de423f admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:07.372264 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a261f-19ce-4be3-98ce-ba7628de423f admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:07.426327 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd033be-81e7-4fb4-9055-dd7b1734dd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:07.426991 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd033be-81e7-4fb4-9055-dd7b1734dd45 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:07.427271 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd033be-81e7-4fb4-9055-dd7b1734dd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:07.427542 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd033be-81e7-4fb4-9055-dd7b1734dd45 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:07.428242 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd033be-81e7-4fb4-9055-dd7b1734dd45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:07.430237 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd033be-81e7-4fb4-9055-dd7b1734dd45 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:07.634369 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939cd45-4d25-4d2d-8bf0-bed8cdb56c09 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:07.634369 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-6939cd45-4d25-4d2d-8bf0-bed8cdb56c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:07.645519 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939cd45-4d25-4d2d-8bf0-bed8cdb56c09 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:07.650263 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd2683-caac-48d1-bcfb-1f82145d2aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:07.651237 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd2683-caac-48d1-bcfb-1f82145d2aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:07.651522 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd2683-caac-48d1-bcfb-1f82145d2aae admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:07.651802 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd2683-caac-48d1-bcfb-1f82145d2aae admin admin] PATH_INFO: `/v3/projects/dc99d4e713d3488f880b028753d48483` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:07.653135 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd2683-caac-48d1-bcfb-1f82145d2aae admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc99d4e713d3488f880b028753d48483)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:07.655226 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd2683-caac-48d1-bcfb-1f82145d2aae admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:07.771606 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1017/2051] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:01:07 2022] POST /identity/v3/users => generated 287 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:01:07.775626 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd033be-81e7-4fb4-9055-dd7b1734dd45 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:07.784805 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd033be-81e7-4fb4-9055-dd7b1734dd45 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:07.789253 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91563c5e-c97c-4116-992c-125a17b406ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:07.794423 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91563c5e-c97c-4116-992c-125a17b406ea admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:07.794423 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91563c5e-c97c-4116-992c-125a17b406ea admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:07.794423 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91563c5e-c97c-4116-992c-125a17b406ea admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:07.794423 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91563c5e-c97c-4116-992c-125a17b406ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:07.794423 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91563c5e-c97c-4116-992c-125a17b406ea admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:07.803380 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1018/2052] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:01:07.807334 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91563c5e-c97c-4116-992c-125a17b406ea admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:07.809215 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-38fd2683-caac-48d1-bcfb-1f82145d2aae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc99d4e713d3488f880b028753d48483', 'request_id': 'req-38fd2683-caac-48d1-bcfb-1f82145d2aae'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:07.816584 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-38fd2683-caac-48d1-bcfb-1f82145d2aae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc99d4e713d3488f880b028753d48483', 'request_id': 'req-38fd2683-caac-48d1-bcfb-1f82145d2aae'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:07.817850 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91563c5e-c97c-4116-992c-125a17b406ea admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:07.872737 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ed34e-20cb-461d-9faa-263cedb1c27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:07.873581 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ed34e-20cb-461d-9faa-263cedb1c27a admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:07.874479 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ed34e-20cb-461d-9faa-263cedb1c27a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:07.874759 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ed34e-20cb-461d-9faa-263cedb1c27a admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:07.875486 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ed34e-20cb-461d-9faa-263cedb1c27a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:07.877087 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ed34e-20cb-461d-9faa-263cedb1c27a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:07.882149 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-38fd2683-caac-48d1-bcfb-1f82145d2aae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc99d4e713d3488f880b028753d48483', 'request_id': 'req-38fd2683-caac-48d1-bcfb-1f82145d2aae'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:07.886858 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1019/2053] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:01:07.893351 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ed34e-20cb-461d-9faa-263cedb1c27a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:07.893536 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-38fd2683-caac-48d1-bcfb-1f82145d2aae admin admin] The token cache is being invalidate because project dc99d4e713d3488f880b028753d48483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:01:07.893666 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-38fd2683-caac-48d1-bcfb-1f82145d2aae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:07.894307 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-38fd2683-caac-48d1-bcfb-1f82145d2aae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:07.895814 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1035/2054] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:01:07 2022] DELETE /identity/v3/projects/dc99d4e713d3488f880b028753d48483 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:01:07.901247 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33050e77-b081-4bf1-95cd-7eb9a71e2c2e None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:07.901535 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33050e77-b081-4bf1-95cd-7eb9a71e2c2e None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:07.901811 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33050e77-b081-4bf1-95cd-7eb9a71e2c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:07.903679 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ed34e-20cb-461d-9faa-263cedb1c27a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:07.908323 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b9587-bfe5-4e08-8209-825f766f28a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:07.910165 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b9587-bfe5-4e08-8209-825f766f28a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:07.910165 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b9587-bfe5-4e08-8209-825f766f28a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:07.910165 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b9587-bfe5-4e08-8209-825f766f28a5 admin admin] PATH_INFO: `/v3/projects/e785ec07120a4184acdbf74f73489ce8/users/0669d8dce2d64715948615519bf0eac9/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:07.921742 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-33050e77-b081-4bf1-95cd-7eb9a71e2c2e None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:07.923076 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-33050e77-b081-4bf1-95cd-7eb9a71e2c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:07.925845 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b9587-bfe5-4e08-8209-825f766f28a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e785ec07120a4184acdbf74f73489ce8, user_id=0669d8dce2d64715948615519bf0eac9, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:07.930659 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b9587-bfe5-4e08-8209-825f766f28a5 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:07.934160 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1036/2055] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:01:07.944175 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f039bc-b74a-47f4-8b06-a77935194c22 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:07.944378 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f039bc-b74a-47f4-8b06-a77935194c22 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:07.944740 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f039bc-b74a-47f4-8b06-a77935194c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:07.965333 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-31f039bc-b74a-47f4-8b06-a77935194c22 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:07.966565 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-31f039bc-b74a-47f4-8b06-a77935194c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:07.974719 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1037/2056] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:07.979279 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f039bc-b74a-47f4-8b06-a77935194c22 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:07.989071 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f039bc-b74a-47f4-8b06-a77935194c22 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:07.993816 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d389f-07d2-4cf1-abcd-ddd3eeca1a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:07.994440 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d389f-07d2-4cf1-abcd-ddd3eeca1a99 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:07.994723 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d389f-07d2-4cf1-abcd-ddd3eeca1a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:07.994999 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d389f-07d2-4cf1-abcd-ddd3eeca1a99 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:07.995746 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d389f-07d2-4cf1-abcd-ddd3eeca1a99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:01:07.996072 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d389f-07d2-4cf1-abcd-ddd3eeca1a99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:07.997742 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d389f-07d2-4cf1-abcd-ddd3eeca1a99 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:08.009507 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1038/2057] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 15:01:08.013457 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d389f-07d2-4cf1-abcd-ddd3eeca1a99 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:08.022775 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d389f-07d2-4cf1-abcd-ddd3eeca1a99 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:08.027699 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc9177-22f2-4b97-a682-45be0dfcc547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:08.028308 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc9177-22f2-4b97-a682-45be0dfcc547 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:08.028592 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc9177-22f2-4b97-a682-45be0dfcc547 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:08.028919 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc9177-22f2-4b97-a682-45be0dfcc547 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:08.029586 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc9177-22f2-4b97-a682-45be0dfcc547 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:08.031931 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc9177-22f2-4b97-a682-45be0dfcc547 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:08.205455 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1020/2058] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:01:07 2022] PUT /identity/v3/projects/e785ec07120a4184acdbf74f73489ce8/users/0669d8dce2d64715948615519bf0eac9/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:08.208729 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1039/2059] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:01:08 2022] POST /identity/v3/projects => generated 401 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:01:08.210676 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1b7c1-b5c6-47f0-a274-2f8d1e31ed90 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:08.210809 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc9177-22f2-4b97-a682-45be0dfcc547 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:08.211056 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1b7c1-b5c6-47f0-a274-2f8d1e31ed90 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:08.211276 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1b7c1-b5c6-47f0-a274-2f8d1e31ed90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:08.228948 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-09d1b7c1-b5c6-47f0-a274-2f8d1e31ed90 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:08.230423 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-09d1b7c1-b5c6-47f0-a274-2f8d1e31ed90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:08.272274 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc9177-22f2-4b97-a682-45be0dfcc547 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:08.277192 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9f125-68ae-458d-b7ce-f7c7949916ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:08.277857 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9f125-68ae-458d-b7ce-f7c7949916ba admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:08.278143 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9f125-68ae-458d-b7ce-f7c7949916ba admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:08.278425 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9f125-68ae-458d-b7ce-f7c7949916ba admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:08.279165 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9f125-68ae-458d-b7ce-f7c7949916ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:08.281675 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9f125-68ae-458d-b7ce-f7c7949916ba admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:08.288258 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1021/2060] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:01:08.298657 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1b7c1-b5c6-47f0-a274-2f8d1e31ed90 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:08.299994 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-09d1b7c1-b5c6-47f0-a274-2f8d1e31ed90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:08.356909 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1040/2061] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:01:08 2022] POST /identity/v3/users => generated 301 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:01:08.358024 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9f125-68ae-458d-b7ce-f7c7949916ba admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:08.358867 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1b7c1-b5c6-47f0-a274-2f8d1e31ed90 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:08.362486 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd494bf4-3d76-41ec-b170-b7f4d6f6e6d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:08.363184 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd494bf4-3d76-41ec-b170-b7f4d6f6e6d2 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:08.363526 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd494bf4-3d76-41ec-b170-b7f4d6f6e6d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:08.363810 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd494bf4-3d76-41ec-b170-b7f4d6f6e6d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:08.368741 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9f125-68ae-458d-b7ce-f7c7949916ba admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:08.372983 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd494bf4-3d76-41ec-b170-b7f4d6f6e6d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:08.374503 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd494bf4-3d76-41ec-b170-b7f4d6f6e6d2 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:08.375760 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5fe4d-7159-4fc8-a67b-d4ff16f605ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:08.376499 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5fe4d-7159-4fc8-a67b-d4ff16f605ea admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:08.376789 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5fe4d-7159-4fc8-a67b-d4ff16f605ea admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:08.377091 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5fe4d-7159-4fc8-a67b-d4ff16f605ea admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:08.377822 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5fe4d-7159-4fc8-a67b-d4ff16f605ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:08.379511 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5fe4d-7159-4fc8-a67b-d4ff16f605ea admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:08.384103 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1022/2062] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:01:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 15:01:08.391113 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1041/2063] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:01:08.395152 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd494bf4-3d76-41ec-b170-b7f4d6f6e6d2 service neutron] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:08.405857 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd494bf4-3d76-41ec-b170-b7f4d6f6e6d2 service neutron] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:08.410580 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197ca47-735a-4845-9913-ef392082a544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:08.414221 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197ca47-735a-4845-9913-ef392082a544 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:08.414221 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197ca47-735a-4845-9913-ef392082a544 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:08.414221 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197ca47-735a-4845-9913-ef392082a544 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:08.414221 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197ca47-735a-4845-9913-ef392082a544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:08.414221 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197ca47-735a-4845-9913-ef392082a544 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:08.424270 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1023/2064] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:01:08.428469 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5fe4d-7159-4fc8-a67b-d4ff16f605ea admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:08.438418 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5fe4d-7159-4fc8-a67b-d4ff16f605ea admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:08.443053 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd4d3c-43fb-4f09-96a1-083fc6662445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:08.443947 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd4d3c-43fb-4f09-96a1-083fc6662445 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:08.444207 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd4d3c-43fb-4f09-96a1-083fc6662445 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:08.444484 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd4d3c-43fb-4f09-96a1-083fc6662445 admin admin] PATH_INFO: `/v3/projects/d009b52253b94692a589de2783954ec3/users/ab56331150664390a300fa705b65c368/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:08.459269 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd4d3c-43fb-4f09-96a1-083fc6662445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d009b52253b94692a589de2783954ec3, user_id=ab56331150664390a300fa705b65c368, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:08.461889 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd4d3c-43fb-4f09-96a1-083fc6662445 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:08.588303 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1042/2065] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:01:08 2022] PUT /identity/v3/projects/d009b52253b94692a589de2783954ec3/users/ab56331150664390a300fa705b65c368/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:08.599585 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee8352-3438-4cd5-956c-b42e910c3077 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:08.599880 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee8352-3438-4cd5-956c-b42e910c3077 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:08.600165 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee8352-3438-4cd5-956c-b42e910c3077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:08.626800 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-8eee8352-3438-4cd5-956c-b42e910c3077 None None] MFA Rules not processed for user `ab56331150664390a300fa705b65c368`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:08.627991 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-8eee8352-3438-4cd5-956c-b42e910c3077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:08.691015 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1024/2066] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:08.695500 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd4d3c-43fb-4f09-96a1-083fc6662445 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:08.770073 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd4d3c-43fb-4f09-96a1-083fc6662445 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:08.774827 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0d374-771b-41ac-af73-6da89fa75a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:08.775482 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0d374-771b-41ac-af73-6da89fa75a63 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:08.775767 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0d374-771b-41ac-af73-6da89fa75a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:08.776046 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0d374-771b-41ac-af73-6da89fa75a63 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:08.776754 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c0d374-771b-41ac-af73-6da89fa75a63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:08.778697 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c0d374-771b-41ac-af73-6da89fa75a63 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:08.881053 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1043/2067] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:01:08 2022] POST /identity/v3/projects => generated 399 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:01:08.882309 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee8352-3438-4cd5-956c-b42e910c3077 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:08.893410 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee8352-3438-4cd5-956c-b42e910c3077 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:08.950107 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed98b82-975e-43d5-8190-1f4f75eef145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:08.952487 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed98b82-975e-43d5-8190-1f4f75eef145 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:08.952487 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed98b82-975e-43d5-8190-1f4f75eef145 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:08.952487 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed98b82-975e-43d5-8190-1f4f75eef145 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:08.952487 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed98b82-975e-43d5-8190-1f4f75eef145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:08.954041 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed98b82-975e-43d5-8190-1f4f75eef145 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:09.105810 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1025/2068] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:01:08 2022] POST /identity/v3/users => generated 306 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:01:09.110206 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0d374-771b-41ac-af73-6da89fa75a63 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:09.121437 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0d374-771b-41ac-af73-6da89fa75a63 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:09.125569 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b88e1-de29-479f-b25f-883d7093e56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:09.126226 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b88e1-de29-479f-b25f-883d7093e56e admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:09.126511 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b88e1-de29-479f-b25f-883d7093e56e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:09.126790 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b88e1-de29-479f-b25f-883d7093e56e admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:09.127804 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b88e1-de29-479f-b25f-883d7093e56e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:09.129507 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b88e1-de29-479f-b25f-883d7093e56e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:09.141498 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1044/2069] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:01:09.145825 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed98b82-975e-43d5-8190-1f4f75eef145 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:09.159598 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed98b82-975e-43d5-8190-1f4f75eef145 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:09.167610 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9b258-b286-4344-b5ba-df0800046d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:09.169392 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9b258-b286-4344-b5ba-df0800046d6a admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:09.169679 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9b258-b286-4344-b5ba-df0800046d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:09.169960 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9b258-b286-4344-b5ba-df0800046d6a admin admin] PATH_INFO: `/v3/projects/ce00aaf3f8244f71a7ed8c17bae354ad/users/b346ecde15b34a4cbcfcec9abd7340eb/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:09.191203 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9b258-b286-4344-b5ba-df0800046d6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce00aaf3f8244f71a7ed8c17bae354ad, user_id=b346ecde15b34a4cbcfcec9abd7340eb, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:09.196384 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9b258-b286-4344-b5ba-df0800046d6a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:09.293363 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1026/2070] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:01:09 2022] PUT /identity/v3/projects/ce00aaf3f8244f71a7ed8c17bae354ad/users/b346ecde15b34a4cbcfcec9abd7340eb/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:09.297478 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b88e1-de29-479f-b25f-883d7093e56e admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:09.307357 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b88e1-de29-479f-b25f-883d7093e56e admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:09.369919 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fda2b5-cf04-4ac2-8bf2-356190dfa9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:09.370602 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fda2b5-cf04-4ac2-8bf2-356190dfa9dd admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:09.370933 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fda2b5-cf04-4ac2-8bf2-356190dfa9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:09.371169 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fda2b5-cf04-4ac2-8bf2-356190dfa9dd admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:09.371914 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fda2b5-cf04-4ac2-8bf2-356190dfa9dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:09.373591 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fda2b5-cf04-4ac2-8bf2-356190dfa9dd admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:09.384425 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1045/2071] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:01:09.393112 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9b258-b286-4344-b5ba-df0800046d6a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:09.403255 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9b258-b286-4344-b5ba-df0800046d6a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:09.408516 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0f2a6-c09a-484b-9e1c-5e8586e749fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:09.409426 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0f2a6-c09a-484b-9e1c-5e8586e749fa admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:09.409704 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0f2a6-c09a-484b-9e1c-5e8586e749fa admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:09.409972 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0f2a6-c09a-484b-9e1c-5e8586e749fa admin admin] PATH_INFO: `/v3/projects/ce00aaf3f8244f71a7ed8c17bae354ad/users/b346ecde15b34a4cbcfcec9abd7340eb/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:09.411924 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0f2a6-c09a-484b-9e1c-5e8586e749fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce00aaf3f8244f71a7ed8c17bae354ad, user_id=b346ecde15b34a4cbcfcec9abd7340eb, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:09.414552 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0f2a6-c09a-484b-9e1c-5e8586e749fa admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:09.424840 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1027/2072] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:01:09 2022] PUT /identity/v3/projects/ce00aaf3f8244f71a7ed8c17bae354ad/users/b346ecde15b34a4cbcfcec9abd7340eb/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:09.436626 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c99b1f-b87a-4f66-b778-54a1149488ad None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:09.442649 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c99b1f-b87a-4f66-b778-54a1149488ad None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:09.442649 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c99b1f-b87a-4f66-b778-54a1149488ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:09.469671 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-e1c99b1f-b87a-4f66-b778-54a1149488ad None None] MFA Rules not processed for user `b346ecde15b34a4cbcfcec9abd7340eb`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:09.470968 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-e1c99b1f-b87a-4f66-b778-54a1149488ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:09.537489 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1046/2073] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:09 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:09.546903 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0f2a6-c09a-484b-9e1c-5e8586e749fa admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:09.548586 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-b9c0f2a6-c09a-484b-9e1c-5e8586e749fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:09.603997 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0f2a6-c09a-484b-9e1c-5e8586e749fa admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:09.608017 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b7c35-efc7-4ecc-92e4-1d98baa94f6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:09.608664 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b7c35-efc7-4ecc-92e4-1d98baa94f6f service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:09.608951 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b7c35-efc7-4ecc-92e4-1d98baa94f6f service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:09.609266 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b7c35-efc7-4ecc-92e4-1d98baa94f6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:09.619507 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b7c35-efc7-4ecc-92e4-1d98baa94f6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:09.620945 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b7c35-efc7-4ecc-92e4-1d98baa94f6f service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:09.631052 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1028/2074] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:01:09 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:01:09.847396 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebf0cb-0f70-4f08-a243-038e7f28f3f3 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:09.848010 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebf0cb-0f70-4f08-a243-038e7f28f3f3 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:09.848496 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebf0cb-0f70-4f08-a243-038e7f28f3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:09.882354 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-dbebf0cb-0f70-4f08-a243-038e7f28f3f3 None None] MFA Rules not processed for user `0669d8dce2d64715948615519bf0eac9`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:09.884066 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-dbebf0cb-0f70-4f08-a243-038e7f28f3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:09.910227 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b7c35-efc7-4ecc-92e4-1d98baa94f6f service cinder] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:09.911642 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-de6b7c35-efc7-4ecc-92e4-1d98baa94f6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:09.922398 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b7c35-efc7-4ecc-92e4-1d98baa94f6f service cinder] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:09.926105 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19881a0f-1371-40e3-b318-dfa13d4fdf09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:09.926964 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19881a0f-1371-40e3-b318-dfa13d4fdf09 service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:09.927248 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19881a0f-1371-40e3-b318-dfa13d4fdf09 service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:09.927532 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19881a0f-1371-40e3-b318-dfa13d4fdf09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:09.959079 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1047/2075] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:09.970214 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbebf0cb-0f70-4f08-a243-038e7f28f3f3 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:09.980128 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbebf0cb-0f70-4f08-a243-038e7f28f3f3 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:09.984103 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9c554-120d-43f2-9a17-3eaf7b8c09a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:09.984811 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9c554-120d-43f2-9a17-3eaf7b8c09a1 service cinder] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:09.985335 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9c554-120d-43f2-9a17-3eaf7b8c09a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:09.985521 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19881a0f-1371-40e3-b318-dfa13d4fdf09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:09.985738 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9c554-120d-43f2-9a17-3eaf7b8c09a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:09.987012 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19881a0f-1371-40e3-b318-dfa13d4fdf09 service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:09.994737 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9c554-120d-43f2-9a17-3eaf7b8c09a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:09.996283 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9c554-120d-43f2-9a17-3eaf7b8c09a1 service cinder] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:09.996423 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1029/2076] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:01:09 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 15:01:10.005728 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1048/2077] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:01:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:01:13.876665 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dbd82-3069-4838-a689-5cda26cbf409 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:13.876665 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dbd82-3069-4838-a689-5cda26cbf409 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:13.876665 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dbd82-3069-4838-a689-5cda26cbf409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:13.893919 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-9f5dbd82-3069-4838-a689-5cda26cbf409 None None] MFA Rules not processed for user `0669d8dce2d64715948615519bf0eac9`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:13.895183 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-9f5dbd82-3069-4838-a689-5cda26cbf409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:13.902068 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1030/2078] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:16.673638 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9c554-120d-43f2-9a17-3eaf7b8c09a1 service cinder] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:16.675108 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-ffb9c554-120d-43f2-9a17-3eaf7b8c09a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:16.743926 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9c554-120d-43f2-9a17-3eaf7b8c09a1 service cinder] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:16.748637 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42738e-e5ed-4843-a38f-7cd6a2e8d813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:16.750159 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42738e-e5ed-4843-a38f-7cd6a2e8d813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:16.750439 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42738e-e5ed-4843-a38f-7cd6a2e8d813 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:16.750724 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42738e-e5ed-4843-a38f-7cd6a2e8d813 admin admin] PATH_INFO: `/v3/users/4ae7a44d6a7f43b0ba2b09232f99c78a` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:16.751925 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e42738e-e5ed-4843-a38f-7cd6a2e8d813 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ae7a44d6a7f43b0ba2b09232f99c78a)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:16.753900 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e42738e-e5ed-4843-a38f-7cd6a2e8d813 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:16.955624 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-4e42738e-e5ed-4843-a38f-7cd6a2e8d813 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ae7a44d6a7f43b0ba2b09232f99c78a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:16.962808 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-4e42738e-e5ed-4843-a38f-7cd6a2e8d813 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ae7a44d6a7f43b0ba2b09232f99c78a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:16.963550 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-4e42738e-e5ed-4843-a38f-7cd6a2e8d813 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ae7a44d6a7f43b0ba2b09232f99c78a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:16.964187 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-4e42738e-e5ed-4843-a38f-7cd6a2e8d813 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ae7a44d6a7f43b0ba2b09232f99c78a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:17.041739 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-4e42738e-e5ed-4843-a38f-7cd6a2e8d813 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ae7a44d6a7f43b0ba2b09232f99c78a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:17.060254 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1049/2079] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:01:16 2022] DELETE /identity/v3/users/4ae7a44d6a7f43b0ba2b09232f99c78a => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:17.064844 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d5400-6f2a-4261-a7b2-8213d6113b7c None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:17.065353 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d5400-6f2a-4261-a7b2-8213d6113b7c None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:17.065470 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d5400-6f2a-4261-a7b2-8213d6113b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:17.082443 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-003d5400-6f2a-4261-a7b2-8213d6113b7c None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:17.083624 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-003d5400-6f2a-4261-a7b2-8213d6113b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:17.140653 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1031/2080] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:17.150054 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42738e-e5ed-4843-a38f-7cd6a2e8d813 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:17.151548 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-4e42738e-e5ed-4843-a38f-7cd6a2e8d813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:17.209233 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42738e-e5ed-4843-a38f-7cd6a2e8d813 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:17.212912 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a88e5-0bf2-44a8-8d71-1d88c7b48d01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:17.213583 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a88e5-0bf2-44a8-8d71-1d88c7b48d01 service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:17.213868 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a88e5-0bf2-44a8-8d71-1d88c7b48d01 service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:17.214148 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a88e5-0bf2-44a8-8d71-1d88c7b48d01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:17.223775 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a88e5-0bf2-44a8-8d71-1d88c7b48d01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:17.225242 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a88e5-0bf2-44a8-8d71-1d88c7b48d01 service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:17.235689 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1050/2081] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:01:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:01:17.558624 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d5400-6f2a-4261-a7b2-8213d6113b7c None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:17.560062 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-003d5400-6f2a-4261-a7b2-8213d6113b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:17.573099 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d5400-6f2a-4261-a7b2-8213d6113b7c None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:17.583239 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb635b6-2201-436a-87c8-4e708c54ce05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:17.584514 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb635b6-2201-436a-87c8-4e708c54ce05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:17.584965 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb635b6-2201-436a-87c8-4e708c54ce05 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:17.585954 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb635b6-2201-436a-87c8-4e708c54ce05 admin admin] PATH_INFO: `/v3/users/ab56331150664390a300fa705b65c368` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:17.587695 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb635b6-2201-436a-87c8-4e708c54ce05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab56331150664390a300fa705b65c368)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:17.590347 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb635b6-2201-436a-87c8-4e708c54ce05 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:17.730103 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a88e5-0bf2-44a8-8d71-1d88c7b48d01 service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:17.731391 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-8e1a88e5-0bf2-44a8-8d71-1d88c7b48d01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:17.744781 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a88e5-0bf2-44a8-8d71-1d88c7b48d01 service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:17.777435 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-8bb635b6-2201-436a-87c8-4e708c54ce05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab56331150664390a300fa705b65c368'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:17.777608 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b87f0-8dce-45b2-b1d7-f819f42d5edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:17.778271 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b87f0-8dce-45b2-b1d7-f819f42d5edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:17.778555 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b87f0-8dce-45b2-b1d7-f819f42d5edb admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:17.778828 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b87f0-8dce-45b2-b1d7-f819f42d5edb admin admin] PATH_INFO: `/v3/projects/8dc0fa7c67174eccbd2eb42b56354626` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:17.780120 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b87f0-8dce-45b2-b1d7-f819f42d5edb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dc0fa7c67174eccbd2eb42b56354626)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:17.782096 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b87f0-8dce-45b2-b1d7-f819f42d5edb admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:17.784740 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-8bb635b6-2201-436a-87c8-4e708c54ce05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab56331150664390a300fa705b65c368'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:17.785619 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-8bb635b6-2201-436a-87c8-4e708c54ce05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab56331150664390a300fa705b65c368'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:17.868205 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-8bb635b6-2201-436a-87c8-4e708c54ce05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab56331150664390a300fa705b65c368'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:17.892112 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-8bb635b6-2201-436a-87c8-4e708c54ce05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab56331150664390a300fa705b65c368'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:17.908115 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1032/2082] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:01:17 2022] DELETE /identity/v3/users/ab56331150664390a300fa705b65c368 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:01:17.920602 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528066d-a5da-4919-a50d-bbe377527eac None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:17.920915 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528066d-a5da-4919-a50d-bbe377527eac None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:17.921232 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528066d-a5da-4919-a50d-bbe377527eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:17.944415 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-d528066d-a5da-4919-a50d-bbe377527eac None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:17.945644 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-d528066d-a5da-4919-a50d-bbe377527eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:17.983849 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-5a8b87f0-8dce-45b2-b1d7-f819f42d5edb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dc0fa7c67174eccbd2eb42b56354626', 'request_id': 'req-5a8b87f0-8dce-45b2-b1d7-f819f42d5edb'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:17.991039 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-5a8b87f0-8dce-45b2-b1d7-f819f42d5edb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dc0fa7c67174eccbd2eb42b56354626', 'request_id': 'req-5a8b87f0-8dce-45b2-b1d7-f819f42d5edb'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:18.007502 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1033/2083] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:18.019159 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528066d-a5da-4919-a50d-bbe377527eac None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:18.020525 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-d528066d-a5da-4919-a50d-bbe377527eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:18.085913 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528066d-a5da-4919-a50d-bbe377527eac None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:18.130318 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-5a8b87f0-8dce-45b2-b1d7-f819f42d5edb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dc0fa7c67174eccbd2eb42b56354626', 'request_id': 'req-5a8b87f0-8dce-45b2-b1d7-f819f42d5edb'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:18.136923 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6af3a-9425-4233-8a36-3c135ed21acd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:18.137721 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6af3a-9425-4233-8a36-3c135ed21acd service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:18.140007 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6af3a-9425-4233-8a36-3c135ed21acd service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:18.140007 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6af3a-9425-4233-8a36-3c135ed21acd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:18.145787 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-5a8b87f0-8dce-45b2-b1d7-f819f42d5edb admin admin] The token cache is being invalidate because project 8dc0fa7c67174eccbd2eb42b56354626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:01:18.146150 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-5a8b87f0-8dce-45b2-b1d7-f819f42d5edb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:18.146869 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-5a8b87f0-8dce-45b2-b1d7-f819f42d5edb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:18.148745 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1051/2084] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:01:17 2022] DELETE /identity/v3/projects/8dc0fa7c67174eccbd2eb42b56354626 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:01:18.154121 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5701c7-24f6-43ab-bea1-aca7e8c12d55 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:18.154907 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5701c7-24f6-43ab-bea1-aca7e8c12d55 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:18.155256 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5701c7-24f6-43ab-bea1-aca7e8c12d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:18.174493 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-0b5701c7-24f6-43ab-bea1-aca7e8c12d55 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:18.175794 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-0b5701c7-24f6-43ab-bea1-aca7e8c12d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:18.213021 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6af3a-9425-4233-8a36-3c135ed21acd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:18.218596 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6af3a-9425-4233-8a36-3c135ed21acd service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:18.225348 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1034/2085] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:01:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 15:01:18.241800 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1052/2086] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:18.250050 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac0949-9f02-4163-a264-60f18e632942 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:18.250336 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac0949-9f02-4163-a264-60f18e632942 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:18.250611 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac0949-9f02-4163-a264-60f18e632942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:18.269320 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-daac0949-9f02-4163-a264-60f18e632942 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:18.270765 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-daac0949-9f02-4163-a264-60f18e632942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:18.279136 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1035/2087] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:18.283285 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5701c7-24f6-43ab-bea1-aca7e8c12d55 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:18.293132 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5701c7-24f6-43ab-bea1-aca7e8c12d55 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:18.298150 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42766e1d-617e-43ea-881f-6e01c167b933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:18.300280 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42766e1d-617e-43ea-881f-6e01c167b933 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:18.300280 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42766e1d-617e-43ea-881f-6e01c167b933 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:18.300280 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42766e1d-617e-43ea-881f-6e01c167b933 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:18.300280 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42766e1d-617e-43ea-881f-6e01c167b933 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:01:18.300669 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42766e1d-617e-43ea-881f-6e01c167b933 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:18.302199 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42766e1d-617e-43ea-881f-6e01c167b933 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:18.314567 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1053/2088] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 15:01:18.318799 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac0949-9f02-4163-a264-60f18e632942 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:18.329619 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac0949-9f02-4163-a264-60f18e632942 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:18.334704 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f073d88-401e-4e7c-a136-825b61b98c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:18.335550 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f073d88-401e-4e7c-a136-825b61b98c4a admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:18.335845 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f073d88-401e-4e7c-a136-825b61b98c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:18.336161 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f073d88-401e-4e7c-a136-825b61b98c4a admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:18.337501 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f073d88-401e-4e7c-a136-825b61b98c4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:18.340959 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f073d88-401e-4e7c-a136-825b61b98c4a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:18.440498 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1036/2089] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:01:18 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:01:18.444288 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42766e1d-617e-43ea-881f-6e01c167b933 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:18.460154 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42766e1d-617e-43ea-881f-6e01c167b933 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:18.521582 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7e639-4268-47d0-9a91-882b96e1b653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:18.522235 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7e639-4268-47d0-9a91-882b96e1b653 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:18.522519 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7e639-4268-47d0-9a91-882b96e1b653 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:18.522796 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7e639-4268-47d0-9a91-882b96e1b653 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:18.523512 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd7e639-4268-47d0-9a91-882b96e1b653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:18.525922 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd7e639-4268-47d0-9a91-882b96e1b653 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:18.619642 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1054/2090] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:01:18 2022] POST /identity/v3/users => generated 283 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:01:18.626401 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f073d88-401e-4e7c-a136-825b61b98c4a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:18.636642 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f073d88-401e-4e7c-a136-825b61b98c4a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:18.641765 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcd97c-dee3-4d21-9082-b44af916dfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:18.642430 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcd97c-dee3-4d21-9082-b44af916dfba admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:18.642837 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcd97c-dee3-4d21-9082-b44af916dfba admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:18.643120 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcd97c-dee3-4d21-9082-b44af916dfba admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:18.643870 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdcd97c-dee3-4d21-9082-b44af916dfba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:18.645570 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdcd97c-dee3-4d21-9082-b44af916dfba admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:18.653473 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7e639-4268-47d0-9a91-882b96e1b653 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:18.656828 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-4dd7e639-4268-47d0-9a91-882b96e1b653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:18.660370 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1037/2091] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:01:18.666546 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcd97c-dee3-4d21-9082-b44af916dfba admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:18.675558 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7e639-4268-47d0-9a91-882b96e1b653 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:18.685371 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcd97c-dee3-4d21-9082-b44af916dfba admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:18.692317 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c6798-02f3-4bc6-bbd7-aac2b784e612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:18.697978 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2890b-7fbb-48ee-8656-02e271f9958d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:18.698293 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c6798-02f3-4bc6-bbd7-aac2b784e612 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:18.698293 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c6798-02f3-4bc6-bbd7-aac2b784e612 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:18.698293 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c6798-02f3-4bc6-bbd7-aac2b784e612 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:18.698293 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c6798-02f3-4bc6-bbd7-aac2b784e612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:18.698552 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2890b-7fbb-48ee-8656-02e271f9958d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:18.698552 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2890b-7fbb-48ee-8656-02e271f9958d admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:18.698552 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2890b-7fbb-48ee-8656-02e271f9958d admin admin] PATH_INFO: `/v3/projects/d009b52253b94692a589de2783954ec3` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:18.698747 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c6798-02f3-4bc6-bbd7-aac2b784e612 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:18.698822 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2890b-7fbb-48ee-8656-02e271f9958d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d009b52253b94692a589de2783954ec3)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:18.698822 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2890b-7fbb-48ee-8656-02e271f9958d admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:18.710052 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1038/2092] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:01:18.714507 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c6798-02f3-4bc6-bbd7-aac2b784e612 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:18.726385 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c6798-02f3-4bc6-bbd7-aac2b784e612 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:18.731916 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63089cb7-7bf8-4687-924b-5cd11e7281f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:18.732934 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63089cb7-7bf8-4687-924b-5cd11e7281f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:18.734219 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63089cb7-7bf8-4687-924b-5cd11e7281f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:18.734600 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63089cb7-7bf8-4687-924b-5cd11e7281f4 admin admin] PATH_INFO: `/v3/projects/4a24108332144b53b211ee05656bc9b8/users/3f9ece08beb6425dba1dc41ba4c00531/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:18.752834 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63089cb7-7bf8-4687-924b-5cd11e7281f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a24108332144b53b211ee05656bc9b8, user_id=3f9ece08beb6425dba1dc41ba4c00531, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:18.757185 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63089cb7-7bf8-4687-924b-5cd11e7281f4 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:18.837220 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1039/2093] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:01:18 2022] PUT /identity/v3/projects/4a24108332144b53b211ee05656bc9b8/users/3f9ece08beb6425dba1dc41ba4c00531/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:18.849232 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32a580-49d8-4386-98fa-9f2d8c541710 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:18.849790 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32a580-49d8-4386-98fa-9f2d8c541710 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:18.850010 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32a580-49d8-4386-98fa-9f2d8c541710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:18.856612 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-64e2890b-7fbb-48ee-8656-02e271f9958d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd009b52253b94692a589de2783954ec3', 'request_id': 'req-64e2890b-7fbb-48ee-8656-02e271f9958d'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:18.864655 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-64e2890b-7fbb-48ee-8656-02e271f9958d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd009b52253b94692a589de2783954ec3', 'request_id': 'req-64e2890b-7fbb-48ee-8656-02e271f9958d'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:18.878380 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-7d32a580-49d8-4386-98fa-9f2d8c541710 None None] MFA Rules not processed for user `3f9ece08beb6425dba1dc41ba4c00531`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:18.879735 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-7d32a580-49d8-4386-98fa-9f2d8c541710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:18.966418 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1040/2094] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:18.973234 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32a580-49d8-4386-98fa-9f2d8c541710 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:18.974775 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-7d32a580-49d8-4386-98fa-9f2d8c541710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:18.994521 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-64e2890b-7fbb-48ee-8656-02e271f9958d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd009b52253b94692a589de2783954ec3', 'request_id': 'req-64e2890b-7fbb-48ee-8656-02e271f9958d'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:19.013059 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-64e2890b-7fbb-48ee-8656-02e271f9958d admin admin] The token cache is being invalidate because project d009b52253b94692a589de2783954ec3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:01:19.013901 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-64e2890b-7fbb-48ee-8656-02e271f9958d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:19.014798 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-64e2890b-7fbb-48ee-8656-02e271f9958d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:19.019306 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1055/2095] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:01:18 2022] DELETE /identity/v3/projects/d009b52253b94692a589de2783954ec3 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:19.020313 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2890b-7fbb-48ee-8656-02e271f9958d admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:19.021732 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-64e2890b-7fbb-48ee-8656-02e271f9958d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:19.049202 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32a580-49d8-4386-98fa-9f2d8c541710 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:19.053340 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da752cdb-e95e-483e-9901-03af614338ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:19.053991 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da752cdb-e95e-483e-9901-03af614338ed service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:19.054271 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da752cdb-e95e-483e-9901-03af614338ed service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:19.054549 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da752cdb-e95e-483e-9901-03af614338ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:19.056515 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-da752cdb-e95e-483e-9901-03af614338ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:19.069113 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da752cdb-e95e-483e-9901-03af614338ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:19.080251 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da752cdb-e95e-483e-9901-03af614338ed service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:19.093944 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1041/2096] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:01:18 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 15:01:19.115343 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2890b-7fbb-48ee-8656-02e271f9958d admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:19.118532 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1553d4-b222-4b68-8248-7a14527880b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:19.119408 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1553d4-b222-4b68-8248-7a14527880b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:19.119689 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1553d4-b222-4b68-8248-7a14527880b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:19.119963 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1553d4-b222-4b68-8248-7a14527880b2 admin admin] PATH_INFO: `/v3/users/b346ecde15b34a4cbcfcec9abd7340eb` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:19.121262 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1553d4-b222-4b68-8248-7a14527880b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b346ecde15b34a4cbcfcec9abd7340eb)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:19.123252 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1553d4-b222-4b68-8248-7a14527880b2 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:19.341424 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-be1553d4-b222-4b68-8248-7a14527880b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b346ecde15b34a4cbcfcec9abd7340eb'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:19.348546 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-be1553d4-b222-4b68-8248-7a14527880b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b346ecde15b34a4cbcfcec9abd7340eb'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:19.349277 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-be1553d4-b222-4b68-8248-7a14527880b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b346ecde15b34a4cbcfcec9abd7340eb'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:19.349881 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-be1553d4-b222-4b68-8248-7a14527880b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b346ecde15b34a4cbcfcec9abd7340eb'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:19.419746 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-be1553d4-b222-4b68-8248-7a14527880b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b346ecde15b34a4cbcfcec9abd7340eb'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:19.446122 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1056/2097] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:01:19 2022] DELETE /identity/v3/users/b346ecde15b34a4cbcfcec9abd7340eb => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:01:19.814594 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da752cdb-e95e-483e-9901-03af614338ed service cinder] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:19.815701 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-da752cdb-e95e-483e-9901-03af614338ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:19.829228 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da752cdb-e95e-483e-9901-03af614338ed service cinder] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:19.887599 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bede3-517c-48b8-962b-1a68d8c49ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:19.888504 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bede3-517c-48b8-962b-1a68d8c49ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:19.888788 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bede3-517c-48b8-962b-1a68d8c49ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:19.889086 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bede3-517c-48b8-962b-1a68d8c49ab2 admin admin] PATH_INFO: `/v3/users/d3d1dc23cfbe470ca8f60eed25cdf7f9` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:19.890954 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bede3-517c-48b8-962b-1a68d8c49ab2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3d1dc23cfbe470ca8f60eed25cdf7f9)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:19.893579 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bede3-517c-48b8-962b-1a68d8c49ab2 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:20.139995 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-105bede3-517c-48b8-962b-1a68d8c49ab2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3d1dc23cfbe470ca8f60eed25cdf7f9'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:20.147787 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-105bede3-517c-48b8-962b-1a68d8c49ab2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3d1dc23cfbe470ca8f60eed25cdf7f9'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:20.148512 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-105bede3-517c-48b8-962b-1a68d8c49ab2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3d1dc23cfbe470ca8f60eed25cdf7f9'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:20.259601 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-105bede3-517c-48b8-962b-1a68d8c49ab2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3d1dc23cfbe470ca8f60eed25cdf7f9'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:20.273681 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-105bede3-517c-48b8-962b-1a68d8c49ab2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3d1dc23cfbe470ca8f60eed25cdf7f9'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:20.283720 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1042/2098] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:01:19 2022] DELETE /identity/v3/users/d3d1dc23cfbe470ca8f60eed25cdf7f9 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:20.288045 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001509ae-edca-42a4-9ef9-464003d68af8 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:20.288548 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001509ae-edca-42a4-9ef9-464003d68af8 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:20.288626 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001509ae-edca-42a4-9ef9-464003d68af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:20.308220 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-001509ae-edca-42a4-9ef9-464003d68af8 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:20.309831 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-001509ae-edca-42a4-9ef9-464003d68af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:20.381809 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1057/2099] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:20.391932 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bede3-517c-48b8-962b-1a68d8c49ab2 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:20.393500 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-105bede3-517c-48b8-962b-1a68d8c49ab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:20.452564 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bede3-517c-48b8-962b-1a68d8c49ab2 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:20.456257 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397e667-af62-4879-ac76-76a8fbf570cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:20.456896 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397e667-af62-4879-ac76-76a8fbf570cb service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:20.457220 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397e667-af62-4879-ac76-76a8fbf570cb service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:20.458593 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397e667-af62-4879-ac76-76a8fbf570cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:20.466969 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397e667-af62-4879-ac76-76a8fbf570cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:20.469035 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397e667-af62-4879-ac76-76a8fbf570cb service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:20.479236 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1043/2100] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:01:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:01:20.527855 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001509ae-edca-42a4-9ef9-464003d68af8 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:20.531039 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-001509ae-edca-42a4-9ef9-464003d68af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:20.544520 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001509ae-edca-42a4-9ef9-464003d68af8 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:20.550005 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e6c11-1ff5-4ce4-8529-88bf976e218b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:20.551147 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e6c11-1ff5-4ce4-8529-88bf976e218b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:20.551430 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e6c11-1ff5-4ce4-8529-88bf976e218b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:20.551741 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e6c11-1ff5-4ce4-8529-88bf976e218b admin admin] PATH_INFO: `/v3/projects/ce00aaf3f8244f71a7ed8c17bae354ad` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:20.552977 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e6c11-1ff5-4ce4-8529-88bf976e218b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce00aaf3f8244f71a7ed8c17bae354ad)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:20.555150 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e6c11-1ff5-4ce4-8529-88bf976e218b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:20.687798 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-ab9e6c11-1ff5-4ce4-8529-88bf976e218b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce00aaf3f8244f71a7ed8c17bae354ad', 'request_id': 'req-ab9e6c11-1ff5-4ce4-8529-88bf976e218b'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:20.693995 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-ab9e6c11-1ff5-4ce4-8529-88bf976e218b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce00aaf3f8244f71a7ed8c17bae354ad', 'request_id': 'req-ab9e6c11-1ff5-4ce4-8529-88bf976e218b'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:20.811482 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-ab9e6c11-1ff5-4ce4-8529-88bf976e218b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce00aaf3f8244f71a7ed8c17bae354ad', 'request_id': 'req-ab9e6c11-1ff5-4ce4-8529-88bf976e218b'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:20.824292 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-ab9e6c11-1ff5-4ce4-8529-88bf976e218b admin admin] The token cache is being invalidate because project ce00aaf3f8244f71a7ed8c17bae354ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:01:20.824585 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-ab9e6c11-1ff5-4ce4-8529-88bf976e218b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:20.825944 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-ab9e6c11-1ff5-4ce4-8529-88bf976e218b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:20.827635 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1058/2101] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:01:20 2022] DELETE /identity/v3/projects/ce00aaf3f8244f71a7ed8c17bae354ad => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:20.833642 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdeed36-6fa7-489b-9ef0-5e759e348257 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:20.834015 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdeed36-6fa7-489b-9ef0-5e759e348257 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:20.834546 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdeed36-6fa7-489b-9ef0-5e759e348257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:20.855951 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-efdeed36-6fa7-489b-9ef0-5e759e348257 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:20.857188 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-efdeed36-6fa7-489b-9ef0-5e759e348257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:20.933708 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1044/2102] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:01:20.940400 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e98aa6-856c-464f-8354-3ea1b4b2c0ed None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:20.940770 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e98aa6-856c-464f-8354-3ea1b4b2c0ed None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:20.941156 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e98aa6-856c-464f-8354-3ea1b4b2c0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:20.961228 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-a0e98aa6-856c-464f-8354-3ea1b4b2c0ed None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:20.961400 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-a0e98aa6-856c-464f-8354-3ea1b4b2c0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:20.971900 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1059/2103] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:20.975949 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdeed36-6fa7-489b-9ef0-5e759e348257 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:20.985854 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdeed36-6fa7-489b-9ef0-5e759e348257 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:20.990583 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed09b77-2563-4b52-90f3-509ce1ec669a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:20.991246 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed09b77-2563-4b52-90f3-509ce1ec669a admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:20.991545 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed09b77-2563-4b52-90f3-509ce1ec669a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:20.991790 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed09b77-2563-4b52-90f3-509ce1ec669a admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:20.992529 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed09b77-2563-4b52-90f3-509ce1ec669a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:01:20.992832 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed09b77-2563-4b52-90f3-509ce1ec669a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:20.994506 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed09b77-2563-4b52-90f3-509ce1ec669a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:21.007525 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1045/2104] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 15:01:21.011882 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e98aa6-856c-464f-8354-3ea1b4b2c0ed None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:21.023998 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e98aa6-856c-464f-8354-3ea1b4b2c0ed None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:21.024355 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed09b77-2563-4b52-90f3-509ce1ec669a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:21.026737 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-0ed09b77-2563-4b52-90f3-509ce1ec669a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:21.030315 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a07e3-129f-426f-8cf2-451e371e7aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:21.031078 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a07e3-129f-426f-8cf2-451e371e7aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:21.031371 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a07e3-129f-426f-8cf2-451e371e7aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:21.033220 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a07e3-129f-426f-8cf2-451e371e7aa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:21.033220 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a07e3-129f-426f-8cf2-451e371e7aa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:21.035127 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a07e3-129f-426f-8cf2-451e371e7aa1 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:21.044321 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed09b77-2563-4b52-90f3-509ce1ec669a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:21.052238 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c6c71-0fc7-49e9-9daf-90dfb6546bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:21.054094 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c6c71-0fc7-49e9-9daf-90dfb6546bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:21.054781 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c6c71-0fc7-49e9-9daf-90dfb6546bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:21.055256 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c6c71-0fc7-49e9-9daf-90dfb6546bbc admin admin] PATH_INFO: `/v3/projects/2c3197b7d48d41c4ae8b136141120bff` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:21.056916 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c6c71-0fc7-49e9-9daf-90dfb6546bbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c3197b7d48d41c4ae8b136141120bff)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:21.058976 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c6c71-0fc7-49e9-9daf-90dfb6546bbc admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:21.252317 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1060/2105] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:01:21 2022] POST /identity/v3/projects => generated 381 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:01:21.256202 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a07e3-129f-426f-8cf2-451e371e7aa1 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:21.261444 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e91c6c71-0fc7-49e9-9daf-90dfb6546bbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c3197b7d48d41c4ae8b136141120bff', 'request_id': 'req-e91c6c71-0fc7-49e9-9daf-90dfb6546bbc'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:21.268725 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e91c6c71-0fc7-49e9-9daf-90dfb6546bbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c3197b7d48d41c4ae8b136141120bff', 'request_id': 'req-e91c6c71-0fc7-49e9-9daf-90dfb6546bbc'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:21.274546 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e91c6c71-0fc7-49e9-9daf-90dfb6546bbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c3197b7d48d41c4ae8b136141120bff', 'request_id': 'req-e91c6c71-0fc7-49e9-9daf-90dfb6546bbc'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:21.317441 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a07e3-129f-426f-8cf2-451e371e7aa1 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:21.323647 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968aec5-e72c-46dd-bc19-34b238356a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:21.324385 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968aec5-e72c-46dd-bc19-34b238356a39 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:21.326416 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968aec5-e72c-46dd-bc19-34b238356a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:21.326416 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968aec5-e72c-46dd-bc19-34b238356a39 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:21.326416 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968aec5-e72c-46dd-bc19-34b238356a39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:21.327979 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968aec5-e72c-46dd-bc19-34b238356a39 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:21.406880 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e91c6c71-0fc7-49e9-9daf-90dfb6546bbc admin admin] The token cache is being invalidate because project 2c3197b7d48d41c4ae8b136141120bff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:01:21.407237 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e91c6c71-0fc7-49e9-9daf-90dfb6546bbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:21.407862 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e91c6c71-0fc7-49e9-9daf-90dfb6546bbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:21.409498 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1046/2106] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:01:21 2022] DELETE /identity/v3/projects/2c3197b7d48d41c4ae8b136141120bff => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:01:21.413741 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c6c71-0fc7-49e9-9daf-90dfb6546bbc admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:21.415211 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-e91c6c71-0fc7-49e9-9daf-90dfb6546bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:21.440953 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1061/2107] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:01:21 2022] POST /identity/v3/users => generated 291 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:01:21.445028 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968aec5-e72c-46dd-bc19-34b238356a39 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:21.448743 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-d968aec5-e72c-46dd-bc19-34b238356a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:21.460982 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968aec5-e72c-46dd-bc19-34b238356a39 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:21.467112 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29f14c-4420-492b-8066-c8457b3fb101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:21.468076 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29f14c-4420-492b-8066-c8457b3fb101 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:21.469136 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29f14c-4420-492b-8066-c8457b3fb101 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:21.469627 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29f14c-4420-492b-8066-c8457b3fb101 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:21.470556 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29f14c-4420-492b-8066-c8457b3fb101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:21.472244 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29f14c-4420-492b-8066-c8457b3fb101 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:21.483453 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1062/2108] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:01:21.487404 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29f14c-4420-492b-8066-c8457b3fb101 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:21.496429 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c6c71-0fc7-49e9-9daf-90dfb6546bbc admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:21.502310 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c1d3b-2bf9-4495-bb40-9458b6e2e318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:21.503647 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c1d3b-2bf9-4495-bb40-9458b6e2e318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:21.503939 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c1d3b-2bf9-4495-bb40-9458b6e2e318 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:21.504168 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29f14c-4420-492b-8066-c8457b3fb101 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:21.506287 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c1d3b-2bf9-4495-bb40-9458b6e2e318 admin admin] PATH_INFO: `/v3/users/a454796801d347d0b535c08a247fb77e` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:21.506287 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c1d3b-2bf9-4495-bb40-9458b6e2e318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a454796801d347d0b535c08a247fb77e)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:21.507439 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c1d3b-2bf9-4495-bb40-9458b6e2e318 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:21.509691 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8732c9-9cc6-4244-a3b2-1b0f984d2a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:21.510343 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8732c9-9cc6-4244-a3b2-1b0f984d2a80 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:21.510675 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8732c9-9cc6-4244-a3b2-1b0f984d2a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:21.510953 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8732c9-9cc6-4244-a3b2-1b0f984d2a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:21.511736 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8732c9-9cc6-4244-a3b2-1b0f984d2a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:21.513917 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8732c9-9cc6-4244-a3b2-1b0f984d2a80 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:21.525237 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1063/2109] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:01:21.530555 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8732c9-9cc6-4244-a3b2-1b0f984d2a80 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:21.540374 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8732c9-9cc6-4244-a3b2-1b0f984d2a80 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:21.545086 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309cb744-323c-4015-850f-402ab2a3d703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:21.546605 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309cb744-323c-4015-850f-402ab2a3d703 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:21.546881 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309cb744-323c-4015-850f-402ab2a3d703 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:21.547152 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309cb744-323c-4015-850f-402ab2a3d703 admin admin] PATH_INFO: `/v3/projects/6b22c92de24249429ee3c736f0fe1447/users/04daf066768e483d8b46e59ad5b4b7b5/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:21.560853 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309cb744-323c-4015-850f-402ab2a3d703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b22c92de24249429ee3c736f0fe1447, user_id=04daf066768e483d8b46e59ad5b4b7b5, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:21.563557 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309cb744-323c-4015-850f-402ab2a3d703 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:21.683957 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1064/2110] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:01:21 2022] PUT /identity/v3/projects/6b22c92de24249429ee3c736f0fe1447/users/04daf066768e483d8b46e59ad5b4b7b5/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:21.695216 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb7599-45d6-45e3-89a6-c57857dd0e8a None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:21.695507 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb7599-45d6-45e3-89a6-c57857dd0e8a None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:21.695785 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb7599-45d6-45e3-89a6-c57857dd0e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:21.724408 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-46fb7599-45d6-45e3-89a6-c57857dd0e8a None None] MFA Rules not processed for user `04daf066768e483d8b46e59ad5b4b7b5`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:21.725749 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-46fb7599-45d6-45e3-89a6-c57857dd0e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:21.731975 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-f46c1d3b-2bf9-4495-bb40-9458b6e2e318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a454796801d347d0b535c08a247fb77e'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:21.743971 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-f46c1d3b-2bf9-4495-bb40-9458b6e2e318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a454796801d347d0b535c08a247fb77e'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:21.743971 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-f46c1d3b-2bf9-4495-bb40-9458b6e2e318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a454796801d347d0b535c08a247fb77e'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:21.796407 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1065/2111] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:21.800852 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb7599-45d6-45e3-89a6-c57857dd0e8a None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:21.825561 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-f46c1d3b-2bf9-4495-bb40-9458b6e2e318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a454796801d347d0b535c08a247fb77e'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:21.867007 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-f46c1d3b-2bf9-4495-bb40-9458b6e2e318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a454796801d347d0b535c08a247fb77e'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:21.867900 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb7599-45d6-45e3-89a6-c57857dd0e8a None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:21.877226 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1047/2112] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:01:21 2022] DELETE /identity/v3/users/a454796801d347d0b535c08a247fb77e => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:01:21.892198 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb74e7-59d3-4250-98e9-60d08de73306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:21.892965 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb74e7-59d3-4250-98e9-60d08de73306 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:21.893361 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb74e7-59d3-4250-98e9-60d08de73306 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:21.893698 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb74e7-59d3-4250-98e9-60d08de73306 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:21.894642 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb74e7-59d3-4250-98e9-60d08de73306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:21.896798 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb74e7-59d3-4250-98e9-60d08de73306 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:22.020613 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1066/2113] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:01:21 2022] POST /identity/v3/projects => generated 381 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:01:22.024825 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c1d3b-2bf9-4495-bb40-9458b6e2e318 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:22.026375 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-f46c1d3b-2bf9-4495-bb40-9458b6e2e318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:22.088151 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c1d3b-2bf9-4495-bb40-9458b6e2e318 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:22.143639 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb190b07-9280-4c49-bba0-e73ebdf4a152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:22.144321 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb190b07-9280-4c49-bba0-e73ebdf4a152 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:22.144603 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb190b07-9280-4c49-bba0-e73ebdf4a152 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:22.144882 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb190b07-9280-4c49-bba0-e73ebdf4a152 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:22.145716 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb190b07-9280-4c49-bba0-e73ebdf4a152 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:22.148416 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb190b07-9280-4c49-bba0-e73ebdf4a152 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:22.265863 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1048/2114] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:01:22 2022] POST /identity/v3/users => generated 297 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:01:22.269493 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb74e7-59d3-4250-98e9-60d08de73306 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:22.279871 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb74e7-59d3-4250-98e9-60d08de73306 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:22.284437 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abca98-1bcf-493c-bdd5-77bbfe4081e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:22.285091 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abca98-1bcf-493c-bdd5-77bbfe4081e5 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:22.285394 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abca98-1bcf-493c-bdd5-77bbfe4081e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:22.285674 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abca98-1bcf-493c-bdd5-77bbfe4081e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:22.286465 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60abca98-1bcf-493c-bdd5-77bbfe4081e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:22.288087 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60abca98-1bcf-493c-bdd5-77bbfe4081e5 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:22.298328 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1067/2115] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:01:22.302333 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb190b07-9280-4c49-bba0-e73ebdf4a152 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:22.312782 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb190b07-9280-4c49-bba0-e73ebdf4a152 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:22.317432 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345bea5b-364a-4caa-be40-724a3cb79b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:22.318300 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bea5b-364a-4caa-be40-724a3cb79b8b admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:22.318582 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bea5b-364a-4caa-be40-724a3cb79b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:22.318859 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bea5b-364a-4caa-be40-724a3cb79b8b admin admin] PATH_INFO: `/v3/projects/73d2a2e16cb542e39333700e51d0b571/users/c11f540b112b45048f7b57e8d98edd35/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:22.333707 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345bea5b-364a-4caa-be40-724a3cb79b8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=73d2a2e16cb542e39333700e51d0b571, user_id=c11f540b112b45048f7b57e8d98edd35, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:22.336472 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345bea5b-364a-4caa-be40-724a3cb79b8b admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:22.355223 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abca98-1bcf-493c-bdd5-77bbfe4081e5 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:22.356917 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-60abca98-1bcf-493c-bdd5-77bbfe4081e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:22.370208 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abca98-1bcf-493c-bdd5-77bbfe4081e5 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:22.378015 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184febe7-a9f5-4093-8af7-daf11eb73219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:22.378988 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184febe7-a9f5-4093-8af7-daf11eb73219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:22.379238 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184febe7-a9f5-4093-8af7-daf11eb73219 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:22.379414 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184febe7-a9f5-4093-8af7-daf11eb73219 admin admin] PATH_INFO: `/v3/projects/016f36654d1643969d70d98d42da0f29` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:22.380621 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184febe7-a9f5-4093-8af7-daf11eb73219 admin admin] RBAC: Authorizing `identity:delete_project(project_id=016f36654d1643969d70d98d42da0f29)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:22.382613 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184febe7-a9f5-4093-8af7-daf11eb73219 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:22.422298 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1049/2116] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:01:22 2022] PUT /identity/v3/projects/73d2a2e16cb542e39333700e51d0b571/users/c11f540b112b45048f7b57e8d98edd35/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:22.426090 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345bea5b-364a-4caa-be40-724a3cb79b8b admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:22.484345 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345bea5b-364a-4caa-be40-724a3cb79b8b admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:22.489397 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbeb10-4d45-45c6-8ef8-0d87978e99b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:22.490059 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbeb10-4d45-45c6-8ef8-0d87978e99b1 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:22.490341 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbeb10-4d45-45c6-8ef8-0d87978e99b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:22.490615 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbeb10-4d45-45c6-8ef8-0d87978e99b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:22.491350 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efbeb10-4d45-45c6-8ef8-0d87978e99b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:22.492952 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efbeb10-4d45-45c6-8ef8-0d87978e99b1 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:22.503422 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1050/2117] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:01:22.507502 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbeb10-4d45-45c6-8ef8-0d87978e99b1 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:22.517561 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-184febe7-a9f5-4093-8af7-daf11eb73219 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '016f36654d1643969d70d98d42da0f29', 'request_id': 'req-184febe7-a9f5-4093-8af7-daf11eb73219'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:22.518318 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbeb10-4d45-45c6-8ef8-0d87978e99b1 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:22.525305 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-184febe7-a9f5-4093-8af7-daf11eb73219 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '016f36654d1643969d70d98d42da0f29', 'request_id': 'req-184febe7-a9f5-4093-8af7-daf11eb73219'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:22.575193 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb0cb4-73de-408f-b1a6-4af23cb3480b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:22.576072 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb0cb4-73de-408f-b1a6-4af23cb3480b admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:22.576349 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb0cb4-73de-408f-b1a6-4af23cb3480b admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:22.576647 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb0cb4-73de-408f-b1a6-4af23cb3480b admin admin] PATH_INFO: `/v3/projects/73d2a2e16cb542e39333700e51d0b571/users/c11f540b112b45048f7b57e8d98edd35/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:22.579286 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb0cb4-73de-408f-b1a6-4af23cb3480b admin admin] RBAC: Authorizing `identity:create_grant(project_id=73d2a2e16cb542e39333700e51d0b571, user_id=c11f540b112b45048f7b57e8d98edd35, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:22.582101 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb0cb4-73de-408f-b1a6-4af23cb3480b admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:22.592138 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1051/2118] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:01:22 2022] PUT /identity/v3/projects/73d2a2e16cb542e39333700e51d0b571/users/c11f540b112b45048f7b57e8d98edd35/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:01:22.603017 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cd1cc-fa9a-4c1b-a7c8-9b615a6ed85e None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:22.603397 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cd1cc-fa9a-4c1b-a7c8-9b615a6ed85e None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:22.603735 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cd1cc-fa9a-4c1b-a7c8-9b615a6ed85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:22.631539 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-5c1cd1cc-fa9a-4c1b-a7c8-9b615a6ed85e None None] MFA Rules not processed for user `c11f540b112b45048f7b57e8d98edd35`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:22.632757 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-5c1cd1cc-fa9a-4c1b-a7c8-9b615a6ed85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:22.636318 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-184febe7-a9f5-4093-8af7-daf11eb73219 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '016f36654d1643969d70d98d42da0f29', 'request_id': 'req-184febe7-a9f5-4093-8af7-daf11eb73219'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:22.649001 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-184febe7-a9f5-4093-8af7-daf11eb73219 admin admin] The token cache is being invalidate because project 016f36654d1643969d70d98d42da0f29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:01:22.649334 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-184febe7-a9f5-4093-8af7-daf11eb73219 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:22.650206 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-184febe7-a9f5-4093-8af7-daf11eb73219 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:22.651933 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1068/2119] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:01:22 2022] DELETE /identity/v3/projects/016f36654d1643969d70d98d42da0f29 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:01:22.657531 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4937d-7bcd-4548-bbee-a0c360f99042 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:22.657928 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4937d-7bcd-4548-bbee-a0c360f99042 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:22.658565 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4937d-7bcd-4548-bbee-a0c360f99042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:22.677768 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-6ef4937d-7bcd-4548-bbee-a0c360f99042 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:22.679043 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-6ef4937d-7bcd-4548-bbee-a0c360f99042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:22.701867 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1052/2120] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:01:22.711261 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1cd1cc-fa9a-4c1b-a7c8-9b615a6ed85e None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:22.712584 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-5c1cd1cc-fa9a-4c1b-a7c8-9b615a6ed85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:22.739828 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1069/2121] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:22.747518 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf61eb-5eab-4c1c-8c00-3c933bdedf93 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:22.747801 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf61eb-5eab-4c1c-8c00-3c933bdedf93 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:22.748079 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf61eb-5eab-4c1c-8c00-3c933bdedf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:22.768182 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-01cf61eb-5eab-4c1c-8c00-3c933bdedf93 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:22.769528 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-01cf61eb-5eab-4c1c-8c00-3c933bdedf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:22.769717 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1cd1cc-fa9a-4c1b-a7c8-9b615a6ed85e None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:22.773977 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62475b-3ec5-41c4-9863-13b69ac46ec7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:22.774622 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62475b-3ec5-41c4-9863-13b69ac46ec7 service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:22.774906 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62475b-3ec5-41c4-9863-13b69ac46ec7 service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:22.780996 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62475b-3ec5-41c4-9863-13b69ac46ec7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:22.781117 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1070/2122] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:22.783861 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf61eb-5eab-4c1c-8c00-3c933bdedf93 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:22.784610 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62475b-3ec5-41c4-9863-13b69ac46ec7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:22.786075 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62475b-3ec5-41c4-9863-13b69ac46ec7 service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:22.793335 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf61eb-5eab-4c1c-8c00-3c933bdedf93 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:22.796280 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1053/2123] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:01:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 15:01:22.798812 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318db93-28d8-40f0-9d3f-3286eeb96d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:22.799461 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318db93-28d8-40f0-9d3f-3286eeb96d46 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:22.799745 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318db93-28d8-40f0-9d3f-3286eeb96d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:22.800483 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318db93-28d8-40f0-9d3f-3286eeb96d46 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:22.800827 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318db93-28d8-40f0-9d3f-3286eeb96d46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:01:22.801171 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318db93-28d8-40f0-9d3f-3286eeb96d46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:22.802793 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318db93-28d8-40f0-9d3f-3286eeb96d46 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:22.818975 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1071/2124] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 15:01:22.823426 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62475b-3ec5-41c4-9863-13b69ac46ec7 service cinder] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:22.835835 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62475b-3ec5-41c4-9863-13b69ac46ec7 service cinder] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:22.840945 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1f7f0-67d0-433a-ab14-aec58ae20d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:22.841688 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1f7f0-67d0-433a-ab14-aec58ae20d81 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:22.842108 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1f7f0-67d0-433a-ab14-aec58ae20d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:22.842505 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1f7f0-67d0-433a-ab14-aec58ae20d81 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:22.843286 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1f7f0-67d0-433a-ab14-aec58ae20d81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:22.845400 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1f7f0-67d0-433a-ab14-aec58ae20d81 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:23.012902 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1054/2125] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:01:22 2022] POST /identity/v3/projects => generated 373 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:01:23.017115 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318db93-28d8-40f0-9d3f-3286eeb96d46 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:23.027680 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318db93-28d8-40f0-9d3f-3286eeb96d46 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:23.095572 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc8a95-c92a-4539-8e9f-972804cc3688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:23.096247 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc8a95-c92a-4539-8e9f-972804cc3688 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:23.096535 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc8a95-c92a-4539-8e9f-972804cc3688 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:23.096813 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc8a95-c92a-4539-8e9f-972804cc3688 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:23.099069 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc8a95-c92a-4539-8e9f-972804cc3688 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:23.099827 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc8a95-c92a-4539-8e9f-972804cc3688 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:23.203752 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1072/2126] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:01:23 2022] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:01:23.210203 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1f7f0-67d0-433a-ab14-aec58ae20d81 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:23.220434 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1f7f0-67d0-433a-ab14-aec58ae20d81 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:23.225135 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847afef-2edb-4cb7-ba34-9064f37a8aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:23.225788 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847afef-2edb-4cb7-ba34-9064f37a8aee admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:23.226089 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847afef-2edb-4cb7-ba34-9064f37a8aee admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:23.226345 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847afef-2edb-4cb7-ba34-9064f37a8aee admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:23.227076 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847afef-2edb-4cb7-ba34-9064f37a8aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:23.228646 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847afef-2edb-4cb7-ba34-9064f37a8aee admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:23.239666 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1055/2127] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:01:23.250795 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc8a95-c92a-4539-8e9f-972804cc3688 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:23.260515 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc8a95-c92a-4539-8e9f-972804cc3688 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:23.266051 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273dd3e-a796-4af6-8a4a-89e1338fb5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:23.266707 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273dd3e-a796-4af6-8a4a-89e1338fb5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:23.266999 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273dd3e-a796-4af6-8a4a-89e1338fb5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:23.267262 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273dd3e-a796-4af6-8a4a-89e1338fb5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:23.267996 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273dd3e-a796-4af6-8a4a-89e1338fb5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:23.269765 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273dd3e-a796-4af6-8a4a-89e1338fb5f7 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:23.283910 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1073/2128] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:01:23.285111 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847afef-2edb-4cb7-ba34-9064f37a8aee admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:23.294757 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847afef-2edb-4cb7-ba34-9064f37a8aee admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:23.299449 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e96d6a-1b0e-40e1-a5c1-f7a41f9b7697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:23.300454 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e96d6a-1b0e-40e1-a5c1-f7a41f9b7697 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:23.305158 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e96d6a-1b0e-40e1-a5c1-f7a41f9b7697 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:23.305158 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e96d6a-1b0e-40e1-a5c1-f7a41f9b7697 admin admin] PATH_INFO: `/v3/projects/cee6a8a08db34ab4999e8deca906b74d/users/441adc92afbb487d89e72a5c76318a4f/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:23.316107 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e96d6a-1b0e-40e1-a5c1-f7a41f9b7697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cee6a8a08db34ab4999e8deca906b74d, user_id=441adc92afbb487d89e72a5c76318a4f, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:23.318830 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e96d6a-1b0e-40e1-a5c1-f7a41f9b7697 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:23.408033 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273dd3e-a796-4af6-8a4a-89e1338fb5f7 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:23.409747 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-3273dd3e-a796-4af6-8a4a-89e1338fb5f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:23.422798 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273dd3e-a796-4af6-8a4a-89e1338fb5f7 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:23.428509 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3cb4f-abb5-42c9-a7ee-35092c80f2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:23.429116 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3cb4f-abb5-42c9-a7ee-35092c80f2fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:23.429403 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3cb4f-abb5-42c9-a7ee-35092c80f2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:23.429681 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3cb4f-abb5-42c9-a7ee-35092c80f2fc admin admin] PATH_INFO: `/v3/users/04daf066768e483d8b46e59ad5b4b7b5` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:23.430870 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1056/2129] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:01:23 2022] PUT /identity/v3/projects/cee6a8a08db34ab4999e8deca906b74d/users/441adc92afbb487d89e72a5c76318a4f/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:23.430999 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a3cb4f-abb5-42c9-a7ee-35092c80f2fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=04daf066768e483d8b46e59ad5b4b7b5)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:23.433107 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a3cb4f-abb5-42c9-a7ee-35092c80f2fc admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:23.441752 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808100ec-0dea-4f18-8605-da1632709789 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:23.442047 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808100ec-0dea-4f18-8605-da1632709789 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:23.442325 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808100ec-0dea-4f18-8605-da1632709789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:23.467846 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-808100ec-0dea-4f18-8605-da1632709789 None None] MFA Rules not processed for user `441adc92afbb487d89e72a5c76318a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:23.469095 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-808100ec-0dea-4f18-8605-da1632709789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:23.530938 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1057/2130] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:01:23.535281 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808100ec-0dea-4f18-8605-da1632709789 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:23.593882 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808100ec-0dea-4f18-8605-da1632709789 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:23.599211 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f944a51-f570-4292-bb5d-4cf80d631601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:23.599864 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f944a51-f570-4292-bb5d-4cf80d631601 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:23.600144 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f944a51-f570-4292-bb5d-4cf80d631601 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:23.600466 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f944a51-f570-4292-bb5d-4cf80d631601 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:23.601353 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f944a51-f570-4292-bb5d-4cf80d631601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:23.603282 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f944a51-f570-4292-bb5d-4cf80d631601 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:23.632571 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-70a3cb4f-abb5-42c9-a7ee-35092c80f2fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04daf066768e483d8b46e59ad5b4b7b5'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:23.639330 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-70a3cb4f-abb5-42c9-a7ee-35092c80f2fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04daf066768e483d8b46e59ad5b4b7b5'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:23.640001 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-70a3cb4f-abb5-42c9-a7ee-35092c80f2fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04daf066768e483d8b46e59ad5b4b7b5'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:23.640620 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-70a3cb4f-abb5-42c9-a7ee-35092c80f2fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04daf066768e483d8b46e59ad5b4b7b5'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:23.739040 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-70a3cb4f-abb5-42c9-a7ee-35092c80f2fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04daf066768e483d8b46e59ad5b4b7b5'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:23.746608 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1058/2131] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:01:23 2022] POST /identity/v3/projects => generated 373 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:01:23.750878 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f944a51-f570-4292-bb5d-4cf80d631601 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:23.752851 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-3f944a51-f570-4292-bb5d-4cf80d631601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:23.775493 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1074/2132] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:01:23 2022] DELETE /identity/v3/users/04daf066768e483d8b46e59ad5b4b7b5 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:01:23.781932 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d1912-3d74-466e-93d5-9307889d2831 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:23.782619 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d1912-3d74-466e-93d5-9307889d2831 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:23.783458 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d1912-3d74-466e-93d5-9307889d2831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:23.808548 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-e16d1912-3d74-466e-93d5-9307889d2831 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:23.810645 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-e16d1912-3d74-466e-93d5-9307889d2831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:23.829362 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f944a51-f570-4292-bb5d-4cf80d631601 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:23.889286 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d97ab7-eebc-4eeb-bed3-a2bfb7f21a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:23.890390 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d97ab7-eebc-4eeb-bed3-a2bfb7f21a50 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:23.891340 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d97ab7-eebc-4eeb-bed3-a2bfb7f21a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:23.891575 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d97ab7-eebc-4eeb-bed3-a2bfb7f21a50 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:23.893160 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d97ab7-eebc-4eeb-bed3-a2bfb7f21a50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:23.897230 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d97ab7-eebc-4eeb-bed3-a2bfb7f21a50 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:23.924333 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1075/2133] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:01:23.945110 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d1912-3d74-466e-93d5-9307889d2831 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:23.946527 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-e16d1912-3d74-466e-93d5-9307889d2831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:24.007239 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d1912-3d74-466e-93d5-9307889d2831 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:24.011676 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db2558-d2c6-4498-a8ff-3e43bf822d13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:24.012534 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db2558-d2c6-4498-a8ff-3e43bf822d13 service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:24.013183 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db2558-d2c6-4498-a8ff-3e43bf822d13 service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:24.013651 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db2558-d2c6-4498-a8ff-3e43bf822d13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:24.023541 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db2558-d2c6-4498-a8ff-3e43bf822d13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:24.025108 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db2558-d2c6-4498-a8ff-3e43bf822d13 service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:24.037099 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1076/2134] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:01:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 15:01:24.109807 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1059/2135] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:01:23 2022] POST /identity/v3/users => generated 293 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:01:24.111025 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db2558-d2c6-4498-a8ff-3e43bf822d13 service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:24.121997 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db2558-d2c6-4498-a8ff-3e43bf822d13 service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:24.130192 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc21360-ea9d-4fcc-8d85-a89ab89da44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:24.133222 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc21360-ea9d-4fcc-8d85-a89ab89da44b admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:24.133553 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc21360-ea9d-4fcc-8d85-a89ab89da44b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:24.133867 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc21360-ea9d-4fcc-8d85-a89ab89da44b admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:24.134618 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc21360-ea9d-4fcc-8d85-a89ab89da44b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:24.136339 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc21360-ea9d-4fcc-8d85-a89ab89da44b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:24.148382 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1077/2136] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:01:24.154909 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d97ab7-eebc-4eeb-bed3-a2bfb7f21a50 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:24.167407 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d97ab7-eebc-4eeb-bed3-a2bfb7f21a50 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:24.172264 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44980d56-fa8b-46fa-aa5d-7c6157efc456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:24.175350 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44980d56-fa8b-46fa-aa5d-7c6157efc456 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:24.175350 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44980d56-fa8b-46fa-aa5d-7c6157efc456 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:24.175350 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44980d56-fa8b-46fa-aa5d-7c6157efc456 admin admin] PATH_INFO: `/v3/projects/9278506791944d4489b47ee7995297a6/users/c6e712a012a44b94a16934a64358ade8/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:24.188362 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44980d56-fa8b-46fa-aa5d-7c6157efc456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9278506791944d4489b47ee7995297a6, user_id=c6e712a012a44b94a16934a64358ade8, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:24.191050 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44980d56-fa8b-46fa-aa5d-7c6157efc456 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:24.290097 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1060/2137] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:01:24 2022] PUT /identity/v3/projects/9278506791944d4489b47ee7995297a6/users/c6e712a012a44b94a16934a64358ade8/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:24.291847 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc21360-ea9d-4fcc-8d85-a89ab89da44b admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:24.303802 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc21360-ea9d-4fcc-8d85-a89ab89da44b admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:24.360502 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01e2a5-4cc9-4503-a6af-96a7a456411c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:24.361200 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01e2a5-4cc9-4503-a6af-96a7a456411c admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:24.361487 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01e2a5-4cc9-4503-a6af-96a7a456411c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:24.361765 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01e2a5-4cc9-4503-a6af-96a7a456411c admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:24.362505 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01e2a5-4cc9-4503-a6af-96a7a456411c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:24.364118 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01e2a5-4cc9-4503-a6af-96a7a456411c admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:24.374367 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1078/2138] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:01:24.378504 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44980d56-fa8b-46fa-aa5d-7c6157efc456 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:24.388997 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44980d56-fa8b-46fa-aa5d-7c6157efc456 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:24.393761 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be6fcd-8e82-482a-bfc5-42aa9b91b1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:24.394643 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be6fcd-8e82-482a-bfc5-42aa9b91b1f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:24.394922 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be6fcd-8e82-482a-bfc5-42aa9b91b1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:24.395194 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be6fcd-8e82-482a-bfc5-42aa9b91b1f7 admin admin] PATH_INFO: `/v3/projects/9278506791944d4489b47ee7995297a6/users/c6e712a012a44b94a16934a64358ade8/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:24.397552 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be6fcd-8e82-482a-bfc5-42aa9b91b1f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9278506791944d4489b47ee7995297a6, user_id=c6e712a012a44b94a16934a64358ade8, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:24.400193 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be6fcd-8e82-482a-bfc5-42aa9b91b1f7 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:24.422623 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1061/2139] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:01:24 2022] PUT /identity/v3/projects/9278506791944d4489b47ee7995297a6/users/c6e712a012a44b94a16934a64358ade8/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:24.434133 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46626c5f-8e0c-480f-95d1-2eba4118a852 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:24.434732 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46626c5f-8e0c-480f-95d1-2eba4118a852 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:24.434732 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46626c5f-8e0c-480f-95d1-2eba4118a852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:24.460903 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-46626c5f-8e0c-480f-95d1-2eba4118a852 None None] MFA Rules not processed for user `c6e712a012a44b94a16934a64358ade8`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:24.462150 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-46626c5f-8e0c-480f-95d1-2eba4118a852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:24.506940 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be6fcd-8e82-482a-bfc5-42aa9b91b1f7 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:24.508697 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-94be6fcd-8e82-482a-bfc5-42aa9b91b1f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:24.546619 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1079/2140] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:24 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:24.556512 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46626c5f-8e0c-480f-95d1-2eba4118a852 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:24.558134 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-46626c5f-8e0c-480f-95d1-2eba4118a852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:24.591824 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be6fcd-8e82-482a-bfc5-42aa9b91b1f7 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:24.598022 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99f112-5c31-43d6-a730-babb72facac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:24.598902 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99f112-5c31-43d6-a730-babb72facac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:24.599216 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99f112-5c31-43d6-a730-babb72facac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:24.599501 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99f112-5c31-43d6-a730-babb72facac0 admin admin] PATH_INFO: `/v3/projects/6b22c92de24249429ee3c736f0fe1447` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:24.600723 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99f112-5c31-43d6-a730-babb72facac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b22c92de24249429ee3c736f0fe1447)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:24.602938 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99f112-5c31-43d6-a730-babb72facac0 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:24.619632 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46626c5f-8e0c-480f-95d1-2eba4118a852 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:24.625699 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cca31-da6f-4f4b-956b-7989d363c04b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:24.626502 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cca31-da6f-4f4b-956b-7989d363c04b service cinder] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:24.627397 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cca31-da6f-4f4b-956b-7989d363c04b service cinder] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:24.627698 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cca31-da6f-4f4b-956b-7989d363c04b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:24.641998 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22cca31-da6f-4f4b-956b-7989d363c04b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:24.643660 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22cca31-da6f-4f4b-956b-7989d363c04b service cinder] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:24.656792 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1080/2141] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:01:24 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 15:01:24.720203 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-be99f112-5c31-43d6-a730-babb72facac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b22c92de24249429ee3c736f0fe1447', 'request_id': 'req-be99f112-5c31-43d6-a730-babb72facac0'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:24.726070 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-be99f112-5c31-43d6-a730-babb72facac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b22c92de24249429ee3c736f0fe1447', 'request_id': 'req-be99f112-5c31-43d6-a730-babb72facac0'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:24.731491 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-be99f112-5c31-43d6-a730-babb72facac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b22c92de24249429ee3c736f0fe1447', 'request_id': 'req-be99f112-5c31-43d6-a730-babb72facac0'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:24.818781 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-be99f112-5c31-43d6-a730-babb72facac0 admin admin] The token cache is being invalidate because project 6b22c92de24249429ee3c736f0fe1447 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:01:24.819054 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-be99f112-5c31-43d6-a730-babb72facac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:24.819686 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-be99f112-5c31-43d6-a730-babb72facac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:24.821292 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1062/2142] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:01:24 2022] DELETE /identity/v3/projects/6b22c92de24249429ee3c736f0fe1447 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:01:24.825423 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cca31-da6f-4f4b-956b-7989d363c04b service cinder] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:24.836494 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cca31-da6f-4f4b-956b-7989d363c04b service cinder] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:24.895034 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b9ae2-8fe3-40f7-8ea9-7aedb425f44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:24.896002 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b9ae2-8fe3-40f7-8ea9-7aedb425f44e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:24.896291 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b9ae2-8fe3-40f7-8ea9-7aedb425f44e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:24.896566 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b9ae2-8fe3-40f7-8ea9-7aedb425f44e admin admin] PATH_INFO: `/v3/users/c11f540b112b45048f7b57e8d98edd35` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:24.898058 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b9ae2-8fe3-40f7-8ea9-7aedb425f44e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c11f540b112b45048f7b57e8d98edd35)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:24.900074 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b9ae2-8fe3-40f7-8ea9-7aedb425f44e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:25.207406 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-388b9ae2-8fe3-40f7-8ea9-7aedb425f44e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c11f540b112b45048f7b57e8d98edd35'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:25.214349 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-388b9ae2-8fe3-40f7-8ea9-7aedb425f44e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c11f540b112b45048f7b57e8d98edd35'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:25.215020 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-388b9ae2-8fe3-40f7-8ea9-7aedb425f44e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c11f540b112b45048f7b57e8d98edd35'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:25.215619 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-388b9ae2-8fe3-40f7-8ea9-7aedb425f44e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c11f540b112b45048f7b57e8d98edd35'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:25.321684 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-388b9ae2-8fe3-40f7-8ea9-7aedb425f44e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c11f540b112b45048f7b57e8d98edd35'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:25.339298 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1081/2143] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:01:24 2022] DELETE /identity/v3/users/c11f540b112b45048f7b57e8d98edd35 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:25.569681 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99f112-5c31-43d6-a730-babb72facac0 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:25.571236 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-be99f112-5c31-43d6-a730-babb72facac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:25.597170 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99f112-5c31-43d6-a730-babb72facac0 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:25.652255 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3f51e-2dfc-41c5-bb6c-6f3ffbbc621d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:25.653160 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3f51e-2dfc-41c5-bb6c-6f3ffbbc621d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:25.653447 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3f51e-2dfc-41c5-bb6c-6f3ffbbc621d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:25.653730 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3f51e-2dfc-41c5-bb6c-6f3ffbbc621d admin admin] PATH_INFO: `/v3/users/441adc92afbb487d89e72a5c76318a4f` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:25.655019 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3f51e-2dfc-41c5-bb6c-6f3ffbbc621d admin admin] RBAC: Authorizing `identity:delete_user(user_id=441adc92afbb487d89e72a5c76318a4f)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:25.657670 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3f51e-2dfc-41c5-bb6c-6f3ffbbc621d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:25.775095 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b9ae2-8fe3-40f7-8ea9-7aedb425f44e admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:25.776676 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-388b9ae2-8fe3-40f7-8ea9-7aedb425f44e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:25.790351 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b9ae2-8fe3-40f7-8ea9-7aedb425f44e admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:25.795873 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57dbc6b-91dc-4f06-8db1-07c93c2b614d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:25.796867 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57dbc6b-91dc-4f06-8db1-07c93c2b614d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:25.797300 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57dbc6b-91dc-4f06-8db1-07c93c2b614d admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:25.797585 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57dbc6b-91dc-4f06-8db1-07c93c2b614d admin admin] PATH_INFO: `/v3/projects/73d2a2e16cb542e39333700e51d0b571` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:25.798792 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57dbc6b-91dc-4f06-8db1-07c93c2b614d admin admin] RBAC: Authorizing `identity:delete_project(project_id=73d2a2e16cb542e39333700e51d0b571)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:25.801224 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57dbc6b-91dc-4f06-8db1-07c93c2b614d admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:25.889972 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-b2c3f51e-2dfc-41c5-bb6c-6f3ffbbc621d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '441adc92afbb487d89e72a5c76318a4f'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:25.896462 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-b2c3f51e-2dfc-41c5-bb6c-6f3ffbbc621d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '441adc92afbb487d89e72a5c76318a4f'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:25.897158 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-b2c3f51e-2dfc-41c5-bb6c-6f3ffbbc621d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '441adc92afbb487d89e72a5c76318a4f'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:25.924898 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a57dbc6b-91dc-4f06-8db1-07c93c2b614d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73d2a2e16cb542e39333700e51d0b571', 'request_id': 'req-a57dbc6b-91dc-4f06-8db1-07c93c2b614d'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:25.931269 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a57dbc6b-91dc-4f06-8db1-07c93c2b614d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73d2a2e16cb542e39333700e51d0b571', 'request_id': 'req-a57dbc6b-91dc-4f06-8db1-07c93c2b614d'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:25.953884 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-b2c3f51e-2dfc-41c5-bb6c-6f3ffbbc621d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '441adc92afbb487d89e72a5c76318a4f'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:25.966556 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-b2c3f51e-2dfc-41c5-bb6c-6f3ffbbc621d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '441adc92afbb487d89e72a5c76318a4f'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:25.973330 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1063/2144] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:01:25 2022] DELETE /identity/v3/users/441adc92afbb487d89e72a5c76318a4f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:25.977701 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48375e2-14db-4fe8-91d9-f80e9684ad5e None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:25.977994 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48375e2-14db-4fe8-91d9-f80e9684ad5e None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:25.978277 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48375e2-14db-4fe8-91d9-f80e9684ad5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:26.002105 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-f48375e2-14db-4fe8-91d9-f80e9684ad5e None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:26.002105 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-f48375e2-14db-4fe8-91d9-f80e9684ad5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:26.072819 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1064/2145] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:01:26.083099 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48375e2-14db-4fe8-91d9-f80e9684ad5e None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:26.084755 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-f48375e2-14db-4fe8-91d9-f80e9684ad5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:26.094019 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a57dbc6b-91dc-4f06-8db1-07c93c2b614d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73d2a2e16cb542e39333700e51d0b571', 'request_id': 'req-a57dbc6b-91dc-4f06-8db1-07c93c2b614d'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:26.102381 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a57dbc6b-91dc-4f06-8db1-07c93c2b614d admin admin] The token cache is being invalidate because project 73d2a2e16cb542e39333700e51d0b571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:01:26.102678 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a57dbc6b-91dc-4f06-8db1-07c93c2b614d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:26.103320 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a57dbc6b-91dc-4f06-8db1-07c93c2b614d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:26.105369 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1082/2146] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:01:25 2022] DELETE /identity/v3/projects/73d2a2e16cb542e39333700e51d0b571 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:01:26.110866 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c0f73-e463-4fa2-8610-a027e1c554b6 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:26.111421 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c0f73-e463-4fa2-8610-a027e1c554b6 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:26.111852 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c0f73-e463-4fa2-8610-a027e1c554b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:26.131476 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-e07c0f73-e463-4fa2-8610-a027e1c554b6 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:26.132926 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-e07c0f73-e463-4fa2-8610-a027e1c554b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:26.148457 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1083/2147] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:01:26.151218 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a27b18-9b1b-42fa-87c0-c24902174913 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:26.151585 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a27b18-9b1b-42fa-87c0-c24902174913 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:26.152111 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a27b18-9b1b-42fa-87c0-c24902174913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:26.163994 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48375e2-14db-4fe8-91d9-f80e9684ad5e None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:26.170819 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473244a-9405-4f74-97a5-14e66bb204f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:26.171560 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473244a-9405-4f74-97a5-14e66bb204f4 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:26.179511 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473244a-9405-4f74-97a5-14e66bb204f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:26.179511 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473244a-9405-4f74-97a5-14e66bb204f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:26.179511 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-1473244a-9405-4f74-97a5-14e66bb204f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:26.179805 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-a1a27b18-9b1b-42fa-87c0-c24902174913 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:26.179805 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-a1a27b18-9b1b-42fa-87c0-c24902174913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:26.189861 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473244a-9405-4f74-97a5-14e66bb204f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:26.192969 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1084/2148] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:26.199277 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473244a-9405-4f74-97a5-14e66bb204f4 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:26.202740 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a27b18-9b1b-42fa-87c0-c24902174913 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:26.229958 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1065/2149] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:01:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:01:26.234167 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a27b18-9b1b-42fa-87c0-c24902174913 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:26.239274 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb8d84-5620-4985-8278-597cdceab3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:26.240098 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb8d84-5620-4985-8278-597cdceab3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:26.240381 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb8d84-5620-4985-8278-597cdceab3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:26.240655 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb8d84-5620-4985-8278-597cdceab3d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:26.241427 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb8d84-5620-4985-8278-597cdceab3d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:01:26.241727 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb8d84-5620-4985-8278-597cdceab3d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:26.243606 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb8d84-5620-4985-8278-597cdceab3d7 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:26.256818 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1085/2150] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 15:01:26.261808 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473244a-9405-4f74-97a5-14e66bb204f4 service neutron] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:26.274484 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473244a-9405-4f74-97a5-14e66bb204f4 service neutron] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:26.279737 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837c150-6574-476b-b2f7-4a881e3e7d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:26.280511 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837c150-6574-476b-b2f7-4a881e3e7d63 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:26.280989 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837c150-6574-476b-b2f7-4a881e3e7d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:26.281395 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837c150-6574-476b-b2f7-4a881e3e7d63 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:26.282351 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837c150-6574-476b-b2f7-4a881e3e7d63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:26.284402 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837c150-6574-476b-b2f7-4a881e3e7d63 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:26.407936 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1066/2151] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:01:26 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:01:26.412152 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb8d84-5620-4985-8278-597cdceab3d7 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:26.423906 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb8d84-5620-4985-8278-597cdceab3d7 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:26.513160 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fcb58-edf6-4d86-a507-a1c5f775b350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:26.514142 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fcb58-edf6-4d86-a507-a1c5f775b350 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:26.514763 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fcb58-edf6-4d86-a507-a1c5f775b350 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:26.514763 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fcb58-edf6-4d86-a507-a1c5f775b350 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:26.527000 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670fcb58-edf6-4d86-a507-a1c5f775b350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:26.528974 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670fcb58-edf6-4d86-a507-a1c5f775b350 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:26.659858 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1086/2152] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:01:26 2022] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:01:26.664024 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837c150-6574-476b-b2f7-4a881e3e7d63 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:26.675285 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837c150-6574-476b-b2f7-4a881e3e7d63 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:26.679904 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44cb30-427b-4986-b2cc-76cb2c84544c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:26.680634 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44cb30-427b-4986-b2cc-76cb2c84544c admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:26.680916 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44cb30-427b-4986-b2cc-76cb2c84544c admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:26.681218 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44cb30-427b-4986-b2cc-76cb2c84544c admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:26.682131 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a44cb30-427b-4986-b2cc-76cb2c84544c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:26.683945 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a44cb30-427b-4986-b2cc-76cb2c84544c admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:26.695855 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1067/2153] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:01:26.699955 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fcb58-edf6-4d86-a507-a1c5f775b350 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:26.711337 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fcb58-edf6-4d86-a507-a1c5f775b350 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:26.716173 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040942d-06dc-4c51-93ef-53753476769e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:26.716890 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040942d-06dc-4c51-93ef-53753476769e admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:26.717241 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040942d-06dc-4c51-93ef-53753476769e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:26.717518 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040942d-06dc-4c51-93ef-53753476769e admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:26.718303 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040942d-06dc-4c51-93ef-53753476769e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:26.719897 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040942d-06dc-4c51-93ef-53753476769e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:26.730562 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1087/2154] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:01:26.735158 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44cb30-427b-4986-b2cc-76cb2c84544c admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:26.745279 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44cb30-427b-4986-b2cc-76cb2c84544c admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:26.750472 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7006dc5-325a-4c31-b74c-975e537c3f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:26.751367 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7006dc5-325a-4c31-b74c-975e537c3f6a admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:26.751650 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7006dc5-325a-4c31-b74c-975e537c3f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:26.751928 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7006dc5-325a-4c31-b74c-975e537c3f6a admin admin] PATH_INFO: `/v3/projects/a487c7af07d6446bbccd2bd4e56119bd/users/ed0f1f3b43e74caea3b8eefc27aaf665/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:26.763398 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040942d-06dc-4c51-93ef-53753476769e admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:26.765325 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-c040942d-06dc-4c51-93ef-53753476769e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:26.769950 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7006dc5-325a-4c31-b74c-975e537c3f6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a487c7af07d6446bbccd2bd4e56119bd, user_id=ed0f1f3b43e74caea3b8eefc27aaf665, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:26.772716 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7006dc5-325a-4c31-b74c-975e537c3f6a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:26.787282 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040942d-06dc-4c51-93ef-53753476769e admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:26.802458 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204bc4b0-8e62-485b-aa1a-1675a2ef782e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:26.803328 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bc4b0-8e62-485b-aa1a-1675a2ef782e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:26.803616 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bc4b0-8e62-485b-aa1a-1675a2ef782e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:26.803893 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bc4b0-8e62-485b-aa1a-1675a2ef782e admin admin] PATH_INFO: `/v3/projects/cee6a8a08db34ab4999e8deca906b74d` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:26.805155 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204bc4b0-8e62-485b-aa1a-1675a2ef782e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cee6a8a08db34ab4999e8deca906b74d)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:26.807130 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204bc4b0-8e62-485b-aa1a-1675a2ef782e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:26.850842 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1068/2155] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:01:26 2022] PUT /identity/v3/projects/a487c7af07d6446bbccd2bd4e56119bd/users/ed0f1f3b43e74caea3b8eefc27aaf665/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:26.862094 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebc02c-f788-4330-a3a5-827615a98eae None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:26.862387 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebc02c-f788-4330-a3a5-827615a98eae None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:26.862669 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebc02c-f788-4330-a3a5-827615a98eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:26.887630 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-84ebc02c-f788-4330-a3a5-827615a98eae None None] MFA Rules not processed for user `ed0f1f3b43e74caea3b8eefc27aaf665`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:26.888757 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-84ebc02c-f788-4330-a3a5-827615a98eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:26.950438 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1069/2156] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:01:26.960313 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ebc02c-f788-4330-a3a5-827615a98eae None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:26.963540 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-84ebc02c-f788-4330-a3a5-827615a98eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:26.985715 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-204bc4b0-8e62-485b-aa1a-1675a2ef782e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cee6a8a08db34ab4999e8deca906b74d', 'request_id': 'req-204bc4b0-8e62-485b-aa1a-1675a2ef782e'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:26.992601 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-204bc4b0-8e62-485b-aa1a-1675a2ef782e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cee6a8a08db34ab4999e8deca906b74d', 'request_id': 'req-204bc4b0-8e62-485b-aa1a-1675a2ef782e'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:27.020990 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ebc02c-f788-4330-a3a5-827615a98eae None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:27.067887 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a2c31-5dce-4031-81e0-b6a7d0437e6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:27.068689 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a2c31-5dce-4031-81e0-b6a7d0437e6d service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:27.068932 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a2c31-5dce-4031-81e0-b6a7d0437e6d service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:27.069239 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a2c31-5dce-4031-81e0-b6a7d0437e6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:27.124495 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a2c31-5dce-4031-81e0-b6a7d0437e6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:27.126028 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a2c31-5dce-4031-81e0-b6a7d0437e6d service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:27.134635 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1070/2157] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:01:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 15:01:27.142257 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-204bc4b0-8e62-485b-aa1a-1675a2ef782e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cee6a8a08db34ab4999e8deca906b74d', 'request_id': 'req-204bc4b0-8e62-485b-aa1a-1675a2ef782e'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:27.150455 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-204bc4b0-8e62-485b-aa1a-1675a2ef782e admin admin] The token cache is being invalidate because project cee6a8a08db34ab4999e8deca906b74d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:01:27.150744 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-204bc4b0-8e62-485b-aa1a-1675a2ef782e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:27.151483 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-204bc4b0-8e62-485b-aa1a-1675a2ef782e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:27.153080 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1088/2158] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:01:26 2022] DELETE /identity/v3/projects/cee6a8a08db34ab4999e8deca906b74d => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:01:27.158166 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a2c31-5dce-4031-81e0-b6a7d0437e6d service cinder] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:27.158693 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204bc4b0-8e62-485b-aa1a-1675a2ef782e admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:27.160771 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-204bc4b0-8e62-485b-aa1a-1675a2ef782e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:27.222928 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a2c31-5dce-4031-81e0-b6a7d0437e6d service cinder] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:27.227599 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779044b-e847-4385-9bab-1c9ba0d70481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:27.228496 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779044b-e847-4385-9bab-1c9ba0d70481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:27.228771 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779044b-e847-4385-9bab-1c9ba0d70481 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:27.229039 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779044b-e847-4385-9bab-1c9ba0d70481 admin admin] PATH_INFO: `/v3/users/c6e712a012a44b94a16934a64358ade8` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:27.230719 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779044b-e847-4385-9bab-1c9ba0d70481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6e712a012a44b94a16934a64358ade8)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:27.231945 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204bc4b0-8e62-485b-aa1a-1675a2ef782e admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:27.232749 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779044b-e847-4385-9bab-1c9ba0d70481 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:27.236796 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fd7b6-2a8b-4c5b-ae65-92664db9fa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:27.237698 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fd7b6-2a8b-4c5b-ae65-92664db9fa08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:27.237982 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fd7b6-2a8b-4c5b-ae65-92664db9fa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:27.239602 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fd7b6-2a8b-4c5b-ae65-92664db9fa08 admin admin] PATH_INFO: `/v3/users/ed0f1f3b43e74caea3b8eefc27aaf665` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:27.239602 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fd7b6-2a8b-4c5b-ae65-92664db9fa08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed0f1f3b43e74caea3b8eefc27aaf665)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:27.241571 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fd7b6-2a8b-4c5b-ae65-92664db9fa08 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:27.488913 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4779044b-e847-4385-9bab-1c9ba0d70481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6e712a012a44b94a16934a64358ade8'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:27.497207 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-7e3fd7b6-2a8b-4c5b-ae65-92664db9fa08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed0f1f3b43e74caea3b8eefc27aaf665'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:27.499100 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4779044b-e847-4385-9bab-1c9ba0d70481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6e712a012a44b94a16934a64358ade8'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:27.499978 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4779044b-e847-4385-9bab-1c9ba0d70481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6e712a012a44b94a16934a64358ade8'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:27.512886 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-7e3fd7b6-2a8b-4c5b-ae65-92664db9fa08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed0f1f3b43e74caea3b8eefc27aaf665'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:27.513885 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-7e3fd7b6-2a8b-4c5b-ae65-92664db9fa08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed0f1f3b43e74caea3b8eefc27aaf665'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:27.514934 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-7e3fd7b6-2a8b-4c5b-ae65-92664db9fa08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed0f1f3b43e74caea3b8eefc27aaf665'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:27.636541 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4779044b-e847-4385-9bab-1c9ba0d70481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6e712a012a44b94a16934a64358ade8'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:27.650192 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4779044b-e847-4385-9bab-1c9ba0d70481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6e712a012a44b94a16934a64358ade8'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:27.656347 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1071/2159] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:01:27 2022] DELETE /identity/v3/users/c6e712a012a44b94a16934a64358ade8 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:27.770999 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-7e3fd7b6-2a8b-4c5b-ae65-92664db9fa08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed0f1f3b43e74caea3b8eefc27aaf665'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:27.795076 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1089/2160] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:01:27 2022] DELETE /identity/v3/users/ed0f1f3b43e74caea3b8eefc27aaf665 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:27.799822 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151b13e-1a24-4da9-9193-e64e1bf96781 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:27.800232 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151b13e-1a24-4da9-9193-e64e1bf96781 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:27.800384 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151b13e-1a24-4da9-9193-e64e1bf96781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:27.819599 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-1151b13e-1a24-4da9-9193-e64e1bf96781 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:27.820792 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-1151b13e-1a24-4da9-9193-e64e1bf96781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:27.888190 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1072/2161] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:01:27.896410 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fd7b6-2a8b-4c5b-ae65-92664db9fa08 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:27.898125 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-7e3fd7b6-2a8b-4c5b-ae65-92664db9fa08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:27.976161 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fd7b6-2a8b-4c5b-ae65-92664db9fa08 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:27.980248 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bae661-d73a-45a3-afaf-bc2a6185965f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:27.980889 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bae661-d73a-45a3-afaf-bc2a6185965f service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:27.981216 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bae661-d73a-45a3-afaf-bc2a6185965f service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:27.981496 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bae661-d73a-45a3-afaf-bc2a6185965f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:27.991765 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bae661-d73a-45a3-afaf-bc2a6185965f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:28.001123 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bae661-d73a-45a3-afaf-bc2a6185965f service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:28.005239 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1090/2162] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:01:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:01:28.292905 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151b13e-1a24-4da9-9193-e64e1bf96781 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:28.294456 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-1151b13e-1a24-4da9-9193-e64e1bf96781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:28.309335 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151b13e-1a24-4da9-9193-e64e1bf96781 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:28.332495 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4704ce2-67c0-46de-b934-e0bbb402f2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:28.338974 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4704ce2-67c0-46de-b934-e0bbb402f2a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:28.339164 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4704ce2-67c0-46de-b934-e0bbb402f2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:28.339453 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4704ce2-67c0-46de-b934-e0bbb402f2a0 admin admin] PATH_INFO: `/v3/projects/9278506791944d4489b47ee7995297a6` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:28.346947 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4704ce2-67c0-46de-b934-e0bbb402f2a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9278506791944d4489b47ee7995297a6)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:28.348932 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4704ce2-67c0-46de-b934-e0bbb402f2a0 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:28.568880 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-f4704ce2-67c0-46de-b934-e0bbb402f2a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9278506791944d4489b47ee7995297a6', 'request_id': 'req-f4704ce2-67c0-46de-b934-e0bbb402f2a0'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:28.577688 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-f4704ce2-67c0-46de-b934-e0bbb402f2a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9278506791944d4489b47ee7995297a6', 'request_id': 'req-f4704ce2-67c0-46de-b934-e0bbb402f2a0'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:28.583526 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-f4704ce2-67c0-46de-b934-e0bbb402f2a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9278506791944d4489b47ee7995297a6', 'request_id': 'req-f4704ce2-67c0-46de-b934-e0bbb402f2a0'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:28.638059 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bae661-d73a-45a3-afaf-bc2a6185965f service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:28.640293 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-c9bae661-d73a-45a3-afaf-bc2a6185965f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:28.667335 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bae661-d73a-45a3-afaf-bc2a6185965f service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:28.695096 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-f4704ce2-67c0-46de-b934-e0bbb402f2a0 admin admin] The token cache is being invalidate because project 9278506791944d4489b47ee7995297a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:01:28.695096 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-f4704ce2-67c0-46de-b934-e0bbb402f2a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:28.695096 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-f4704ce2-67c0-46de-b934-e0bbb402f2a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:28.697097 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1073/2163] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:01:28 2022] DELETE /identity/v3/projects/9278506791944d4489b47ee7995297a6 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:28.704044 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd95590-131a-467b-9224-645565fbe1db None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:28.704044 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd95590-131a-467b-9224-645565fbe1db None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:28.704044 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd95590-131a-467b-9224-645565fbe1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:28.727398 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-fdd95590-131a-467b-9224-645565fbe1db None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:28.728603 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-fdd95590-131a-467b-9224-645565fbe1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:28.745281 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ca56b-1c90-438d-b03a-2444a6bafc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:28.746493 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ca56b-1c90-438d-b03a-2444a6bafc6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:28.746924 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ca56b-1c90-438d-b03a-2444a6bafc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:28.747368 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ca56b-1c90-438d-b03a-2444a6bafc6c admin admin] PATH_INFO: `/v3/projects/a487c7af07d6446bbccd2bd4e56119bd` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:28.757231 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ca56b-1c90-438d-b03a-2444a6bafc6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a487c7af07d6446bbccd2bd4e56119bd)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:28.759549 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ca56b-1c90-438d-b03a-2444a6bafc6c admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:28.811136 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1074/2164] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:28.819088 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1fd52-f2b3-463d-983c-3aead7d63c8b None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:28.819468 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1fd52-f2b3-463d-983c-3aead7d63c8b None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:28.819745 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1fd52-f2b3-463d-983c-3aead7d63c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:28.839221 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-7ce1fd52-f2b3-463d-983c-3aead7d63c8b None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:28.840467 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-7ce1fd52-f2b3-463d-983c-3aead7d63c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:28.849468 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1075/2165] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:01:28.853346 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1fd52-f2b3-463d-983c-3aead7d63c8b None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:28.862911 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1fd52-f2b3-463d-983c-3aead7d63c8b None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:28.878497 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-4c1ca56b-1c90-438d-b03a-2444a6bafc6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a487c7af07d6446bbccd2bd4e56119bd', 'request_id': 'req-4c1ca56b-1c90-438d-b03a-2444a6bafc6c'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:28.886172 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-4c1ca56b-1c90-438d-b03a-2444a6bafc6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a487c7af07d6446bbccd2bd4e56119bd', 'request_id': 'req-4c1ca56b-1c90-438d-b03a-2444a6bafc6c'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:28.923605 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5bb073-e347-400f-892b-fb627b226c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:28.924272 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bb073-e347-400f-892b-fb627b226c6e admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:28.924559 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bb073-e347-400f-892b-fb627b226c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:28.924899 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bb073-e347-400f-892b-fb627b226c6e admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:28.925712 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5bb073-e347-400f-892b-fb627b226c6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:01:28.926020 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5bb073-e347-400f-892b-fb627b226c6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:28.927609 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5bb073-e347-400f-892b-fb627b226c6e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:28.940786 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1076/2166] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 15:01:28.944898 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5bb073-e347-400f-892b-fb627b226c6e admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:28.955416 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5bb073-e347-400f-892b-fb627b226c6e admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:28.960251 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2b8ae-b3ba-4a80-a278-5cf6ad6fcb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:28.961003 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2b8ae-b3ba-4a80-a278-5cf6ad6fcb6a admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:28.961365 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2b8ae-b3ba-4a80-a278-5cf6ad6fcb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:28.961637 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2b8ae-b3ba-4a80-a278-5cf6ad6fcb6a admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:28.962339 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2b8ae-b3ba-4a80-a278-5cf6ad6fcb6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:28.964398 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2b8ae-b3ba-4a80-a278-5cf6ad6fcb6a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:28.987657 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-4c1ca56b-1c90-438d-b03a-2444a6bafc6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a487c7af07d6446bbccd2bd4e56119bd', 'request_id': 'req-4c1ca56b-1c90-438d-b03a-2444a6bafc6c'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:29.002151 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-4c1ca56b-1c90-438d-b03a-2444a6bafc6c admin admin] The token cache is being invalidate because project a487c7af07d6446bbccd2bd4e56119bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:01:29.002554 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-4c1ca56b-1c90-438d-b03a-2444a6bafc6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:29.003423 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-4c1ca56b-1c90-438d-b03a-2444a6bafc6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:29.005122 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1091/2167] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:01:28 2022] DELETE /identity/v3/projects/a487c7af07d6446bbccd2bd4e56119bd => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:29.010475 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ee0bf-9ddc-43c6-8981-ea7e60da3989 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:29.010760 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ee0bf-9ddc-43c6-8981-ea7e60da3989 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:29.011034 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ee0bf-9ddc-43c6-8981-ea7e60da3989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:29.032104 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-154ee0bf-9ddc-43c6-8981-ea7e60da3989 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:29.033338 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-154ee0bf-9ddc-43c6-8981-ea7e60da3989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:29.041497 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1092/2168] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:01:29.050370 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb6086-33c1-4f9e-a05c-533b9f776eb5 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:29.050693 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb6086-33c1-4f9e-a05c-533b9f776eb5 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:29.050986 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb6086-33c1-4f9e-a05c-533b9f776eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:29.070750 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-02fb6086-33c1-4f9e-a05c-533b9f776eb5 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:29.071930 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-02fb6086-33c1-4f9e-a05c-533b9f776eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:29.080398 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1093/2169] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:01:29.084356 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb6086-33c1-4f9e-a05c-533b9f776eb5 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:29.093578 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb6086-33c1-4f9e-a05c-533b9f776eb5 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:29.098819 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b80811-53f6-4a89-9997-7d391bfbaf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:29.099621 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b80811-53f6-4a89-9997-7d391bfbaf8e admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:29.099996 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b80811-53f6-4a89-9997-7d391bfbaf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:29.100369 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b80811-53f6-4a89-9997-7d391bfbaf8e admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:29.101272 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b80811-53f6-4a89-9997-7d391bfbaf8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:01:29.101675 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b80811-53f6-4a89-9997-7d391bfbaf8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:29.103432 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b80811-53f6-4a89-9997-7d391bfbaf8e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:29.116336 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1094/2170] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 15:01:29.120971 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b80811-53f6-4a89-9997-7d391bfbaf8e admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:29.131653 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b80811-53f6-4a89-9997-7d391bfbaf8e admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:29.135086 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1077/2171] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:01:28 2022] POST /identity/v3/projects => generated 367 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:01:29.136459 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39a8e3-2b98-409f-8c6b-977d5c33b007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:29.137201 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39a8e3-2b98-409f-8c6b-977d5c33b007 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:29.137489 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39a8e3-2b98-409f-8c6b-977d5c33b007 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:29.137764 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39a8e3-2b98-409f-8c6b-977d5c33b007 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:29.138461 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39a8e3-2b98-409f-8c6b-977d5c33b007 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:29.139745 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2b8ae-b3ba-4a80-a278-5cf6ad6fcb6a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:29.141161 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39a8e3-2b98-409f-8c6b-977d5c33b007 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:29.141411 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-b7d2b8ae-b3ba-4a80-a278-5cf6ad6fcb6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:29.205807 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2b8ae-b3ba-4a80-a278-5cf6ad6fcb6a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:29.210562 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfae79-3fe1-42ed-9d76-963edd0ad0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:29.211227 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfae79-3fe1-42ed-9d76-963edd0ad0cc admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:29.211508 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfae79-3fe1-42ed-9d76-963edd0ad0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:29.211781 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfae79-3fe1-42ed-9d76-963edd0ad0cc admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:29.212481 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfae79-3fe1-42ed-9d76-963edd0ad0cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:29.214450 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfae79-3fe1-42ed-9d76-963edd0ad0cc admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:29.262409 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1095/2172] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:01:29 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:01:29.266672 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39a8e3-2b98-409f-8c6b-977d5c33b007 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:29.331658 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39a8e3-2b98-409f-8c6b-977d5c33b007 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:29.335689 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1078/2173] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:01:29 2022] POST /identity/v3/users => generated 284 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:01:29.337072 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb2219-eb51-4096-b338-dcca81b81940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:29.339479 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb2219-eb51-4096-b338-dcca81b81940 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:29.339479 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb2219-eb51-4096-b338-dcca81b81940 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:29.339479 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb2219-eb51-4096-b338-dcca81b81940 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:29.339479 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb2219-eb51-4096-b338-dcca81b81940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:29.340737 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfae79-3fe1-42ed-9d76-963edd0ad0cc admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:29.340982 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb2219-eb51-4096-b338-dcca81b81940 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:29.351994 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfae79-3fe1-42ed-9d76-963edd0ad0cc admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:29.357258 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff0910-1425-4cdc-88ff-da05d1fcca58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:29.358653 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff0910-1425-4cdc-88ff-da05d1fcca58 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:29.358946 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff0910-1425-4cdc-88ff-da05d1fcca58 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:29.359220 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff0910-1425-4cdc-88ff-da05d1fcca58 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:29.359952 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff0910-1425-4cdc-88ff-da05d1fcca58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:29.362298 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff0910-1425-4cdc-88ff-da05d1fcca58 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:29.372293 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1079/2174] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:01:29.376877 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff0910-1425-4cdc-88ff-da05d1fcca58 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:29.386881 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff0910-1425-4cdc-88ff-da05d1fcca58 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:29.392069 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261736b-ca81-43ff-a45f-3f4c6fe40c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:29.392713 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261736b-ca81-43ff-a45f-3f4c6fe40c48 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:29.392988 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261736b-ca81-43ff-a45f-3f4c6fe40c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:29.393289 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261736b-ca81-43ff-a45f-3f4c6fe40c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:29.394019 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261736b-ca81-43ff-a45f-3f4c6fe40c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:29.395616 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261736b-ca81-43ff-a45f-3f4c6fe40c48 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:29.406250 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1080/2175] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:01:29.410268 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261736b-ca81-43ff-a45f-3f4c6fe40c48 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:29.419908 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261736b-ca81-43ff-a45f-3f4c6fe40c48 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:29.425505 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e954f-ea81-409b-81ff-8563e9a9e696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:29.426379 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e954f-ea81-409b-81ff-8563e9a9e696 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:29.426657 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e954f-ea81-409b-81ff-8563e9a9e696 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:29.426929 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e954f-ea81-409b-81ff-8563e9a9e696 admin admin] PATH_INFO: `/v3/projects/38de823882b746189a785073b9ce0481/users/26ff5b3293fb4d69a803b2cc6cbb8dd1/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:29.431133 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1096/2176] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:01:29 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:01:29.435049 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb2219-eb51-4096-b338-dcca81b81940 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:29.449106 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb2219-eb51-4096-b338-dcca81b81940 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:29.454566 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e954f-ea81-409b-81ff-8563e9a9e696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38de823882b746189a785073b9ce0481, user_id=26ff5b3293fb4d69a803b2cc6cbb8dd1, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:29.455606 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80444dd-8a95-46c2-8613-d2ebbde7ee3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:29.456331 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80444dd-8a95-46c2-8613-d2ebbde7ee3c admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:29.456555 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80444dd-8a95-46c2-8613-d2ebbde7ee3c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:29.456831 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80444dd-8a95-46c2-8613-d2ebbde7ee3c admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:29.457371 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e954f-ea81-409b-81ff-8563e9a9e696 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:29.457759 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80444dd-8a95-46c2-8613-d2ebbde7ee3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:29.459685 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80444dd-8a95-46c2-8613-d2ebbde7ee3c admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:29.484736 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1097/2177] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:01:29.489275 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80444dd-8a95-46c2-8613-d2ebbde7ee3c admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:29.500237 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80444dd-8a95-46c2-8613-d2ebbde7ee3c admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:29.512922 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aae198-e803-4d11-99b6-d7785f00a5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:29.513634 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aae198-e803-4d11-99b6-d7785f00a5e7 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:29.513903 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aae198-e803-4d11-99b6-d7785f00a5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:29.514822 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aae198-e803-4d11-99b6-d7785f00a5e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:29.515840 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aae198-e803-4d11-99b6-d7785f00a5e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:29.517276 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aae198-e803-4d11-99b6-d7785f00a5e7 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:29.528149 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1098/2178] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:01:29.533128 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aae198-e803-4d11-99b6-d7785f00a5e7 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:29.543447 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aae198-e803-4d11-99b6-d7785f00a5e7 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:29.548433 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4744e-7a3f-4c9c-8868-f2a49f45913b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:29.549351 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4744e-7a3f-4c9c-8868-f2a49f45913b admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:29.549672 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4744e-7a3f-4c9c-8868-f2a49f45913b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:29.549931 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4744e-7a3f-4c9c-8868-f2a49f45913b admin admin] PATH_INFO: `/v3/projects/6a0a02799a494b62b05cbded51442335/users/b7288c96489d41a0b821a2a7c158a338/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:29.569427 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4744e-7a3f-4c9c-8868-f2a49f45913b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a0a02799a494b62b05cbded51442335, user_id=b7288c96489d41a0b821a2a7c158a338, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:29.572204 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4744e-7a3f-4c9c-8868-f2a49f45913b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:29.573517 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1081/2179] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:01:29 2022] PUT /identity/v3/projects/38de823882b746189a785073b9ce0481/users/26ff5b3293fb4d69a803b2cc6cbb8dd1/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:01:29.584003 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f51cf-2770-4f5f-984d-b0b33e369e2d None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:29.584317 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f51cf-2770-4f5f-984d-b0b33e369e2d None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:29.584652 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f51cf-2770-4f5f-984d-b0b33e369e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:29.611594 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-fc4f51cf-2770-4f5f-984d-b0b33e369e2d None None] MFA Rules not processed for user `26ff5b3293fb4d69a803b2cc6cbb8dd1`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:29.612874 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-fc4f51cf-2770-4f5f-984d-b0b33e369e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:29.672340 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1099/2180] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:01:29 2022] PUT /identity/v3/projects/6a0a02799a494b62b05cbded51442335/users/b7288c96489d41a0b821a2a7c158a338/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:01:29.675317 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1082/2181] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:01:29.682436 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ed364-8970-4842-8996-aad01f6a754d None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:29.682888 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ed364-8970-4842-8996-aad01f6a754d None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:29.683364 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ed364-8970-4842-8996-aad01f6a754d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:29.685013 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f51cf-2770-4f5f-984d-b0b33e369e2d None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:29.709958 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-546ed364-8970-4842-8996-aad01f6a754d None None] MFA Rules not processed for user `b7288c96489d41a0b821a2a7c158a338`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:29.711067 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-546ed364-8970-4842-8996-aad01f6a754d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:29.746341 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f51cf-2770-4f5f-984d-b0b33e369e2d None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:29.775610 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1100/2182] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:01:29.787172 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ed364-8970-4842-8996-aad01f6a754d None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:29.788496 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-546ed364-8970-4842-8996-aad01f6a754d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:29.800197 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0046e21-3a36-4343-b47c-c989715d0ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:29.800866 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0046e21-3a36-4343-b47c-c989715d0ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:29.801179 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0046e21-3a36-4343-b47c-c989715d0ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:29.801464 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0046e21-3a36-4343-b47c-c989715d0ce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:29.802164 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0046e21-3a36-4343-b47c-c989715d0ce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:29.804056 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0046e21-3a36-4343-b47c-c989715d0ce8 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:29.845892 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ed364-8970-4842-8996-aad01f6a754d None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:29.849615 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0df347-3813-47d8-8052-209fe6b98a26 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935ad716e4624c25bc34308f05eb1526', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:29.850257 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0df347-3813-47d8-8052-209fe6b98a26 service glance] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:29.850538 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0df347-3813-47d8-8052-209fe6b98a26 service glance] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:29.850811 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0df347-3813-47d8-8052-209fe6b98a26 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:29.860800 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0df347-3813-47d8-8052-209fe6b98a26 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:29.869253 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0df347-3813-47d8-8052-209fe6b98a26 service glance] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:29.875364 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1101/2183] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:01:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:01:29.909984 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1083/2184] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:01:29 2022] POST /identity/v3/projects => generated 369 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:01:29.910768 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0df347-3813-47d8-8052-209fe6b98a26 service glance] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:29.924928 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0df347-3813-47d8-8052-209fe6b98a26 service glance] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:29.991603 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b45ea-5b89-462d-a7cf-475b4e307ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:29.992290 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b45ea-5b89-462d-a7cf-475b4e307ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:29.992560 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b45ea-5b89-462d-a7cf-475b4e307ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:29.992842 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b45ea-5b89-462d-a7cf-475b4e307ca6 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:29.993761 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b45ea-5b89-462d-a7cf-475b4e307ca6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:29.996007 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b45ea-5b89-462d-a7cf-475b4e307ca6 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:30.132316 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1102/2185] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:01:29 2022] POST /identity/v3/users => generated 291 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:01:30.136745 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0046e21-3a36-4343-b47c-c989715d0ce8 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:30.153428 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0046e21-3a36-4343-b47c-c989715d0ce8 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:30.158291 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2789b-4e33-41fb-aaff-2d8b6ece6851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:30.159056 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2789b-4e33-41fb-aaff-2d8b6ece6851 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:30.159384 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2789b-4e33-41fb-aaff-2d8b6ece6851 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:30.159728 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2789b-4e33-41fb-aaff-2d8b6ece6851 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:30.160577 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2789b-4e33-41fb-aaff-2d8b6ece6851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:30.162382 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2789b-4e33-41fb-aaff-2d8b6ece6851 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:30.174076 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1084/2186] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:01:30.178659 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b45ea-5b89-462d-a7cf-475b4e307ca6 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:30.189617 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b45ea-5b89-462d-a7cf-475b4e307ca6 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:30.194296 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6b53e-34e0-48c5-b1e5-082bb564c27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:30.195175 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6b53e-34e0-48c5-b1e5-082bb564c27c admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:30.195459 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6b53e-34e0-48c5-b1e5-082bb564c27c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:30.195735 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6b53e-34e0-48c5-b1e5-082bb564c27c admin admin] PATH_INFO: `/v3/projects/1ee5a235c76548639d48b0b23f444ebb/users/e40533f4dc0e4ea08ded781f2e992dd8/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:30.211227 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6b53e-34e0-48c5-b1e5-082bb564c27c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ee5a235c76548639d48b0b23f444ebb, user_id=e40533f4dc0e4ea08ded781f2e992dd8, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:30.213997 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6b53e-34e0-48c5-b1e5-082bb564c27c admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:30.317820 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1103/2187] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:01:30 2022] PUT /identity/v3/projects/1ee5a235c76548639d48b0b23f444ebb/users/e40533f4dc0e4ea08ded781f2e992dd8/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:30.321908 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2789b-4e33-41fb-aaff-2d8b6ece6851 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:30.332428 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2789b-4e33-41fb-aaff-2d8b6ece6851 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:30.388075 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4ffb1-a3f4-4f38-b86d-cd69b475a413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:30.388732 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4ffb1-a3f4-4f38-b86d-cd69b475a413 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:30.389012 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4ffb1-a3f4-4f38-b86d-cd69b475a413 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:30.389314 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4ffb1-a3f4-4f38-b86d-cd69b475a413 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:30.390039 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4ffb1-a3f4-4f38-b86d-cd69b475a413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:30.391699 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4ffb1-a3f4-4f38-b86d-cd69b475a413 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:30.401049 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1085/2188] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:01:30.405651 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6b53e-34e0-48c5-b1e5-082bb564c27c admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:30.416337 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6b53e-34e0-48c5-b1e5-082bb564c27c admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:30.421605 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7e679-363b-4d5e-a403-f68526532dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:30.422472 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7e679-363b-4d5e-a403-f68526532dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:30.422762 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7e679-363b-4d5e-a403-f68526532dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:30.423039 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7e679-363b-4d5e-a403-f68526532dcc admin admin] PATH_INFO: `/v3/projects/1ee5a235c76548639d48b0b23f444ebb/users/e40533f4dc0e4ea08ded781f2e992dd8/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:30.425055 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7e679-363b-4d5e-a403-f68526532dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ee5a235c76548639d48b0b23f444ebb, user_id=e40533f4dc0e4ea08ded781f2e992dd8, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:30.428233 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7e679-363b-4d5e-a403-f68526532dcc admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:30.440754 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1104/2189] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:01:30 2022] PUT /identity/v3/projects/1ee5a235c76548639d48b0b23f444ebb/users/e40533f4dc0e4ea08ded781f2e992dd8/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:30.452149 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3bd3a9-e4f0-4672-8f64-acb17b83b6bc None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:30.452512 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3bd3a9-e4f0-4672-8f64-acb17b83b6bc None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:30.452798 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3bd3a9-e4f0-4672-8f64-acb17b83b6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:30.478178 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-5c3bd3a9-e4f0-4672-8f64-acb17b83b6bc None None] MFA Rules not processed for user `e40533f4dc0e4ea08ded781f2e992dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:30.479294 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-5c3bd3a9-e4f0-4672-8f64-acb17b83b6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:30.553543 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1086/2190] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:30 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:31.125284 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7e679-363b-4d5e-a403-f68526532dcc admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:31.127165 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-7ea7e679-363b-4d5e-a403-f68526532dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:31.182682 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7e679-363b-4d5e-a403-f68526532dcc admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:31.186270 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05cde63-ba14-42da-886d-89ca43586193 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:31.186887 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cde63-ba14-42da-886d-89ca43586193 service cinder] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:31.187175 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cde63-ba14-42da-886d-89ca43586193 service cinder] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:31.187464 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cde63-ba14-42da-886d-89ca43586193 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:31.196242 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05cde63-ba14-42da-886d-89ca43586193 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:31.197718 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05cde63-ba14-42da-886d-89ca43586193 service cinder] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:31.207514 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1105/2191] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:01:31 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:01:35.039495 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3bd3a9-e4f0-4672-8f64-acb17b83b6bc None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:35.142655 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3bd3a9-e4f0-4672-8f64-acb17b83b6bc None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:35.147233 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e218f2e-2898-4476-b5c5-9fee73bf88c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:35.148098 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e218f2e-2898-4476-b5c5-9fee73bf88c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:35.148380 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e218f2e-2898-4476-b5c5-9fee73bf88c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:35.148655 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e218f2e-2898-4476-b5c5-9fee73bf88c1 admin admin] PATH_INFO: `/v3/users/26ff5b3293fb4d69a803b2cc6cbb8dd1` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:35.149915 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e218f2e-2898-4476-b5c5-9fee73bf88c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26ff5b3293fb4d69a803b2cc6cbb8dd1)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:35.151864 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e218f2e-2898-4476-b5c5-9fee73bf88c1 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:35.385673 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-1e218f2e-2898-4476-b5c5-9fee73bf88c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26ff5b3293fb4d69a803b2cc6cbb8dd1'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:35.395199 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-1e218f2e-2898-4476-b5c5-9fee73bf88c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26ff5b3293fb4d69a803b2cc6cbb8dd1'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:35.396155 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-1e218f2e-2898-4476-b5c5-9fee73bf88c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26ff5b3293fb4d69a803b2cc6cbb8dd1'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:35.498472 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-1e218f2e-2898-4476-b5c5-9fee73bf88c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26ff5b3293fb4d69a803b2cc6cbb8dd1'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:35.513869 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-1e218f2e-2898-4476-b5c5-9fee73bf88c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26ff5b3293fb4d69a803b2cc6cbb8dd1'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:35.519916 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1087/2192] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:01:35 2022] DELETE /identity/v3/users/26ff5b3293fb4d69a803b2cc6cbb8dd1 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:35.524506 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e0705-02f0-4864-a7b9-b8c90258211a None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:35.525084 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e0705-02f0-4864-a7b9-b8c90258211a None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:35.525193 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e0705-02f0-4864-a7b9-b8c90258211a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:35.574667 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-7c7e0705-02f0-4864-a7b9-b8c90258211a None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:35.575923 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-7c7e0705-02f0-4864-a7b9-b8c90258211a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:35.639560 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1106/2193] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:35.650358 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e218f2e-2898-4476-b5c5-9fee73bf88c1 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:35.651920 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-1e218f2e-2898-4476-b5c5-9fee73bf88c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:35.754263 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e218f2e-2898-4476-b5c5-9fee73bf88c1 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:35.757929 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3206cf-f008-4774-8237-e28b759f1425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:35.758575 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3206cf-f008-4774-8237-e28b759f1425 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:35.758858 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3206cf-f008-4774-8237-e28b759f1425 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:35.759136 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3206cf-f008-4774-8237-e28b759f1425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:35.768406 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3206cf-f008-4774-8237-e28b759f1425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:35.769870 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3206cf-f008-4774-8237-e28b759f1425 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:35.779551 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1088/2194] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:01:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:01:36.546844 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e0705-02f0-4864-a7b9-b8c90258211a None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:36.548658 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-7c7e0705-02f0-4864-a7b9-b8c90258211a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:36.572494 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e0705-02f0-4864-a7b9-b8c90258211a None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:36.579929 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53135b-0002-4bbd-a888-e65b17f89168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:36.580990 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53135b-0002-4bbd-a888-e65b17f89168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:36.581413 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53135b-0002-4bbd-a888-e65b17f89168 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:36.581753 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53135b-0002-4bbd-a888-e65b17f89168 admin admin] PATH_INFO: `/v3/projects/38de823882b746189a785073b9ce0481` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:36.583080 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53135b-0002-4bbd-a888-e65b17f89168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38de823882b746189a785073b9ce0481)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:36.586376 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53135b-0002-4bbd-a888-e65b17f89168 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:36.719688 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-1f53135b-0002-4bbd-a888-e65b17f89168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38de823882b746189a785073b9ce0481', 'request_id': 'req-1f53135b-0002-4bbd-a888-e65b17f89168'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:36.726346 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-1f53135b-0002-4bbd-a888-e65b17f89168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38de823882b746189a785073b9ce0481', 'request_id': 'req-1f53135b-0002-4bbd-a888-e65b17f89168'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:36.839544 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-1f53135b-0002-4bbd-a888-e65b17f89168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38de823882b746189a785073b9ce0481', 'request_id': 'req-1f53135b-0002-4bbd-a888-e65b17f89168'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:36.852421 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-1f53135b-0002-4bbd-a888-e65b17f89168 admin admin] The token cache is being invalidate because project 38de823882b746189a785073b9ce0481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:01:36.852721 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-1f53135b-0002-4bbd-a888-e65b17f89168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:36.853394 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-1f53135b-0002-4bbd-a888-e65b17f89168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:36.855852 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1107/2195] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:01:36 2022] DELETE /identity/v3/projects/38de823882b746189a785073b9ce0481 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:36.860456 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3206cf-f008-4774-8237-e28b759f1425 service neutron] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:36.869994 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3206cf-f008-4774-8237-e28b759f1425 service neutron] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:36.924621 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6ffc5-16c4-4297-8dcd-c7bf4e44e532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:36.925527 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6ffc5-16c4-4297-8dcd-c7bf4e44e532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:36.925814 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6ffc5-16c4-4297-8dcd-c7bf4e44e532 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:36.926090 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6ffc5-16c4-4297-8dcd-c7bf4e44e532 admin admin] PATH_INFO: `/v3/users/e40533f4dc0e4ea08ded781f2e992dd8` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:36.927281 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6ffc5-16c4-4297-8dcd-c7bf4e44e532 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e40533f4dc0e4ea08ded781f2e992dd8)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:36.929234 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6ffc5-16c4-4297-8dcd-c7bf4e44e532 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:37.195817 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-70b6ffc5-16c4-4297-8dcd-c7bf4e44e532 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e40533f4dc0e4ea08ded781f2e992dd8'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:37.202676 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-70b6ffc5-16c4-4297-8dcd-c7bf4e44e532 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e40533f4dc0e4ea08ded781f2e992dd8'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:37.203347 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-70b6ffc5-16c4-4297-8dcd-c7bf4e44e532 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e40533f4dc0e4ea08ded781f2e992dd8'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:37.299224 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-70b6ffc5-16c4-4297-8dcd-c7bf4e44e532 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e40533f4dc0e4ea08ded781f2e992dd8'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:37.312148 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-70b6ffc5-16c4-4297-8dcd-c7bf4e44e532 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e40533f4dc0e4ea08ded781f2e992dd8'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:37.321331 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1089/2196] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:01:36 2022] DELETE /identity/v3/users/e40533f4dc0e4ea08ded781f2e992dd8 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:01:37.803703 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53135b-0002-4bbd-a888-e65b17f89168 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:37.805242 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-1f53135b-0002-4bbd-a888-e65b17f89168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:37.835258 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53135b-0002-4bbd-a888-e65b17f89168 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:37.904219 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ea3ad-a7d8-4d24-a9c7-a449abdc9140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:37.905217 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ea3ad-a7d8-4d24-a9c7-a449abdc9140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:37.905410 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ea3ad-a7d8-4d24-a9c7-a449abdc9140 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:37.906328 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ea3ad-a7d8-4d24-a9c7-a449abdc9140 admin admin] PATH_INFO: `/v3/projects/1ee5a235c76548639d48b0b23f444ebb` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:37.907581 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ea3ad-a7d8-4d24-a9c7-a449abdc9140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ee5a235c76548639d48b0b23f444ebb)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:37.909656 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ea3ad-a7d8-4d24-a9c7-a449abdc9140 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:38.112339 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c36287-b531-4cfc-b977-0d457007e543 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:38.112874 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c36287-b531-4cfc-b977-0d457007e543 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:38.113107 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c36287-b531-4cfc-b977-0d457007e543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:38.133326 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-41c36287-b531-4cfc-b977-0d457007e543 None None] MFA Rules not processed for user `0669d8dce2d64715948615519bf0eac9`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:38.134575 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-41c36287-b531-4cfc-b977-0d457007e543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:38.166345 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b87ea3ad-a7d8-4d24-a9c7-a449abdc9140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ee5a235c76548639d48b0b23f444ebb', 'request_id': 'req-b87ea3ad-a7d8-4d24-a9c7-a449abdc9140'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:38.175320 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b87ea3ad-a7d8-4d24-a9c7-a449abdc9140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ee5a235c76548639d48b0b23f444ebb', 'request_id': 'req-b87ea3ad-a7d8-4d24-a9c7-a449abdc9140'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:38.197504 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1090/2197] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:01:38.338679 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b87ea3ad-a7d8-4d24-a9c7-a449abdc9140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ee5a235c76548639d48b0b23f444ebb', 'request_id': 'req-b87ea3ad-a7d8-4d24-a9c7-a449abdc9140'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:38.350398 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b87ea3ad-a7d8-4d24-a9c7-a449abdc9140 admin admin] The token cache is being invalidate because project 1ee5a235c76548639d48b0b23f444ebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:01:38.350697 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b87ea3ad-a7d8-4d24-a9c7-a449abdc9140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:38.351641 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b87ea3ad-a7d8-4d24-a9c7-a449abdc9140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:01:38.353088 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1108/2198] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:01:37 2022] DELETE /identity/v3/projects/1ee5a235c76548639d48b0b23f444ebb => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:38.359736 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdabaf0-a2d8-4c7e-ba1a-a593cefb8dda None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:38.360031 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdabaf0-a2d8-4c7e-ba1a-a593cefb8dda None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:38.365612 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdabaf0-a2d8-4c7e-ba1a-a593cefb8dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:38.408155 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-6cdabaf0-a2d8-4c7e-ba1a-a593cefb8dda None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:38.409370 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-6cdabaf0-a2d8-4c7e-ba1a-a593cefb8dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:38.472831 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1091/2199] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:38.480929 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfe836-14bd-4bbb-9a58-239720345ad4 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:38.481258 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfe836-14bd-4bbb-9a58-239720345ad4 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:38.481542 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfe836-14bd-4bbb-9a58-239720345ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:38.500944 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-0ddfe836-14bd-4bbb-9a58-239720345ad4 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:38.502184 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-0ddfe836-14bd-4bbb-9a58-239720345ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:38.510899 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1109/2200] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:38.515339 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdabaf0-a2d8-4c7e-ba1a-a593cefb8dda None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:38.525440 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdabaf0-a2d8-4c7e-ba1a-a593cefb8dda None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:38.532637 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59348082-afbb-44e9-882e-01853170b605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:38.532637 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59348082-afbb-44e9-882e-01853170b605 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:38.532637 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59348082-afbb-44e9-882e-01853170b605 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:38.532637 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59348082-afbb-44e9-882e-01853170b605 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:38.533051 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59348082-afbb-44e9-882e-01853170b605 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:01:38.533051 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59348082-afbb-44e9-882e-01853170b605 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:38.534677 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59348082-afbb-44e9-882e-01853170b605 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:38.546953 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1092/2201] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 15:01:38.551165 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfe836-14bd-4bbb-9a58-239720345ad4 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:38.561108 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfe836-14bd-4bbb-9a58-239720345ad4 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:38.567026 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734c69b-d109-4fa9-8987-96aca3c8eb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:38.568482 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734c69b-d109-4fa9-8987-96aca3c8eb81 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:38.568864 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734c69b-d109-4fa9-8987-96aca3c8eb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:38.569894 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734c69b-d109-4fa9-8987-96aca3c8eb81 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:38.570623 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734c69b-d109-4fa9-8987-96aca3c8eb81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:38.572590 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734c69b-d109-4fa9-8987-96aca3c8eb81 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:38.705101 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1110/2202] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:01:38 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:01:38.705733 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59348082-afbb-44e9-882e-01853170b605 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:38.716805 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59348082-afbb-44e9-882e-01853170b605 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:38.778047 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea94432-bcc4-443b-a617-e5591f6526e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:38.778047 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea94432-bcc4-443b-a617-e5591f6526e0 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:38.778047 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea94432-bcc4-443b-a617-e5591f6526e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:38.778047 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea94432-bcc4-443b-a617-e5591f6526e0 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:38.778541 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea94432-bcc4-443b-a617-e5591f6526e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:38.778683 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea94432-bcc4-443b-a617-e5591f6526e0 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:38.882020 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1093/2203] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:01:38 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:01:38.887965 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734c69b-d109-4fa9-8987-96aca3c8eb81 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:38.900769 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734c69b-d109-4fa9-8987-96aca3c8eb81 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:38.924824 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d6b08-426b-4a66-ba55-a649670cd79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:38.924824 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d6b08-426b-4a66-ba55-a649670cd79d admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:38.924824 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d6b08-426b-4a66-ba55-a649670cd79d admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:38.924824 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d6b08-426b-4a66-ba55-a649670cd79d admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:38.925326 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d6b08-426b-4a66-ba55-a649670cd79d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:38.925326 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d6b08-426b-4a66-ba55-a649670cd79d admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:38.929463 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1111/2204] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:01:38.933522 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea94432-bcc4-443b-a617-e5591f6526e0 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:38.944549 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea94432-bcc4-443b-a617-e5591f6526e0 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:38.949396 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b4423-94b9-40cf-887f-d7731e44f4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:38.950200 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b4423-94b9-40cf-887f-d7731e44f4fe admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:38.950853 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b4423-94b9-40cf-887f-d7731e44f4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:38.951131 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b4423-94b9-40cf-887f-d7731e44f4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:38.951980 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b4423-94b9-40cf-887f-d7731e44f4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:38.953785 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b4423-94b9-40cf-887f-d7731e44f4fe admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:38.968963 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1094/2205] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:01:38.970225 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d6b08-426b-4a66-ba55-a649670cd79d admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:38.990932 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d6b08-426b-4a66-ba55-a649670cd79d admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:39.001879 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694141f-9c1d-4911-9b09-e5839c10e973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:39.002762 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694141f-9c1d-4911-9b09-e5839c10e973 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:39.003323 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694141f-9c1d-4911-9b09-e5839c10e973 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:39.003608 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694141f-9c1d-4911-9b09-e5839c10e973 admin admin] PATH_INFO: `/v3/projects/07f202371473497a9f8970497a54ae30/users/9646868fc36b47de927cefc5ec61c12a/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:39.032735 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694141f-9c1d-4911-9b09-e5839c10e973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07f202371473497a9f8970497a54ae30, user_id=9646868fc36b47de927cefc5ec61c12a, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:39.039879 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694141f-9c1d-4911-9b09-e5839c10e973 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:39.127737 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1112/2206] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:01:38 2022] PUT /identity/v3/projects/07f202371473497a9f8970497a54ae30/users/9646868fc36b47de927cefc5ec61c12a/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:01:39.142063 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e5c45-57f9-4bf2-95ee-ec87bea2cc13 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:39.142567 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e5c45-57f9-4bf2-95ee-ec87bea2cc13 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:39.142839 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e5c45-57f9-4bf2-95ee-ec87bea2cc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:39.169470 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-651e5c45-57f9-4bf2-95ee-ec87bea2cc13 None None] MFA Rules not processed for user `9646868fc36b47de927cefc5ec61c12a`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:39.170672 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-651e5c45-57f9-4bf2-95ee-ec87bea2cc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:39.235214 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1095/2207] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:39.239715 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694141f-9c1d-4911-9b09-e5839c10e973 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:39.308077 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694141f-9c1d-4911-9b09-e5839c10e973 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:39.312544 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a91731-9afc-426c-9600-5f080e26a6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:39.313225 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a91731-9afc-426c-9600-5f080e26a6bd admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:39.313511 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a91731-9afc-426c-9600-5f080e26a6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:39.313790 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a91731-9afc-426c-9600-5f080e26a6bd admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:39.314500 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a91731-9afc-426c-9600-5f080e26a6bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:39.316387 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a91731-9afc-426c-9600-5f080e26a6bd admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:39.444667 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1113/2208] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:01:39 2022] POST /identity/v3/projects => generated 377 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:01:39.445846 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e5c45-57f9-4bf2-95ee-ec87bea2cc13 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:39.456918 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e5c45-57f9-4bf2-95ee-ec87bea2cc13 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:39.520840 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ec74b-c859-444a-a868-7c57c1321bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:39.521637 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ec74b-c859-444a-a868-7c57c1321bef admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:39.521990 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ec74b-c859-444a-a868-7c57c1321bef admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:39.522274 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ec74b-c859-444a-a868-7c57c1321bef admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:39.523073 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ec74b-c859-444a-a868-7c57c1321bef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:39.524942 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ec74b-c859-444a-a868-7c57c1321bef admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:39.628604 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1096/2209] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:01:39 2022] POST /identity/v3/users => generated 295 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:01:39.632860 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a91731-9afc-426c-9600-5f080e26a6bd admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:39.648763 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a91731-9afc-426c-9600-5f080e26a6bd admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:39.656114 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cf1cf-4d63-4085-86e0-cc6f062f7f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:39.656953 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cf1cf-4d63-4085-86e0-cc6f062f7f62 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:39.657274 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cf1cf-4d63-4085-86e0-cc6f062f7f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:39.657552 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cf1cf-4d63-4085-86e0-cc6f062f7f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:39.658297 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4cf1cf-4d63-4085-86e0-cc6f062f7f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:39.660098 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4cf1cf-4d63-4085-86e0-cc6f062f7f62 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:39.674688 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1114/2210] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:01:39.676228 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ec74b-c859-444a-a868-7c57c1321bef admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:39.686692 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ec74b-c859-444a-a868-7c57c1321bef admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:39.693337 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4a694-0b53-4bfe-9f28-4bf242a2d585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:39.694364 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4a694-0b53-4bfe-9f28-4bf242a2d585 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:39.694675 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4a694-0b53-4bfe-9f28-4bf242a2d585 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:39.694950 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4a694-0b53-4bfe-9f28-4bf242a2d585 admin admin] PATH_INFO: `/v3/projects/b9b76b14ed96434f91a058f39f1e1355/users/aed74278716f4d15baa32eda5accce6d/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:39.711218 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4a694-0b53-4bfe-9f28-4bf242a2d585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b76b14ed96434f91a058f39f1e1355, user_id=aed74278716f4d15baa32eda5accce6d, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:39.713940 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4a694-0b53-4bfe-9f28-4bf242a2d585 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:39.887502 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1097/2211] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:01:39 2022] PUT /identity/v3/projects/b9b76b14ed96434f91a058f39f1e1355/users/aed74278716f4d15baa32eda5accce6d/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:39.891472 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cf1cf-4d63-4085-86e0-cc6f062f7f62 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:39.901648 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cf1cf-4d63-4085-86e0-cc6f062f7f62 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:39.964722 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf91c85-e852-4391-bd1b-b2b5e1e06eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:39.965448 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf91c85-e852-4391-bd1b-b2b5e1e06eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:39.965727 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf91c85-e852-4391-bd1b-b2b5e1e06eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:39.965997 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf91c85-e852-4391-bd1b-b2b5e1e06eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:39.966735 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf91c85-e852-4391-bd1b-b2b5e1e06eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:39.968350 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf91c85-e852-4391-bd1b-b2b5e1e06eb2 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:39.979106 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1115/2212] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:01:39.983417 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4a694-0b53-4bfe-9f28-4bf242a2d585 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:39.993924 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4a694-0b53-4bfe-9f28-4bf242a2d585 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:39.998506 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b77a32-b155-4d31-b36d-917c17dd9e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:39.999939 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b77a32-b155-4d31-b36d-917c17dd9e17 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:40.000212 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b77a32-b155-4d31-b36d-917c17dd9e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:40.000487 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b77a32-b155-4d31-b36d-917c17dd9e17 admin admin] PATH_INFO: `/v3/projects/b9b76b14ed96434f91a058f39f1e1355/users/aed74278716f4d15baa32eda5accce6d/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:40.002727 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b77a32-b155-4d31-b36d-917c17dd9e17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b76b14ed96434f91a058f39f1e1355, user_id=aed74278716f4d15baa32eda5accce6d, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:40.005049 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b77a32-b155-4d31-b36d-917c17dd9e17 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:40.014886 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1098/2213] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:01:39 2022] PUT /identity/v3/projects/b9b76b14ed96434f91a058f39f1e1355/users/aed74278716f4d15baa32eda5accce6d/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:01:40.024881 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafea5c-d9c0-4026-a4b0-89e55c7addeb None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:40.025838 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafea5c-d9c0-4026-a4b0-89e55c7addeb None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:40.026136 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafea5c-d9c0-4026-a4b0-89e55c7addeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:40.055600 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-7dafea5c-d9c0-4026-a4b0-89e55c7addeb None None] MFA Rules not processed for user `aed74278716f4d15baa32eda5accce6d`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:40.057997 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-7dafea5c-d9c0-4026-a4b0-89e55c7addeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:40.150892 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1116/2214] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:01:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:40.160278 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b77a32-b155-4d31-b36d-917c17dd9e17 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:40.162205 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-85b77a32-b155-4d31-b36d-917c17dd9e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:40.226190 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b77a32-b155-4d31-b36d-917c17dd9e17 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:40.230318 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0a63c-633b-48e6-92a5-dc523b20b98c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:40.230965 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0a63c-633b-48e6-92a5-dc523b20b98c service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:40.231248 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0a63c-633b-48e6-92a5-dc523b20b98c service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:40.231521 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0a63c-633b-48e6-92a5-dc523b20b98c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:40.288182 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0a63c-633b-48e6-92a5-dc523b20b98c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:40.289674 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0a63c-633b-48e6-92a5-dc523b20b98c service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:40.299597 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1099/2215] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:01:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:01:46.713546 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafea5c-d9c0-4026-a4b0-89e55c7addeb None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:46.715015 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-7dafea5c-d9c0-4026-a4b0-89e55c7addeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:46.727584 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafea5c-d9c0-4026-a4b0-89e55c7addeb None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:46.731485 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b33352-5bc3-41a1-a606-e719f21a9b1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:46.732129 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b33352-5bc3-41a1-a606-e719f21a9b1b service cinder] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:46.732412 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b33352-5bc3-41a1-a606-e719f21a9b1b service cinder] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:46.732683 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b33352-5bc3-41a1-a606-e719f21a9b1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:46.742326 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b33352-5bc3-41a1-a606-e719f21a9b1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:46.743820 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b33352-5bc3-41a1-a606-e719f21a9b1b service cinder] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:46.753234 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1117/2216] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:01:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:01:58.489586 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f2dc6-8890-4215-b5bf-18fbbeed9fef None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:58.490066 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f2dc6-8890-4215-b5bf-18fbbeed9fef None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:58.490183 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f2dc6-8890-4215-b5bf-18fbbeed9fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:58.520482 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-0d3f2dc6-8890-4215-b5bf-18fbbeed9fef None None] MFA Rules not processed for user `29314b0be6534c79b36f31402d51d17b`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:01:58.521842 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-0d3f2dc6-8890-4215-b5bf-18fbbeed9fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:58.577625 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1100/2217] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Jan 5 15:01:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:01:58.628559 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b33352-5bc3-41a1-a606-e719f21a9b1b service cinder] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:01:58.628559 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-d8b33352-5bc3-41a1-a606-e719f21a9b1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:01:58.705079 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b33352-5bc3-41a1-a606-e719f21a9b1b service cinder] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:01:58.710119 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da26683-17ee-4dc1-b32d-27a268c30c1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ea13fd3e704b16aad5a38606ddc049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:01:58.710741 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da26683-17ee-4dc1-b32d-27a268c30c1b service swift] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:01:58.711025 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da26683-17ee-4dc1-b32d-27a268c30c1b service swift] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:01:58.711304 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da26683-17ee-4dc1-b32d-27a268c30c1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:01:58.719199 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da26683-17ee-4dc1-b32d-27a268c30c1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:01:58.720794 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da26683-17ee-4dc1-b32d-27a268c30c1b service swift] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:01:58.728634 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1118/2218] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jan 5 15:01:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 15:02:06.566393 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f2dc6-8890-4215-b5bf-18fbbeed9fef None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:06.569386 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-0d3f2dc6-8890-4215-b5bf-18fbbeed9fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:06.651380 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f2dc6-8890-4215-b5bf-18fbbeed9fef None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:06.651380 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d94ec-85cd-452e-95f8-96a54b1289f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:06.651380 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d94ec-85cd-452e-95f8-96a54b1289f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:06.651380 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d94ec-85cd-452e-95f8-96a54b1289f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:06.652105 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d94ec-85cd-452e-95f8-96a54b1289f6 admin admin] PATH_INFO: `/v3/users/b7288c96489d41a0b821a2a7c158a338` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:06.652105 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d94ec-85cd-452e-95f8-96a54b1289f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7288c96489d41a0b821a2a7c158a338)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:06.652105 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d94ec-85cd-452e-95f8-96a54b1289f6 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:06.867384 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-a24d94ec-85cd-452e-95f8-96a54b1289f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7288c96489d41a0b821a2a7c158a338'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:06.874570 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-a24d94ec-85cd-452e-95f8-96a54b1289f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7288c96489d41a0b821a2a7c158a338'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:06.875478 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-a24d94ec-85cd-452e-95f8-96a54b1289f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7288c96489d41a0b821a2a7c158a338'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:06.967279 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-a24d94ec-85cd-452e-95f8-96a54b1289f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7288c96489d41a0b821a2a7c158a338'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:06.983855 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-a24d94ec-85cd-452e-95f8-96a54b1289f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7288c96489d41a0b821a2a7c158a338'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:06.991332 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1101/2219] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:02:06 2022] DELETE /identity/v3/users/b7288c96489d41a0b821a2a7c158a338 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:02:06.999151 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0b338-dab4-4386-ac03-45408eecc156 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:07.000565 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0b338-dab4-4386-ac03-45408eecc156 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:07.001186 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0b338-dab4-4386-ac03-45408eecc156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:07.021682 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-f7a0b338-dab4-4386-ac03-45408eecc156 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:07.023407 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-f7a0b338-dab4-4386-ac03-45408eecc156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:07.119611 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1119/2220] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:02:07.129818 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d94ec-85cd-452e-95f8-96a54b1289f6 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:07.131640 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-a24d94ec-85cd-452e-95f8-96a54b1289f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:07.194069 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d94ec-85cd-452e-95f8-96a54b1289f6 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:07.200055 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4adf2d-43d6-4461-b728-2aa2ac7a6730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:07.200055 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4adf2d-43d6-4461-b728-2aa2ac7a6730 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:07.200055 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4adf2d-43d6-4461-b728-2aa2ac7a6730 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:07.200055 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4adf2d-43d6-4461-b728-2aa2ac7a6730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:07.209603 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4adf2d-43d6-4461-b728-2aa2ac7a6730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:07.211047 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4adf2d-43d6-4461-b728-2aa2ac7a6730 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:07.223169 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1102/2221] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:02:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:02:07.759348 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0b338-dab4-4386-ac03-45408eecc156 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:07.760816 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-f7a0b338-dab4-4386-ac03-45408eecc156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:07.805778 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0b338-dab4-4386-ac03-45408eecc156 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:07.810761 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e26fe-9e0a-43b7-9ae8-2fec5412045d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:07.812383 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e26fe-9e0a-43b7-9ae8-2fec5412045d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:07.812826 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e26fe-9e0a-43b7-9ae8-2fec5412045d admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:07.813295 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e26fe-9e0a-43b7-9ae8-2fec5412045d admin admin] PATH_INFO: `/v3/projects/6a0a02799a494b62b05cbded51442335` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:07.814700 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e26fe-9e0a-43b7-9ae8-2fec5412045d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a0a02799a494b62b05cbded51442335)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:07.817033 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e26fe-9e0a-43b7-9ae8-2fec5412045d admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:07.998618 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-321e26fe-9e0a-43b7-9ae8-2fec5412045d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a0a02799a494b62b05cbded51442335', 'request_id': 'req-321e26fe-9e0a-43b7-9ae8-2fec5412045d'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:08.008550 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-321e26fe-9e0a-43b7-9ae8-2fec5412045d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a0a02799a494b62b05cbded51442335', 'request_id': 'req-321e26fe-9e0a-43b7-9ae8-2fec5412045d'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:08.102423 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-321e26fe-9e0a-43b7-9ae8-2fec5412045d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a0a02799a494b62b05cbded51442335', 'request_id': 'req-321e26fe-9e0a-43b7-9ae8-2fec5412045d'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:08.124746 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-321e26fe-9e0a-43b7-9ae8-2fec5412045d admin admin] The token cache is being invalidate because project 6a0a02799a494b62b05cbded51442335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:02:08.126832 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-321e26fe-9e0a-43b7-9ae8-2fec5412045d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:08.129005 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-321e26fe-9e0a-43b7-9ae8-2fec5412045d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:08.134696 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1120/2222] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:02:07 2022] DELETE /identity/v3/projects/6a0a02799a494b62b05cbded51442335 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:02:08.142601 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef0feb-f444-4e12-86c6-5aa56839de2f None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:08.145485 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef0feb-f444-4e12-86c6-5aa56839de2f None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:08.145881 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef0feb-f444-4e12-86c6-5aa56839de2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:08.179151 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-b7ef0feb-f444-4e12-86c6-5aa56839de2f None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:08.180440 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-b7ef0feb-f444-4e12-86c6-5aa56839de2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:08.275026 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1103/2223] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:02:08.284698 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9c6da-3e96-458d-a7a2-e65c6e64bd0a None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:08.284982 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9c6da-3e96-458d-a7a2-e65c6e64bd0a None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:08.285467 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9c6da-3e96-458d-a7a2-e65c6e64bd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:08.312973 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-37e9c6da-3e96-458d-a7a2-e65c6e64bd0a None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:08.314785 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-37e9c6da-3e96-458d-a7a2-e65c6e64bd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:08.324289 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1121/2224] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:02:08.329836 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef0feb-f444-4e12-86c6-5aa56839de2f None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:08.341435 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef0feb-f444-4e12-86c6-5aa56839de2f None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:08.347516 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b55f4b-1d23-47cd-a016-d79f20f2c3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:08.348293 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b55f4b-1d23-47cd-a016-d79f20f2c3dc admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:08.348623 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b55f4b-1d23-47cd-a016-d79f20f2c3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:08.349162 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b55f4b-1d23-47cd-a016-d79f20f2c3dc admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:08.349681 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b55f4b-1d23-47cd-a016-d79f20f2c3dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:02:08.349990 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b55f4b-1d23-47cd-a016-d79f20f2c3dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:08.351616 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b55f4b-1d23-47cd-a016-d79f20f2c3dc admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:08.369471 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1104/2225] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 15:02:08.371943 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9c6da-3e96-458d-a7a2-e65c6e64bd0a None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:08.381709 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9c6da-3e96-458d-a7a2-e65c6e64bd0a None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:08.387508 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9f7ec-a146-4884-bcb1-54ccbc58401c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:08.388528 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9f7ec-a146-4884-bcb1-54ccbc58401c admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:08.389235 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9f7ec-a146-4884-bcb1-54ccbc58401c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:08.389739 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9f7ec-a146-4884-bcb1-54ccbc58401c admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:08.391274 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9f7ec-a146-4884-bcb1-54ccbc58401c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:08.394178 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9f7ec-a146-4884-bcb1-54ccbc58401c admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:08.548460 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1122/2226] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:02:08 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:02:08.552739 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b55f4b-1d23-47cd-a016-d79f20f2c3dc admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:08.563094 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b55f4b-1d23-47cd-a016-d79f20f2c3dc admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:08.649478 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d8cf7-305a-47ff-9ac4-1523630a04ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:08.649478 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d8cf7-305a-47ff-9ac4-1523630a04ee admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:08.649478 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d8cf7-305a-47ff-9ac4-1523630a04ee admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:08.649478 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d8cf7-305a-47ff-9ac4-1523630a04ee admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:08.649783 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d8cf7-305a-47ff-9ac4-1523630a04ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:08.651369 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d8cf7-305a-47ff-9ac4-1523630a04ee admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:09.547455 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1105/2227] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:02:08 2022] POST /identity/v3/users => generated 292 bytes in 992 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:02:09.548733 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9f7ec-a146-4884-bcb1-54ccbc58401c admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:09.563557 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9f7ec-a146-4884-bcb1-54ccbc58401c admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:09.568520 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89b2c0-4e2b-452f-8b0b-d7bc98491190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:09.569225 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89b2c0-4e2b-452f-8b0b-d7bc98491190 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:09.569537 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89b2c0-4e2b-452f-8b0b-d7bc98491190 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:09.569994 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89b2c0-4e2b-452f-8b0b-d7bc98491190 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:09.570948 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89b2c0-4e2b-452f-8b0b-d7bc98491190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:09.572667 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89b2c0-4e2b-452f-8b0b-d7bc98491190 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:09.583863 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1123/2228] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:02:09.587988 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d8cf7-305a-47ff-9ac4-1523630a04ee admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:09.598338 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d8cf7-305a-47ff-9ac4-1523630a04ee admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:09.602851 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9726f2-c87d-4b10-b9d6-2300b82fbdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:09.603501 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9726f2-c87d-4b10-b9d6-2300b82fbdf2 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:09.603785 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9726f2-c87d-4b10-b9d6-2300b82fbdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:09.604062 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9726f2-c87d-4b10-b9d6-2300b82fbdf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:09.605081 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9726f2-c87d-4b10-b9d6-2300b82fbdf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:09.606757 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9726f2-c87d-4b10-b9d6-2300b82fbdf2 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:09.616898 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1106/2229] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:02:09.620910 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89b2c0-4e2b-452f-8b0b-d7bc98491190 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:09.630965 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89b2c0-4e2b-452f-8b0b-d7bc98491190 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:09.636213 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0fed8-b38d-4d00-aa83-add8104d7b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:09.637260 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0fed8-b38d-4d00-aa83-add8104d7b2c admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:09.637546 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0fed8-b38d-4d00-aa83-add8104d7b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:09.637840 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0fed8-b38d-4d00-aa83-add8104d7b2c admin admin] PATH_INFO: `/v3/projects/b874b608d2c848a88541148e56d2114d/users/036ba058101541b891732f6d9591c876/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:09.656717 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0fed8-b38d-4d00-aa83-add8104d7b2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b874b608d2c848a88541148e56d2114d, user_id=036ba058101541b891732f6d9591c876, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:09.659582 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0fed8-b38d-4d00-aa83-add8104d7b2c admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:09.802638 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1124/2230] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:02:09 2022] PUT /identity/v3/projects/b874b608d2c848a88541148e56d2114d/users/036ba058101541b891732f6d9591c876/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:02:09.808065 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586499e-395c-4727-807c-ea5d173a170c None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:09.812713 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586499e-395c-4727-807c-ea5d173a170c None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:09.812713 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586499e-395c-4727-807c-ea5d173a170c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:09.830978 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-5586499e-395c-4727-807c-ea5d173a170c None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:09.832560 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-5586499e-395c-4727-807c-ea5d173a170c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:09.901748 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1107/2231] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:02:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:02:09.911989 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0fed8-b38d-4d00-aa83-add8104d7b2c admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:09.913964 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-c8e0fed8-b38d-4d00-aa83-add8104d7b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:09.989739 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0fed8-b38d-4d00-aa83-add8104d7b2c admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:09.994019 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bee1ce-d640-407f-8ac1-7cf865775dba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:09.994974 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bee1ce-d640-407f-8ac1-7cf865775dba service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:09.995434 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bee1ce-d640-407f-8ac1-7cf865775dba service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:09.995879 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bee1ce-d640-407f-8ac1-7cf865775dba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:10.017890 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bee1ce-d640-407f-8ac1-7cf865775dba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:10.019644 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bee1ce-d640-407f-8ac1-7cf865775dba service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:10.045137 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1125/2232] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:02:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:02:16.982187 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea9be4-f7b0-4248-9d7c-936f114398fe None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:16.982658 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea9be4-f7b0-4248-9d7c-936f114398fe None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:16.982771 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea9be4-f7b0-4248-9d7c-936f114398fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:17.021714 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-01ea9be4-f7b0-4248-9d7c-936f114398fe None None] MFA Rules not processed for user `036ba058101541b891732f6d9591c876`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:17.022918 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-01ea9be4-f7b0-4248-9d7c-936f114398fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:17.042545 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bee1ce-d640-407f-8ac1-7cf865775dba service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:17.042545 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-e4bee1ce-d640-407f-8ac1-7cf865775dba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:17.054820 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bee1ce-d640-407f-8ac1-7cf865775dba service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:17.063284 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521761a-b67c-465c-9894-917f70aa9aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:17.064997 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521761a-b67c-465c-9894-917f70aa9aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:17.065514 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521761a-b67c-465c-9894-917f70aa9aff admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:17.066014 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521761a-b67c-465c-9894-917f70aa9aff admin admin] PATH_INFO: `/v3/users/3f9ece08beb6425dba1dc41ba4c00531` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:17.067534 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521761a-b67c-465c-9894-917f70aa9aff admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f9ece08beb6425dba1dc41ba4c00531)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:17.070295 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521761a-b67c-465c-9894-917f70aa9aff admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:17.096312 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1108/2233] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:02:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:02:17.100875 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea9be4-f7b0-4248-9d7c-936f114398fe None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:17.117179 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea9be4-f7b0-4248-9d7c-936f114398fe None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:17.121442 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57c205-9ed9-45dc-a463-337462ef0df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:17.122380 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57c205-9ed9-45dc-a463-337462ef0df1 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:17.122843 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57c205-9ed9-45dc-a463-337462ef0df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:17.123295 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57c205-9ed9-45dc-a463-337462ef0df1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:17.125187 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57c205-9ed9-45dc-a463-337462ef0df1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:17.128157 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57c205-9ed9-45dc-a463-337462ef0df1 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:17.268661 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1109/2234] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:02:17 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:02:17.273371 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57c205-9ed9-45dc-a463-337462ef0df1 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:17.336596 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57c205-9ed9-45dc-a463-337462ef0df1 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:17.343237 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63282f4f-0a4c-4c5b-8ad2-0204ee8b832c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:17.344613 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63282f4f-0a4c-4c5b-8ad2-0204ee8b832c admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:17.344898 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63282f4f-0a4c-4c5b-8ad2-0204ee8b832c admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:17.345200 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63282f4f-0a4c-4c5b-8ad2-0204ee8b832c admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:17.345932 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63282f4f-0a4c-4c5b-8ad2-0204ee8b832c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:17.347837 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63282f4f-0a4c-4c5b-8ad2-0204ee8b832c admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:17.417626 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-6521761a-b67c-465c-9894-917f70aa9aff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f9ece08beb6425dba1dc41ba4c00531'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:17.424882 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-6521761a-b67c-465c-9894-917f70aa9aff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f9ece08beb6425dba1dc41ba4c00531'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:17.425653 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-6521761a-b67c-465c-9894-917f70aa9aff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f9ece08beb6425dba1dc41ba4c00531'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:17.426263 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-6521761a-b67c-465c-9894-917f70aa9aff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f9ece08beb6425dba1dc41ba4c00531'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:17.439744 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1110/2235] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:02:17 2022] POST /identity/v3/users => generated 299 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:02:17.442425 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63282f4f-0a4c-4c5b-8ad2-0204ee8b832c admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:17.442619 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-63282f4f-0a4c-4c5b-8ad2-0204ee8b832c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:17.455713 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63282f4f-0a4c-4c5b-8ad2-0204ee8b832c admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:17.460499 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebae95a-bb73-4b94-b8ad-65bfae8308f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:17.461399 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebae95a-bb73-4b94-b8ad-65bfae8308f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:17.461680 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebae95a-bb73-4b94-b8ad-65bfae8308f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:17.461950 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebae95a-bb73-4b94-b8ad-65bfae8308f5 admin admin] PATH_INFO: `/v3/users/9646868fc36b47de927cefc5ec61c12a` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:17.463312 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebae95a-bb73-4b94-b8ad-65bfae8308f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9646868fc36b47de927cefc5ec61c12a)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:17.465300 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebae95a-bb73-4b94-b8ad-65bfae8308f5 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:17.527337 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-6521761a-b67c-465c-9894-917f70aa9aff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f9ece08beb6425dba1dc41ba4c00531'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:17.544990 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1126/2236] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:02:17 2022] DELETE /identity/v3/users/3f9ece08beb6425dba1dc41ba4c00531 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:02:17.545724 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521761a-b67c-465c-9894-917f70aa9aff admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:17.547574 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-6521761a-b67c-465c-9894-917f70aa9aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:17.616282 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521761a-b67c-465c-9894-917f70aa9aff admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:17.621279 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fcf7a9-3ddc-4d1d-bbe7-84dc8235e6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:17.621967 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcf7a9-3ddc-4d1d-bbe7-84dc8235e6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:17.622251 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcf7a9-3ddc-4d1d-bbe7-84dc8235e6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:17.622542 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcf7a9-3ddc-4d1d-bbe7-84dc8235e6d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:17.623304 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fcf7a9-3ddc-4d1d-bbe7-84dc8235e6d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:17.625553 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fcf7a9-3ddc-4d1d-bbe7-84dc8235e6d6 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:17.635685 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1127/2237] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:02:17.636940 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a2be6-5e6a-4332-b9fe-2130bcaf90e5 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:17.637301 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a2be6-5e6a-4332-b9fe-2130bcaf90e5 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:17.637527 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a2be6-5e6a-4332-b9fe-2130bcaf90e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:17.656296 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-6f0a2be6-5e6a-4332-b9fe-2130bcaf90e5 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:17.657829 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-6f0a2be6-5e6a-4332-b9fe-2130bcaf90e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:17.665872 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1128/2238] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:02:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:02:17.666481 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a2be6-5e6a-4332-b9fe-2130bcaf90e5 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:17.676487 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a2be6-5e6a-4332-b9fe-2130bcaf90e5 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:17.681239 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f95ee-c2d0-4357-b743-fd41da2a901e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:17.682120 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f95ee-c2d0-4357-b743-fd41da2a901e admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:17.682398 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f95ee-c2d0-4357-b743-fd41da2a901e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:17.682730 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f95ee-c2d0-4357-b743-fd41da2a901e admin admin] PATH_INFO: `/v3/projects/c9dbadb18d1c4e888fda9d242ffdaf05/users/ad7e6e6259d54c8cb3d5ea6a14401cb2/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:17.699346 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4ebae95a-bb73-4b94-b8ad-65bfae8308f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9646868fc36b47de927cefc5ec61c12a'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:17.700484 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f95ee-c2d0-4357-b743-fd41da2a901e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9dbadb18d1c4e888fda9d242ffdaf05, user_id=ad7e6e6259d54c8cb3d5ea6a14401cb2, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:17.703239 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f95ee-c2d0-4357-b743-fd41da2a901e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:17.708474 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4ebae95a-bb73-4b94-b8ad-65bfae8308f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9646868fc36b47de927cefc5ec61c12a'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:17.709523 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4ebae95a-bb73-4b94-b8ad-65bfae8308f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9646868fc36b47de927cefc5ec61c12a'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:17.765594 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1129/2239] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:02:17 2022] PUT /identity/v3/projects/c9dbadb18d1c4e888fda9d242ffdaf05/users/ad7e6e6259d54c8cb3d5ea6a14401cb2/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:02:17.767773 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f95ee-c2d0-4357-b743-fd41da2a901e admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:17.769300 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-ad1f95ee-c2d0-4357-b743-fd41da2a901e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:17.787349 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4ebae95a-bb73-4b94-b8ad-65bfae8308f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9646868fc36b47de927cefc5ec61c12a'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:17.803423 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4ebae95a-bb73-4b94-b8ad-65bfae8308f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9646868fc36b47de927cefc5ec61c12a'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:17.814862 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1111/2240] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:02:17 2022] DELETE /identity/v3/users/9646868fc36b47de927cefc5ec61c12a => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:02:17.814862 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebae95a-bb73-4b94-b8ad-65bfae8308f5 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:17.815171 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-4ebae95a-bb73-4b94-b8ad-65bfae8308f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:17.840034 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f95ee-c2d0-4357-b743-fd41da2a901e admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:17.908597 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b9c23-fb46-40fa-9a3f-6a5eaa01a2fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:17.908997 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebae95a-bb73-4b94-b8ad-65bfae8308f5 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:17.915325 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b9c23-fb46-40fa-9a3f-6a5eaa01a2fa service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:17.915325 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b9c23-fb46-40fa-9a3f-6a5eaa01a2fa service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:17.915325 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b9c23-fb46-40fa-9a3f-6a5eaa01a2fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:17.916294 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acda9a7-6a45-4d33-811b-bc1f1b939099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:17.916850 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-f88b9c23-fb46-40fa-9a3f-6a5eaa01a2fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:17.917492 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acda9a7-6a45-4d33-811b-bc1f1b939099 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:17.917942 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acda9a7-6a45-4d33-811b-bc1f1b939099 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:17.918418 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acda9a7-6a45-4d33-811b-bc1f1b939099 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:17.919910 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acda9a7-6a45-4d33-811b-bc1f1b939099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:17.921574 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acda9a7-6a45-4d33-811b-bc1f1b939099 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:17.936024 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1112/2241] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:02:17.942909 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b78dfc-babf-4246-8c1a-4ef0f4c63b44 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:17.942909 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b78dfc-babf-4246-8c1a-4ef0f4c63b44 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:17.943187 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b78dfc-babf-4246-8c1a-4ef0f4c63b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:17.944242 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b9c23-fb46-40fa-9a3f-6a5eaa01a2fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:17.955924 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b9c23-fb46-40fa-9a3f-6a5eaa01a2fa service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:17.962781 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-c3b78dfc-babf-4246-8c1a-4ef0f4c63b44 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:17.964852 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-c3b78dfc-babf-4246-8c1a-4ef0f4c63b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:17.969343 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1130/2242] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:02:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:02:17.970122 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b9c23-fb46-40fa-9a3f-6a5eaa01a2fa service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:17.974862 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1113/2243] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:02:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:02:17.998107 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b78dfc-babf-4246-8c1a-4ef0f4c63b44 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:18.002014 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-c3b78dfc-babf-4246-8c1a-4ef0f4c63b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:18.003025 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b9c23-fb46-40fa-9a3f-6a5eaa01a2fa service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:18.015590 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b085bd-6c31-4729-a9db-41e751d80da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:18.017224 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b085bd-6c31-4729-a9db-41e751d80da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:18.017583 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b085bd-6c31-4729-a9db-41e751d80da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:18.018026 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b085bd-6c31-4729-a9db-41e751d80da0 admin admin] PATH_INFO: `/v3/projects/c9dbadb18d1c4e888fda9d242ffdaf05/users/ad7e6e6259d54c8cb3d5ea6a14401cb2/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:18.020435 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b085bd-6c31-4729-a9db-41e751d80da0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9dbadb18d1c4e888fda9d242ffdaf05, user_id=ad7e6e6259d54c8cb3d5ea6a14401cb2, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:18.024817 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b085bd-6c31-4729-a9db-41e751d80da0 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:18.034071 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b78dfc-babf-4246-8c1a-4ef0f4c63b44 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:18.054201 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1131/2244] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:02:17 2022] PUT /identity/v3/projects/c9dbadb18d1c4e888fda9d242ffdaf05/users/ad7e6e6259d54c8cb3d5ea6a14401cb2/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:02:18.131500 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b4588-a28a-4faa-b56c-33f15d47225b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:18.132155 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b4588-a28a-4faa-b56c-33f15d47225b service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:18.139156 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b4588-a28a-4faa-b56c-33f15d47225b service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:18.139156 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b4588-a28a-4faa-b56c-33f15d47225b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:18.210051 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b4588-a28a-4faa-b56c-33f15d47225b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:18.211505 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b4588-a28a-4faa-b56c-33f15d47225b service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:18.221999 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1114/2245] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:02:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 15:02:18.815452 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b085bd-6c31-4729-a9db-41e751d80da0 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:18.817393 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-65b085bd-6c31-4729-a9db-41e751d80da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:18.838801 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b085bd-6c31-4729-a9db-41e751d80da0 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:18.844644 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e742b2-dd2e-45ae-90ce-2c60178b5400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:18.845301 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e742b2-dd2e-45ae-90ce-2c60178b5400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:18.845573 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e742b2-dd2e-45ae-90ce-2c60178b5400 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:18.845848 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e742b2-dd2e-45ae-90ce-2c60178b5400 admin admin] PATH_INFO: `/v3/projects/4a24108332144b53b211ee05656bc9b8` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:18.847055 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e742b2-dd2e-45ae-90ce-2c60178b5400 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a24108332144b53b211ee05656bc9b8)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:18.848960 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e742b2-dd2e-45ae-90ce-2c60178b5400 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:19.032236 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b4588-a28a-4faa-b56c-33f15d47225b service neutron] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:19.033841 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-067b4588-a28a-4faa-b56c-33f15d47225b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:19.052901 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b4588-a28a-4faa-b56c-33f15d47225b service neutron] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:19.062988 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a4a95-e40f-45b0-a1eb-a9052eb24157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:19.064983 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a4a95-e40f-45b0-a1eb-a9052eb24157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:19.065455 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a4a95-e40f-45b0-a1eb-a9052eb24157 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:19.065925 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a4a95-e40f-45b0-a1eb-a9052eb24157 admin admin] PATH_INFO: `/v3/projects/07f202371473497a9f8970497a54ae30` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:19.067553 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a4a95-e40f-45b0-a1eb-a9052eb24157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07f202371473497a9f8970497a54ae30)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:19.070534 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a4a95-e40f-45b0-a1eb-a9052eb24157 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:19.082780 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-22e742b2-dd2e-45ae-90ce-2c60178b5400 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a24108332144b53b211ee05656bc9b8', 'request_id': 'req-22e742b2-dd2e-45ae-90ce-2c60178b5400'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:19.090517 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-22e742b2-dd2e-45ae-90ce-2c60178b5400 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a24108332144b53b211ee05656bc9b8', 'request_id': 'req-22e742b2-dd2e-45ae-90ce-2c60178b5400'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:19.460527 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-22e742b2-dd2e-45ae-90ce-2c60178b5400 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a24108332144b53b211ee05656bc9b8', 'request_id': 'req-22e742b2-dd2e-45ae-90ce-2c60178b5400'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:19.469427 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-22e742b2-dd2e-45ae-90ce-2c60178b5400 admin admin] The token cache is being invalidate because project 4a24108332144b53b211ee05656bc9b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:02:19.469722 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-22e742b2-dd2e-45ae-90ce-2c60178b5400 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:19.470519 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-22e742b2-dd2e-45ae-90ce-2c60178b5400 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:19.476431 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4d5a4a95-e40f-45b0-a1eb-a9052eb24157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07f202371473497a9f8970497a54ae30', 'request_id': 'req-4d5a4a95-e40f-45b0-a1eb-a9052eb24157'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:19.482629 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1132/2246] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:02:18 2022] DELETE /identity/v3/projects/4a24108332144b53b211ee05656bc9b8 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:02:19.495558 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4d5a4a95-e40f-45b0-a1eb-a9052eb24157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07f202371473497a9f8970497a54ae30', 'request_id': 'req-4d5a4a95-e40f-45b0-a1eb-a9052eb24157'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:19.523475 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4d5a4a95-e40f-45b0-a1eb-a9052eb24157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07f202371473497a9f8970497a54ae30', 'request_id': 'req-4d5a4a95-e40f-45b0-a1eb-a9052eb24157'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:19.660860 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4d5a4a95-e40f-45b0-a1eb-a9052eb24157 admin admin] The token cache is being invalidate because project 07f202371473497a9f8970497a54ae30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:02:19.665259 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4d5a4a95-e40f-45b0-a1eb-a9052eb24157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:19.667075 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4d5a4a95-e40f-45b0-a1eb-a9052eb24157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:19.670726 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1115/2247] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:02:19 2022] DELETE /identity/v3/projects/07f202371473497a9f8970497a54ae30 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:02:19.674824 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e742b2-dd2e-45ae-90ce-2c60178b5400 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:19.678139 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-22e742b2-dd2e-45ae-90ce-2c60178b5400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:19.774085 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e742b2-dd2e-45ae-90ce-2c60178b5400 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:19.834369 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffa92e-09de-41c3-8c9c-359586bfaa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:19.835635 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffa92e-09de-41c3-8c9c-359586bfaa37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:19.836150 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffa92e-09de-41c3-8c9c-359586bfaa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:19.836609 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffa92e-09de-41c3-8c9c-359586bfaa37 admin admin] PATH_INFO: `/v3/users/aed74278716f4d15baa32eda5accce6d` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:19.838267 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caffa92e-09de-41c3-8c9c-359586bfaa37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aed74278716f4d15baa32eda5accce6d)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:19.840544 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caffa92e-09de-41c3-8c9c-359586bfaa37 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:20.195603 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-caffa92e-09de-41c3-8c9c-359586bfaa37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aed74278716f4d15baa32eda5accce6d'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:20.203633 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-caffa92e-09de-41c3-8c9c-359586bfaa37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aed74278716f4d15baa32eda5accce6d'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:20.204337 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-caffa92e-09de-41c3-8c9c-359586bfaa37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aed74278716f4d15baa32eda5accce6d'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:20.204954 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-caffa92e-09de-41c3-8c9c-359586bfaa37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aed74278716f4d15baa32eda5accce6d'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:20.284682 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-caffa92e-09de-41c3-8c9c-359586bfaa37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aed74278716f4d15baa32eda5accce6d'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:20.308269 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1133/2248] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:02:19 2022] DELETE /identity/v3/users/aed74278716f4d15baa32eda5accce6d => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:02:20.560090 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d8dbd-36d7-4c64-af1c-48e356d7f6a2 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:20.561042 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d8dbd-36d7-4c64-af1c-48e356d7f6a2 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:20.561602 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d8dbd-36d7-4c64-af1c-48e356d7f6a2 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:20.564000 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1116/2249] 10.222.0.30 () {54 vars in 921 bytes} [Wed Jan 5 15:02:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 15:02:20.573222 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed193a-60be-4f8a-a474-82334d96f059 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:20.574463 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed193a-60be-4f8a-a474-82334d96f059 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:20.574956 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed193a-60be-4f8a-a474-82334d96f059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:20.678146 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-f3ed193a-60be-4f8a-a474-82334d96f059 None None] MFA Rules not processed for user `77db235e2f7046e4bdbad7f31b5e3ebc`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:20.679802 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-f3ed193a-60be-4f8a-a474-82334d96f059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:20.798754 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1134/2250] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Jan 5 15:02:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:02:20.810724 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d8dbd-36d7-4c64-af1c-48e356d7f6a2 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:20.813345 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-af9d8dbd-36d7-4c64-af1c-48e356d7f6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:20.868556 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed193a-60be-4f8a-a474-82334d96f059 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:20.870228 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-f3ed193a-60be-4f8a-a474-82334d96f059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:20.921257 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d8dbd-36d7-4c64-af1c-48e356d7f6a2 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:20.930772 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae2715-efb7-442b-b8d4-e0a2678ed5e8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935ad716e4624c25bc34308f05eb1526', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:20.931515 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae2715-efb7-442b-b8d4-e0a2678ed5e8 service glance] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:20.932436 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae2715-efb7-442b-b8d4-e0a2678ed5e8 service glance] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:20.932738 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae2715-efb7-442b-b8d4-e0a2678ed5e8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:20.944606 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae2715-efb7-442b-b8d4-e0a2678ed5e8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:20.946109 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae2715-efb7-442b-b8d4-e0a2678ed5e8 service glance] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:20.971196 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1117/2251] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:02:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:02:21.002902 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed193a-60be-4f8a-a474-82334d96f059 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:21.009773 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37d30d-bd52-4384-8162-f4257c58ab82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:21.010664 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37d30d-bd52-4384-8162-f4257c58ab82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:21.010950 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37d30d-bd52-4384-8162-f4257c58ab82 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:21.011225 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37d30d-bd52-4384-8162-f4257c58ab82 admin admin] PATH_INFO: `/v3/projects/b9b76b14ed96434f91a058f39f1e1355` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:21.013834 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37d30d-bd52-4384-8162-f4257c58ab82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9b76b14ed96434f91a058f39f1e1355)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:21.019292 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37d30d-bd52-4384-8162-f4257c58ab82 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:21.195548 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-2d37d30d-bd52-4384-8162-f4257c58ab82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9b76b14ed96434f91a058f39f1e1355', 'request_id': 'req-2d37d30d-bd52-4384-8162-f4257c58ab82'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:21.203258 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-2d37d30d-bd52-4384-8162-f4257c58ab82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9b76b14ed96434f91a058f39f1e1355', 'request_id': 'req-2d37d30d-bd52-4384-8162-f4257c58ab82'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:21.247826 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba81296-3b94-4a84-9135-bb6581ec9cf9 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:21.248112 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba81296-3b94-4a84-9135-bb6581ec9cf9 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:21.248583 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba81296-3b94-4a84-9135-bb6581ec9cf9 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:21.251480 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1118/2252] 10.222.0.30 () {54 vars in 921 bytes} [Wed Jan 5 15:02:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 05 15:02:21.256426 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4e05b-4818-48c4-a30f-0e0d147a29ea None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:21.256930 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4e05b-4818-48c4-a30f-0e0d147a29ea None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:21.257378 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4e05b-4818-48c4-a30f-0e0d147a29ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:21.302361 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-41f4e05b-4818-48c4-a30f-0e0d147a29ea None None] MFA Rules not processed for user `a6234d716a014808a8a4eb22b903bbc9`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:21.304395 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-2d37d30d-bd52-4384-8162-f4257c58ab82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9b76b14ed96434f91a058f39f1e1355', 'request_id': 'req-2d37d30d-bd52-4384-8162-f4257c58ab82'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:21.314583 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-41f4e05b-4818-48c4-a30f-0e0d147a29ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:21.320224 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-2d37d30d-bd52-4384-8162-f4257c58ab82 admin admin] The token cache is being invalidate because project b9b76b14ed96434f91a058f39f1e1355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:02:21.320510 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-2d37d30d-bd52-4384-8162-f4257c58ab82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:21.322815 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-2d37d30d-bd52-4384-8162-f4257c58ab82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:21.327779 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1135/2253] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:02:20 2022] DELETE /identity/v3/projects/b9b76b14ed96434f91a058f39f1e1355 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:02:21.334845 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9b694-0787-45a1-a1ad-ff77a1e2a112 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:21.335916 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9b694-0787-45a1-a1ad-ff77a1e2a112 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:21.337584 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9b694-0787-45a1-a1ad-ff77a1e2a112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:21.392774 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-74b9b694-0787-45a1-a1ad-ff77a1e2a112 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:21.395310 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-74b9b694-0787-45a1-a1ad-ff77a1e2a112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:21.428784 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1119/2254] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Jan 5 15:02:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:02:21.441434 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4e05b-4818-48c4-a30f-0e0d147a29ea None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:21.443614 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-41f4e05b-4818-48c4-a30f-0e0d147a29ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:21.458037 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4e05b-4818-48c4-a30f-0e0d147a29ea None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:21.465334 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0201e00-9b03-4811-864b-80b9e1c8a28e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:21.466362 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0201e00-9b03-4811-864b-80b9e1c8a28e service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:21.466801 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0201e00-9b03-4811-864b-80b9e1c8a28e service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:21.467270 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0201e00-9b03-4811-864b-80b9e1c8a28e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:21.480734 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1136/2255] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:02:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:02:21.483209 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12539ab8-2145-42c0-83c1-d800795239da None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:21.483566 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12539ab8-2145-42c0-83c1-d800795239da None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:21.483848 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12539ab8-2145-42c0-83c1-d800795239da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:21.485598 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0201e00-9b03-4811-864b-80b9e1c8a28e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:21.487703 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0201e00-9b03-4811-864b-80b9e1c8a28e service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:21.515408 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1120/2256] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:02:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 15:02:21.536073 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-12539ab8-2145-42c0-83c1-d800795239da None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:21.537511 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-12539ab8-2145-42c0-83c1-d800795239da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:21.549619 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1137/2257] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:02:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:02:21.550943 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0201e00-9b03-4811-864b-80b9e1c8a28e service neutron] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:21.571688 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bccf62-8626-4c35-bb30-0eca911a1510 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:21.572914 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0201e00-9b03-4811-864b-80b9e1c8a28e service neutron] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:21.573849 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bccf62-8626-4c35-bb30-0eca911a1510 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:21.574080 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bccf62-8626-4c35-bb30-0eca911a1510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:21.594796 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626692a-8f60-4166-b1de-53f8254ea94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:21.595890 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626692a-8f60-4166-b1de-53f8254ea94a admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:21.596385 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626692a-8f60-4166-b1de-53f8254ea94a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:21.596866 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626692a-8f60-4166-b1de-53f8254ea94a admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:21.598108 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626692a-8f60-4166-b1de-53f8254ea94a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:02:21.599431 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626692a-8f60-4166-b1de-53f8254ea94a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:21.601437 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-15bccf62-8626-4c35-bb30-0eca911a1510 None None] MFA Rules not processed for user `29314b0be6534c79b36f31402d51d17b`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:21.602426 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626692a-8f60-4166-b1de-53f8254ea94a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:21.603724 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-15bccf62-8626-4c35-bb30-0eca911a1510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:21.618191 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1121/2258] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:02:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 15:02:21.624235 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626692a-8f60-4166-b1de-53f8254ea94a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:21.641509 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626692a-8f60-4166-b1de-53f8254ea94a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:21.664709 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4fec0-578e-49bf-a905-ae3627b9fb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:21.664709 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4fec0-578e-49bf-a905-ae3627b9fb44 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:21.664709 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4fec0-578e-49bf-a905-ae3627b9fb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:21.664709 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4fec0-578e-49bf-a905-ae3627b9fb44 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:21.666121 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4fec0-578e-49bf-a905-ae3627b9fb44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:21.671547 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4fec0-578e-49bf-a905-ae3627b9fb44 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:21.699736 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1138/2259] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Jan 5 15:02:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:02:21.714877 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bccf62-8626-4c35-bb30-0eca911a1510 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:21.717607 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-15bccf62-8626-4c35-bb30-0eca911a1510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:21.823493 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bccf62-8626-4c35-bb30-0eca911a1510 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:21.828373 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e8e0e-4ccb-4c45-9fc3-8f861df006e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ea13fd3e704b16aad5a38606ddc049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:21.829225 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e8e0e-4ccb-4c45-9fc3-8f861df006e0 service swift] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:21.831938 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e8e0e-4ccb-4c45-9fc3-8f861df006e0 service swift] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:21.832023 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e8e0e-4ccb-4c45-9fc3-8f861df006e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:21.850636 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1122/2260] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:02:21 2022] POST /identity/v3/projects => generated 381 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:02:21.852212 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e8e0e-4ccb-4c45-9fc3-8f861df006e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:21.855315 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4fec0-578e-49bf-a905-ae3627b9fb44 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:21.858070 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e8e0e-4ccb-4c45-9fc3-8f861df006e0 service swift] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:21.880210 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1139/2261] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jan 5 15:02:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 15:02:21.941464 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4fec0-578e-49bf-a905-ae3627b9fb44 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:21.950766 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64164ad-1439-43b7-86ca-c1c80b8be9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:21.951768 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64164ad-1439-43b7-86ca-c1c80b8be9f5 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:21.952209 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64164ad-1439-43b7-86ca-c1c80b8be9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:21.952750 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64164ad-1439-43b7-86ca-c1c80b8be9f5 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:21.954493 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64164ad-1439-43b7-86ca-c1c80b8be9f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:21.969592 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64164ad-1439-43b7-86ca-c1c80b8be9f5 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:22.177796 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e8e0e-4ccb-4c45-9fc3-8f861df006e0 service swift] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:22.183569 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1123/2262] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:02:21 2022] POST /identity/v3/users => generated 291 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:02:22.191977 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e8e0e-4ccb-4c45-9fc3-8f861df006e0 service swift] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:22.202303 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860b5ac-afc9-4baf-8bd6-b17a1fe9b061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:22.204204 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860b5ac-afc9-4baf-8bd6-b17a1fe9b061 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:22.205121 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860b5ac-afc9-4baf-8bd6-b17a1fe9b061 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:22.205610 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860b5ac-afc9-4baf-8bd6-b17a1fe9b061 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:22.206553 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860b5ac-afc9-4baf-8bd6-b17a1fe9b061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:22.208750 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860b5ac-afc9-4baf-8bd6-b17a1fe9b061 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:22.227596 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1140/2263] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:02:22.228532 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64164ad-1439-43b7-86ca-c1c80b8be9f5 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:22.262953 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64164ad-1439-43b7-86ca-c1c80b8be9f5 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:22.311582 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53880e05-1456-4c27-a5a0-ac41c9c79072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:22.316141 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53880e05-1456-4c27-a5a0-ac41c9c79072 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:22.317622 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53880e05-1456-4c27-a5a0-ac41c9c79072 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:22.318961 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53880e05-1456-4c27-a5a0-ac41c9c79072 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:22.319740 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53880e05-1456-4c27-a5a0-ac41c9c79072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:22.325048 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53880e05-1456-4c27-a5a0-ac41c9c79072 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:22.351178 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1124/2264] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:02:22.356017 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860b5ac-afc9-4baf-8bd6-b17a1fe9b061 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:22.369006 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860b5ac-afc9-4baf-8bd6-b17a1fe9b061 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:22.375377 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1abbe-890f-4754-a9d6-2cce63c38119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:22.376737 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1abbe-890f-4754-a9d6-2cce63c38119 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:22.377528 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1abbe-890f-4754-a9d6-2cce63c38119 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:22.377960 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1abbe-890f-4754-a9d6-2cce63c38119 admin admin] PATH_INFO: `/v3/projects/d895eaa10dfa4f81adf06e0cb17ab755/users/2d7ad8dbc99c47cebd798cf487ba995f/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:22.399834 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1abbe-890f-4754-a9d6-2cce63c38119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d895eaa10dfa4f81adf06e0cb17ab755, user_id=2d7ad8dbc99c47cebd798cf487ba995f, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:22.404290 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1abbe-890f-4754-a9d6-2cce63c38119 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:22.494549 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1141/2265] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:02:22 2022] PUT /identity/v3/projects/d895eaa10dfa4f81adf06e0cb17ab755/users/2d7ad8dbc99c47cebd798cf487ba995f/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:02:22.504570 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fbcc7-fbc0-4ef5-a394-7c9009c22bc8 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:22.504860 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fbcc7-fbc0-4ef5-a394-7c9009c22bc8 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:22.505193 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fbcc7-fbc0-4ef5-a394-7c9009c22bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:22.610494 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-9b4fbcc7-fbc0-4ef5-a394-7c9009c22bc8 None None] MFA Rules not processed for user `2d7ad8dbc99c47cebd798cf487ba995f`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:22.613332 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-9b4fbcc7-fbc0-4ef5-a394-7c9009c22bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:22.704286 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1125/2266] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:02:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:02:22.708761 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1abbe-890f-4754-a9d6-2cce63c38119 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:22.803581 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1abbe-890f-4754-a9d6-2cce63c38119 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:22.810370 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa45985-e3b7-4c3e-8c9f-a579543341bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:22.811043 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa45985-e3b7-4c3e-8c9f-a579543341bb admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:22.811339 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa45985-e3b7-4c3e-8c9f-a579543341bb admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:22.811617 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa45985-e3b7-4c3e-8c9f-a579543341bb admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:22.812455 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa45985-e3b7-4c3e-8c9f-a579543341bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:22.814691 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa45985-e3b7-4c3e-8c9f-a579543341bb admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:22.966495 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1142/2267] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:02:22 2022] POST /identity/v3/projects => generated 373 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:02:22.970857 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fbcc7-fbc0-4ef5-a394-7c9009c22bc8 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:22.992820 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fbcc7-fbc0-4ef5-a394-7c9009c22bc8 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:23.080140 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4861a5-b999-4bba-943b-1dfaf0fbeb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:23.080846 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4861a5-b999-4bba-943b-1dfaf0fbeb0a admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:23.081148 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4861a5-b999-4bba-943b-1dfaf0fbeb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:23.081434 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4861a5-b999-4bba-943b-1dfaf0fbeb0a admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:23.082199 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4861a5-b999-4bba-943b-1dfaf0fbeb0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:23.084380 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4861a5-b999-4bba-943b-1dfaf0fbeb0a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:23.212849 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa45985-e3b7-4c3e-8c9f-a579543341bb admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:23.213416 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1126/2268] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:02:22 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:02:23.227361 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa45985-e3b7-4c3e-8c9f-a579543341bb admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:23.235486 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c86c4-86bb-46ba-a55d-cdf09497647c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:23.236432 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c86c4-86bb-46ba-a55d-cdf09497647c admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:23.237515 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c86c4-86bb-46ba-a55d-cdf09497647c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:23.237978 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c86c4-86bb-46ba-a55d-cdf09497647c admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:23.238896 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c86c4-86bb-46ba-a55d-cdf09497647c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:23.240905 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c86c4-86bb-46ba-a55d-cdf09497647c admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:23.253613 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1143/2269] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:02:23.258332 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4861a5-b999-4bba-943b-1dfaf0fbeb0a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:23.275538 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4861a5-b999-4bba-943b-1dfaf0fbeb0a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:23.285575 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c4a45-9e42-4e48-b2d5-e090ae20256d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:23.286597 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c4a45-9e42-4e48-b2d5-e090ae20256d admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:23.286889 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c4a45-9e42-4e48-b2d5-e090ae20256d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:23.287171 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c4a45-9e42-4e48-b2d5-e090ae20256d admin admin] PATH_INFO: `/v3/projects/b5b31bc2e59f43aab49a1fc136823a2e/users/6c64ac376c2c49048f3a7eaee11a8b46/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:23.319518 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c4a45-9e42-4e48-b2d5-e090ae20256d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5b31bc2e59f43aab49a1fc136823a2e, user_id=6c64ac376c2c49048f3a7eaee11a8b46, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:23.326337 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c4a45-9e42-4e48-b2d5-e090ae20256d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:23.459581 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1127/2270] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:02:23 2022] PUT /identity/v3/projects/b5b31bc2e59f43aab49a1fc136823a2e/users/6c64ac376c2c49048f3a7eaee11a8b46/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:02:23.459826 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c86c4-86bb-46ba-a55d-cdf09497647c admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:23.459826 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c86c4-86bb-46ba-a55d-cdf09497647c admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:23.592246 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f48f3-8fc5-46dd-8897-88845184adef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:23.592947 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f48f3-8fc5-46dd-8897-88845184adef admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:23.593266 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f48f3-8fc5-46dd-8897-88845184adef admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:23.594178 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f48f3-8fc5-46dd-8897-88845184adef admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:23.595037 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f48f3-8fc5-46dd-8897-88845184adef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:23.596923 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f48f3-8fc5-46dd-8897-88845184adef admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:23.620408 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1144/2271] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:02:23.620741 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c4a45-9e42-4e48-b2d5-e090ae20256d admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:23.632896 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c4a45-9e42-4e48-b2d5-e090ae20256d admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:23.642975 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50fbe6-69f7-4fad-b424-5423588d8d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:23.644127 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50fbe6-69f7-4fad-b424-5423588d8d56 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:23.644502 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50fbe6-69f7-4fad-b424-5423588d8d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:23.644877 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50fbe6-69f7-4fad-b424-5423588d8d56 admin admin] PATH_INFO: `/v3/projects/b5b31bc2e59f43aab49a1fc136823a2e/users/6c64ac376c2c49048f3a7eaee11a8b46/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:23.654241 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50fbe6-69f7-4fad-b424-5423588d8d56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5b31bc2e59f43aab49a1fc136823a2e, user_id=6c64ac376c2c49048f3a7eaee11a8b46, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:23.658711 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50fbe6-69f7-4fad-b424-5423588d8d56 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:23.674191 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1128/2272] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:02:23 2022] PUT /identity/v3/projects/b5b31bc2e59f43aab49a1fc136823a2e/users/6c64ac376c2c49048f3a7eaee11a8b46/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:02:23.684474 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ca8ff-2793-4892-9a1b-94b94a32735a None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:23.684790 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ca8ff-2793-4892-9a1b-94b94a32735a None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:23.685038 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ca8ff-2793-4892-9a1b-94b94a32735a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:23.740951 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-4f0ca8ff-2793-4892-9a1b-94b94a32735a None None] MFA Rules not processed for user `6c64ac376c2c49048f3a7eaee11a8b46`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:23.742271 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-4f0ca8ff-2793-4892-9a1b-94b94a32735a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:23.936821 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1145/2273] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:02:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:02:23.969585 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50fbe6-69f7-4fad-b424-5423588d8d56 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:23.971690 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-bd50fbe6-69f7-4fad-b424-5423588d8d56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:24.175006 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50fbe6-69f7-4fad-b424-5423588d8d56 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:24.185678 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b94c2-0200-4714-b8d1-5ddf574144a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:24.186513 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b94c2-0200-4714-b8d1-5ddf574144a3 service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:24.186796 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b94c2-0200-4714-b8d1-5ddf574144a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:24.187073 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b94c2-0200-4714-b8d1-5ddf574144a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:24.213301 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b94c2-0200-4714-b8d1-5ddf574144a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:24.214870 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b94c2-0200-4714-b8d1-5ddf574144a3 service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:24.239709 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1129/2274] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:02:23 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:02:25.981150 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ca8ff-2793-4892-9a1b-94b94a32735a None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:26.014798 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ca8ff-2793-4892-9a1b-94b94a32735a None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:26.040232 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c3a45-3738-4c94-9fff-94e9c0d8d8f5 tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c64ac376c2c49048f3a7eaee11a8b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b31bc2e59f43aab49a1fc136823a2e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:26.041202 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c3a45-3738-4c94-9fff-94e9c0d8d8f5 tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:26.041687 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c3a45-3738-4c94-9fff-94e9c0d8d8f5 tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:26.042117 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c3a45-3738-4c94-9fff-94e9c0d8d8f5 tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:26.043031 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c3a45-3738-4c94-9fff-94e9c0d8d8f5 tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:02:26.043499 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c3a45-3738-4c94-9fff-94e9c0d8d8f5 tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:26.045338 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c3a45-3738-4c94-9fff-94e9c0d8d8f5 tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:26.104936 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1146/2275] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 15:02:26.106063 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b94c2-0200-4714-b8d1-5ddf574144a3 service cinder] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:26.116408 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b94c2-0200-4714-b8d1-5ddf574144a3 service cinder] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:26.142817 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84690c0-43e0-487b-af7c-26f8d4a20a1b tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c64ac376c2c49048f3a7eaee11a8b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b31bc2e59f43aab49a1fc136823a2e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:26.143768 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84690c0-43e0-487b-af7c-26f8d4a20a1b tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:26.144059 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84690c0-43e0-487b-af7c-26f8d4a20a1b tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:26.144515 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84690c0-43e0-487b-af7c-26f8d4a20a1b tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:26.145437 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84690c0-43e0-487b-af7c-26f8d4a20a1b tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:26.147839 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84690c0-43e0-487b-af7c-26f8d4a20a1b tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:26.265174 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1130/2276] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:02:26 2022] POST /identity/v3/projects => generated 354 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:02:26.269510 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c3a45-3738-4c94-9fff-94e9c0d8d8f5 tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:26.286208 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c3a45-3738-4c94-9fff-94e9c0d8d8f5 tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:26.425894 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f50cb-2629-46ca-8075-46a3f4ee5e22 tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c64ac376c2c49048f3a7eaee11a8b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b31bc2e59f43aab49a1fc136823a2e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:26.427344 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f50cb-2629-46ca-8075-46a3f4ee5e22 tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:26.428046 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f50cb-2629-46ca-8075-46a3f4ee5e22 tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:26.428575 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f50cb-2629-46ca-8075-46a3f4ee5e22 tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:26.430728 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f50cb-2629-46ca-8075-46a3f4ee5e22 tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:02:26.431518 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f50cb-2629-46ca-8075-46a3f4ee5e22 tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:26.434556 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f50cb-2629-46ca-8075-46a3f4ee5e22 tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:26.472996 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1147/2277] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 15:02:26.603425 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84690c0-43e0-487b-af7c-26f8d4a20a1b tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:26.616166 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84690c0-43e0-487b-af7c-26f8d4a20a1b tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:26.649634 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b6b6a-1c14-402e-a750-f46ff356eaf2 tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c64ac376c2c49048f3a7eaee11a8b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b31bc2e59f43aab49a1fc136823a2e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:26.650540 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b6b6a-1c14-402e-a750-f46ff356eaf2 tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:26.651627 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b6b6a-1c14-402e-a750-f46ff356eaf2 tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:26.651905 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b6b6a-1c14-402e-a750-f46ff356eaf2 tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] PATH_INFO: `/v3/projects/3c1284e6fdf2439a9865c78e45889ac8` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:26.656147 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b6b6a-1c14-402e-a750-f46ff356eaf2 tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3c1284e6fdf2439a9865c78e45889ac8)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:26.659035 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b6b6a-1c14-402e-a750-f46ff356eaf2 tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:27.088461 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e67b6b6a-1c14-402e-a750-f46ff356eaf2 tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c1284e6fdf2439a9865c78e45889ac8', 'request_id': 'req-e67b6b6a-1c14-402e-a750-f46ff356eaf2'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:27.098673 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e67b6b6a-1c14-402e-a750-f46ff356eaf2 tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c1284e6fdf2439a9865c78e45889ac8', 'request_id': 'req-e67b6b6a-1c14-402e-a750-f46ff356eaf2'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:27.106008 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e67b6b6a-1c14-402e-a750-f46ff356eaf2 tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c1284e6fdf2439a9865c78e45889ac8', 'request_id': 'req-e67b6b6a-1c14-402e-a750-f46ff356eaf2'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:27.186979 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e67b6b6a-1c14-402e-a750-f46ff356eaf2 tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] The token cache is being invalidate because project 3c1284e6fdf2439a9865c78e45889ac8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:02:27.188059 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e67b6b6a-1c14-402e-a750-f46ff356eaf2 tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:27.189495 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e67b6b6a-1c14-402e-a750-f46ff356eaf2 tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:27.192987 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1131/2278] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:02:26 2022] DELETE /identity/v3/projects/3c1284e6fdf2439a9865c78e45889ac8 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:02:27.942261 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23908c07-63af-4f36-8fc0-a0b03390dd08 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:27.943144 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23908c07-63af-4f36-8fc0-a0b03390dd08 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:27.943609 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23908c07-63af-4f36-8fc0-a0b03390dd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:28.023829 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-23908c07-63af-4f36-8fc0-a0b03390dd08 None None] MFA Rules not processed for user `ad7e6e6259d54c8cb3d5ea6a14401cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:28.025618 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-23908c07-63af-4f36-8fc0-a0b03390dd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:28.101852 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b6b6a-1c14-402e-a750-f46ff356eaf2 tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:28.103524 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-e67b6b6a-1c14-402e-a750-f46ff356eaf2 tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:28.262624 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1148/2279] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:02:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:02:28.264528 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3faeeda-0d18-4b67-aae8-4ec188b9f442 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:28.264824 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3faeeda-0d18-4b67-aae8-4ec188b9f442 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:28.266814 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b6b6a-1c14-402e-a750-f46ff356eaf2 tempest-VolumeQuotaClassesTest-617951 tempest-VolumeQuotaClassesTest-617951-project-admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:28.267881 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3faeeda-0d18-4b67-aae8-4ec188b9f442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:28.271806 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a39d1-ba76-458e-bbca-3563b2747d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:28.272766 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a39d1-ba76-458e-bbca-3563b2747d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:28.273303 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a39d1-ba76-458e-bbca-3563b2747d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:28.273668 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a39d1-ba76-458e-bbca-3563b2747d29 admin admin] PATH_INFO: `/v3/users/2d7ad8dbc99c47cebd798cf487ba995f` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:28.274961 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a39d1-ba76-458e-bbca-3563b2747d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d7ad8dbc99c47cebd798cf487ba995f)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:28.276980 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a39d1-ba76-458e-bbca-3563b2747d29 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:28.324399 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-d3faeeda-0d18-4b67-aae8-4ec188b9f442 None None] MFA Rules not processed for user `29314b0be6534c79b36f31402d51d17b`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:28.325666 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-d3faeeda-0d18-4b67-aae8-4ec188b9f442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:28.456117 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1149/2280] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Jan 5 15:02:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:02:28.475209 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3faeeda-0d18-4b67-aae8-4ec188b9f442 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:28.477164 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-d3faeeda-0d18-4b67-aae8-4ec188b9f442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:28.525033 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-c16a39d1-ba76-458e-bbca-3563b2747d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d7ad8dbc99c47cebd798cf487ba995f'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:28.541100 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-c16a39d1-ba76-458e-bbca-3563b2747d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d7ad8dbc99c47cebd798cf487ba995f'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:28.542344 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-c16a39d1-ba76-458e-bbca-3563b2747d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d7ad8dbc99c47cebd798cf487ba995f'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:28.595209 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3faeeda-0d18-4b67-aae8-4ec188b9f442 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:28.608385 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85502a60-a67f-4a2f-ac26-6c9834e9d6b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ea13fd3e704b16aad5a38606ddc049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:28.610853 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85502a60-a67f-4a2f-ac26-6c9834e9d6b5 service swift] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:28.611248 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85502a60-a67f-4a2f-ac26-6c9834e9d6b5 service swift] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:28.611791 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85502a60-a67f-4a2f-ac26-6c9834e9d6b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:28.631541 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85502a60-a67f-4a2f-ac26-6c9834e9d6b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:28.633365 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85502a60-a67f-4a2f-ac26-6c9834e9d6b5 service swift] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:28.656999 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1150/2281] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jan 5 15:02:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 15:02:28.677402 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-c16a39d1-ba76-458e-bbca-3563b2747d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d7ad8dbc99c47cebd798cf487ba995f'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:28.706066 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-c16a39d1-ba76-458e-bbca-3563b2747d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d7ad8dbc99c47cebd798cf487ba995f'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:28.715287 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1132/2282] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:02:28 2022] DELETE /identity/v3/users/2d7ad8dbc99c47cebd798cf487ba995f => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:02:28.720731 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262b332-6e12-419a-ba00-de07b315991b None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:28.725558 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262b332-6e12-419a-ba00-de07b315991b None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:28.725558 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262b332-6e12-419a-ba00-de07b315991b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:28.756645 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-6262b332-6e12-419a-ba00-de07b315991b None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:28.758377 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-6262b332-6e12-419a-ba00-de07b315991b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:28.888365 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1151/2283] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:02:28.899161 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a39d1-ba76-458e-bbca-3563b2747d29 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:28.901973 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-c16a39d1-ba76-458e-bbca-3563b2747d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:29.046904 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a39d1-ba76-458e-bbca-3563b2747d29 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:29.054871 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4270366-5fbc-494f-9f66-a4fa5171e177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:29.059261 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4270366-5fbc-494f-9f66-a4fa5171e177 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:29.059261 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4270366-5fbc-494f-9f66-a4fa5171e177 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:29.059261 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4270366-5fbc-494f-9f66-a4fa5171e177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:29.082195 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4270366-5fbc-494f-9f66-a4fa5171e177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:29.083917 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4270366-5fbc-494f-9f66-a4fa5171e177 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:29.115591 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1133/2284] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:02:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:02:29.884662 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262b332-6e12-419a-ba00-de07b315991b None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:29.888728 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-6262b332-6e12-419a-ba00-de07b315991b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:29.922522 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262b332-6e12-419a-ba00-de07b315991b None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:29.943112 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb6d52-b48d-4dbf-b116-f7aeb8c8b6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:29.944045 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb6d52-b48d-4dbf-b116-f7aeb8c8b6ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:29.944472 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb6d52-b48d-4dbf-b116-f7aeb8c8b6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:29.944867 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb6d52-b48d-4dbf-b116-f7aeb8c8b6ab admin admin] PATH_INFO: `/v3/projects/d895eaa10dfa4f81adf06e0cb17ab755` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:29.950857 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb6d52-b48d-4dbf-b116-f7aeb8c8b6ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=d895eaa10dfa4f81adf06e0cb17ab755)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:29.952053 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb6d52-b48d-4dbf-b116-f7aeb8c8b6ab admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:30.145583 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-11bb6d52-b48d-4dbf-b116-f7aeb8c8b6ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd895eaa10dfa4f81adf06e0cb17ab755', 'request_id': 'req-11bb6d52-b48d-4dbf-b116-f7aeb8c8b6ab'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:30.155225 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-11bb6d52-b48d-4dbf-b116-f7aeb8c8b6ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd895eaa10dfa4f81adf06e0cb17ab755', 'request_id': 'req-11bb6d52-b48d-4dbf-b116-f7aeb8c8b6ab'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:30.258698 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-11bb6d52-b48d-4dbf-b116-f7aeb8c8b6ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd895eaa10dfa4f81adf06e0cb17ab755', 'request_id': 'req-11bb6d52-b48d-4dbf-b116-f7aeb8c8b6ab'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:30.290865 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-11bb6d52-b48d-4dbf-b116-f7aeb8c8b6ab admin admin] The token cache is being invalidate because project d895eaa10dfa4f81adf06e0cb17ab755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:02:30.290865 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-11bb6d52-b48d-4dbf-b116-f7aeb8c8b6ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:30.290865 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-11bb6d52-b48d-4dbf-b116-f7aeb8c8b6ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:30.294090 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1152/2285] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:02:29 2022] DELETE /identity/v3/projects/d895eaa10dfa4f81adf06e0cb17ab755 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:02:30.295133 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4270366-5fbc-494f-9f66-a4fa5171e177 service neutron] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:30.310196 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4270366-5fbc-494f-9f66-a4fa5171e177 service neutron] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:30.456280 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b10fff-b859-4107-95d9-89fb1aef835e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:30.551319 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b10fff-b859-4107-95d9-89fb1aef835e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:30.551319 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b10fff-b859-4107-95d9-89fb1aef835e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:30.551319 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b10fff-b859-4107-95d9-89fb1aef835e admin admin] PATH_INFO: `/v3/users/6c64ac376c2c49048f3a7eaee11a8b46` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:30.551319 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b10fff-b859-4107-95d9-89fb1aef835e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c64ac376c2c49048f3a7eaee11a8b46)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:30.551319 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b10fff-b859-4107-95d9-89fb1aef835e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:31.019681 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-25b10fff-b859-4107-95d9-89fb1aef835e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c64ac376c2c49048f3a7eaee11a8b46'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:31.041474 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-25b10fff-b859-4107-95d9-89fb1aef835e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c64ac376c2c49048f3a7eaee11a8b46'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:31.042260 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-25b10fff-b859-4107-95d9-89fb1aef835e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c64ac376c2c49048f3a7eaee11a8b46'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:31.124913 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-25b10fff-b859-4107-95d9-89fb1aef835e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c64ac376c2c49048f3a7eaee11a8b46'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:31.143352 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-25b10fff-b859-4107-95d9-89fb1aef835e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c64ac376c2c49048f3a7eaee11a8b46'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:31.155351 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1134/2286] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:02:30 2022] DELETE /identity/v3/users/6c64ac376c2c49048f3a7eaee11a8b46 => generated 0 bytes in 861 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:02:31.879412 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb6d52-b48d-4dbf-b116-f7aeb8c8b6ab admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:31.884807 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-11bb6d52-b48d-4dbf-b116-f7aeb8c8b6ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:31.897770 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb6d52-b48d-4dbf-b116-f7aeb8c8b6ab admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:32.097359 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc85e5-4788-459a-aa33-ace6792365fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:32.098555 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc85e5-4788-459a-aa33-ace6792365fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:32.099040 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc85e5-4788-459a-aa33-ace6792365fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:32.099555 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc85e5-4788-459a-aa33-ace6792365fd admin admin] PATH_INFO: `/v3/projects/b5b31bc2e59f43aab49a1fc136823a2e` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:32.101771 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc85e5-4788-459a-aa33-ace6792365fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5b31bc2e59f43aab49a1fc136823a2e)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:32.104024 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc85e5-4788-459a-aa33-ace6792365fd admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:32.306555 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-46fc85e5-4788-459a-aa33-ace6792365fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5b31bc2e59f43aab49a1fc136823a2e', 'request_id': 'req-46fc85e5-4788-459a-aa33-ace6792365fd'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:32.313313 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-46fc85e5-4788-459a-aa33-ace6792365fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5b31bc2e59f43aab49a1fc136823a2e', 'request_id': 'req-46fc85e5-4788-459a-aa33-ace6792365fd'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:32.447332 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-46fc85e5-4788-459a-aa33-ace6792365fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5b31bc2e59f43aab49a1fc136823a2e', 'request_id': 'req-46fc85e5-4788-459a-aa33-ace6792365fd'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:32.475516 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-46fc85e5-4788-459a-aa33-ace6792365fd admin admin] The token cache is being invalidate because project b5b31bc2e59f43aab49a1fc136823a2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:02:32.476071 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-46fc85e5-4788-459a-aa33-ace6792365fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:32.476663 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-46fc85e5-4788-459a-aa33-ace6792365fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:32.488913 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1bd3a-08d7-46bb-914e-13f3a23037d4 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:32.489465 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1bd3a-08d7-46bb-914e-13f3a23037d4 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:32.489567 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1bd3a-08d7-46bb-914e-13f3a23037d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:32.491453 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1153/2287] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:02:31 2022] DELETE /identity/v3/projects/b5b31bc2e59f43aab49a1fc136823a2e => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:02:32.516701 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-cce1bd3a-08d7-46bb-914e-13f3a23037d4 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:32.518210 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-cce1bd3a-08d7-46bb-914e-13f3a23037d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:32.596680 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1135/2288] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:02:32.597793 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bc56e-0513-40d2-b2d9-2e92ca374d1d None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:32.598128 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bc56e-0513-40d2-b2d9-2e92ca374d1d None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:32.598650 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bc56e-0513-40d2-b2d9-2e92ca374d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:32.644819 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-090bc56e-0513-40d2-b2d9-2e92ca374d1d None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:32.647300 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-090bc56e-0513-40d2-b2d9-2e92ca374d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:32.678068 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1154/2289] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:02:32.680444 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1bd3a-08d7-46bb-914e-13f3a23037d4 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:32.699909 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1bd3a-08d7-46bb-914e-13f3a23037d4 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:32.712697 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c24260-b2fe-47cd-9076-d7ce008fabcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:32.716043 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c24260-b2fe-47cd-9076-d7ce008fabcb admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:32.716598 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c24260-b2fe-47cd-9076-d7ce008fabcb admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:32.717196 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c24260-b2fe-47cd-9076-d7ce008fabcb admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:32.719630 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c24260-b2fe-47cd-9076-d7ce008fabcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:02:32.720187 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c24260-b2fe-47cd-9076-d7ce008fabcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:32.726672 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c24260-b2fe-47cd-9076-d7ce008fabcb admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:32.776604 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1136/2290] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 15:02:32.777486 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bc56e-0513-40d2-b2d9-2e92ca374d1d None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:32.792466 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bc56e-0513-40d2-b2d9-2e92ca374d1d None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:32.839036 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8fc13-e959-46a2-a30f-ae4870538731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:32.840753 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8fc13-e959-46a2-a30f-ae4870538731 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:32.845639 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8fc13-e959-46a2-a30f-ae4870538731 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:32.848878 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8fc13-e959-46a2-a30f-ae4870538731 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:32.852227 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff8fc13-e959-46a2-a30f-ae4870538731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:32.857539 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff8fc13-e959-46a2-a30f-ae4870538731 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:32.980558 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1155/2291] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:02:32 2022] POST /identity/v3/projects => generated 375 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:02:32.985720 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c24260-b2fe-47cd-9076-d7ce008fabcb admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:32.998286 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c24260-b2fe-47cd-9076-d7ce008fabcb admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:33.157192 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7738f84-5bfb-4925-bf89-a697f5355d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:33.160447 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7738f84-5bfb-4925-bf89-a697f5355d72 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:33.161797 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7738f84-5bfb-4925-bf89-a697f5355d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:33.162938 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7738f84-5bfb-4925-bf89-a697f5355d72 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:33.164715 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7738f84-5bfb-4925-bf89-a697f5355d72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:33.171469 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7738f84-5bfb-4925-bf89-a697f5355d72 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:33.302885 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1137/2292] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:02:32 2022] POST /identity/v3/users => generated 288 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:02:33.305970 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8fc13-e959-46a2-a30f-ae4870538731 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:33.335165 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8fc13-e959-46a2-a30f-ae4870538731 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:33.345235 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b704a-a8f8-420c-a4a5-e16f96f851e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:33.345969 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b704a-a8f8-420c-a4a5-e16f96f851e1 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:33.346322 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b704a-a8f8-420c-a4a5-e16f96f851e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:33.346652 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b704a-a8f8-420c-a4a5-e16f96f851e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:33.347361 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b704a-a8f8-420c-a4a5-e16f96f851e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:33.349092 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b704a-a8f8-420c-a4a5-e16f96f851e1 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:33.399483 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1156/2293] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:02:33.400233 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7738f84-5bfb-4925-bf89-a697f5355d72 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:33.412019 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7738f84-5bfb-4925-bf89-a697f5355d72 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:33.424512 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d37eb5-5e64-427b-8468-5a84d62d14c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:33.425600 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d37eb5-5e64-427b-8468-5a84d62d14c0 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:33.425690 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d37eb5-5e64-427b-8468-5a84d62d14c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:33.425895 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d37eb5-5e64-427b-8468-5a84d62d14c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:33.427306 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d37eb5-5e64-427b-8468-5a84d62d14c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:33.428455 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d37eb5-5e64-427b-8468-5a84d62d14c0 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:33.444601 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b704a-a8f8-420c-a4a5-e16f96f851e1 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:33.453535 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1138/2294] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:02:33.465837 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b704a-a8f8-420c-a4a5-e16f96f851e1 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:33.481946 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917f923-aa17-42e3-a3e7-913dac691318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:33.482927 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917f923-aa17-42e3-a3e7-913dac691318 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:33.483224 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917f923-aa17-42e3-a3e7-913dac691318 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:33.483503 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917f923-aa17-42e3-a3e7-913dac691318 admin admin] PATH_INFO: `/v3/projects/96bba18706b54ff2b7732851a9b8de25/users/b5efbd2c08b644e182e8b6f5916e87cc/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:33.514710 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917f923-aa17-42e3-a3e7-913dac691318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96bba18706b54ff2b7732851a9b8de25, user_id=b5efbd2c08b644e182e8b6f5916e87cc, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:33.523213 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917f923-aa17-42e3-a3e7-913dac691318 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:33.636210 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95c448-3bc3-4cc7-a17c-34eb421b6aa1 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:33.636768 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95c448-3bc3-4cc7-a17c-34eb421b6aa1 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:33.637027 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95c448-3bc3-4cc7-a17c-34eb421b6aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:33.639609 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1157/2295] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:02:33 2022] PUT /identity/v3/projects/96bba18706b54ff2b7732851a9b8de25/users/b5efbd2c08b644e182e8b6f5916e87cc/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:02:33.716561 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-cd95c448-3bc3-4cc7-a17c-34eb421b6aa1 None None] MFA Rules not processed for user `b5efbd2c08b644e182e8b6f5916e87cc`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:33.733167 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-cd95c448-3bc3-4cc7-a17c-34eb421b6aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:33.876307 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1139/2296] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:02:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:02:33.885656 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917f923-aa17-42e3-a3e7-913dac691318 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:33.887475 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-f917f923-aa17-42e3-a3e7-913dac691318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:33.979762 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917f923-aa17-42e3-a3e7-913dac691318 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:33.983716 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2688a5c-c320-42bd-b4d0-cb7cc5b06721 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:33.984458 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2688a5c-c320-42bd-b4d0-cb7cc5b06721 service cinder] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:33.984683 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2688a5c-c320-42bd-b4d0-cb7cc5b06721 service cinder] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:33.984957 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2688a5c-c320-42bd-b4d0-cb7cc5b06721 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:34.008754 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2688a5c-c320-42bd-b4d0-cb7cc5b06721 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:34.011465 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2688a5c-c320-42bd-b4d0-cb7cc5b06721 service cinder] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:34.031308 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1158/2297] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:02:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 15:02:40.779509 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95c448-3bc3-4cc7-a17c-34eb421b6aa1 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:40.781386 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-cd95c448-3bc3-4cc7-a17c-34eb421b6aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:40.977935 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95c448-3bc3-4cc7-a17c-34eb421b6aa1 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:40.986014 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf3c85-cb9d-45c9-ac6e-3454edcac4c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8847b97a7089420a8b8b817f3059c660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:40.986941 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf3c85-cb9d-45c9-ac6e-3454edcac4c0 service placement] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:40.987579 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf3c85-cb9d-45c9-ac6e-3454edcac4c0 service placement] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:40.988058 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf3c85-cb9d-45c9-ac6e-3454edcac4c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:40.991122 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-cdbf3c85-cb9d-45c9-ac6e-3454edcac4c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:41.027143 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf3c85-cb9d-45c9-ac6e-3454edcac4c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:41.034929 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf3c85-cb9d-45c9-ac6e-3454edcac4c0 service placement] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:41.065366 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1140/2298] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:02:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:02:41.666266 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2688a5c-c320-42bd-b4d0-cb7cc5b06721 service cinder] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:41.669144 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-e2688a5c-c320-42bd-b4d0-cb7cc5b06721 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:41.762234 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2688a5c-c320-42bd-b4d0-cb7cc5b06721 service cinder] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:41.766899 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c852cff-62c0-4e98-8f45-5b818e6d8907 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935ad716e4624c25bc34308f05eb1526', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:41.767806 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c852cff-62c0-4e98-8f45-5b818e6d8907 service glance] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:41.768198 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c852cff-62c0-4e98-8f45-5b818e6d8907 service glance] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:41.768659 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c852cff-62c0-4e98-8f45-5b818e6d8907 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:41.771309 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-6c852cff-62c0-4e98-8f45-5b818e6d8907 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:41.852749 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c852cff-62c0-4e98-8f45-5b818e6d8907 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:41.855066 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c852cff-62c0-4e98-8f45-5b818e6d8907 service glance] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:41.874010 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1159/2299] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:02:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:02:42.200623 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7e4f8-1196-444f-9392-e851a73b6650 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:42.202067 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7e4f8-1196-444f-9392-e851a73b6650 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:42.202067 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7e4f8-1196-444f-9392-e851a73b6650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:42.261847 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-4cd7e4f8-1196-444f-9392-e851a73b6650 None None] MFA Rules not processed for user `29314b0be6534c79b36f31402d51d17b`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:42.263641 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-4cd7e4f8-1196-444f-9392-e851a73b6650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:42.350673 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1141/2300] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Jan 5 15:02:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:02:42.365396 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c852cff-62c0-4e98-8f45-5b818e6d8907 service glance] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:42.367013 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-6c852cff-62c0-4e98-8f45-5b818e6d8907 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:42.502114 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c852cff-62c0-4e98-8f45-5b818e6d8907 service glance] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:42.511236 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce9d13-c260-4111-8caa-7bbd950b90c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ea13fd3e704b16aad5a38606ddc049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:42.512247 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce9d13-c260-4111-8caa-7bbd950b90c9 service swift] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:42.512830 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce9d13-c260-4111-8caa-7bbd950b90c9 service swift] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:42.514015 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce9d13-c260-4111-8caa-7bbd950b90c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:42.525835 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce9d13-c260-4111-8caa-7bbd950b90c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:42.527968 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce9d13-c260-4111-8caa-7bbd950b90c9 service swift] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:42.549760 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1160/2301] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jan 5 15:02:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 05 15:02:47.081618 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e175c90-2f6b-40c7-a476-27fd9fd2ca01 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:47.082258 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e175c90-2f6b-40c7-a476-27fd9fd2ca01 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:47.082258 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e175c90-2f6b-40c7-a476-27fd9fd2ca01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:47.104552 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-6e175c90-2f6b-40c7-a476-27fd9fd2ca01 None None] MFA Rules not processed for user `29314b0be6534c79b36f31402d51d17b`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:47.105973 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-6e175c90-2f6b-40c7-a476-27fd9fd2ca01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:47.114197 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1142/2302] 10.222.0.30 () {58 vars in 967 bytes} [Wed Jan 5 15:02:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:02:47.128045 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce9d13-c260-4111-8caa-7bbd950b90c9 service swift] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:47.139257 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce9d13-c260-4111-8caa-7bbd950b90c9 service swift] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:47.144446 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105338af-28fa-484f-9d29-30303cea050f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ea13fd3e704b16aad5a38606ddc049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:47.145080 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105338af-28fa-484f-9d29-30303cea050f service swift] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:47.145376 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105338af-28fa-484f-9d29-30303cea050f service swift] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:47.145650 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105338af-28fa-484f-9d29-30303cea050f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:47.155269 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105338af-28fa-484f-9d29-30303cea050f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:47.157022 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105338af-28fa-484f-9d29-30303cea050f service swift] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:47.165875 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1161/2303] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jan 5 15:02:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 15:02:50.454403 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e175c90-2f6b-40c7-a476-27fd9fd2ca01 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:50.632840 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e175c90-2f6b-40c7-a476-27fd9fd2ca01 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:50.638887 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f4ddb-7d84-49e6-921b-ba397ee43cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:50.641371 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f4ddb-7d84-49e6-921b-ba397ee43cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:50.641371 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f4ddb-7d84-49e6-921b-ba397ee43cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:50.641371 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f4ddb-7d84-49e6-921b-ba397ee43cc8 admin admin] PATH_INFO: `/v3/users/b5efbd2c08b644e182e8b6f5916e87cc` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:50.643083 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f4ddb-7d84-49e6-921b-ba397ee43cc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5efbd2c08b644e182e8b6f5916e87cc)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:50.646359 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f4ddb-7d84-49e6-921b-ba397ee43cc8 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:50.829388 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-8d1f4ddb-7d84-49e6-921b-ba397ee43cc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5efbd2c08b644e182e8b6f5916e87cc'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:50.838191 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-8d1f4ddb-7d84-49e6-921b-ba397ee43cc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5efbd2c08b644e182e8b6f5916e87cc'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:50.839261 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-8d1f4ddb-7d84-49e6-921b-ba397ee43cc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5efbd2c08b644e182e8b6f5916e87cc'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:50.914033 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-8d1f4ddb-7d84-49e6-921b-ba397ee43cc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5efbd2c08b644e182e8b6f5916e87cc'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:50.945455 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-8d1f4ddb-7d84-49e6-921b-ba397ee43cc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5efbd2c08b644e182e8b6f5916e87cc'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:50.974768 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1143/2304] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:02:50 2022] DELETE /identity/v3/users/b5efbd2c08b644e182e8b6f5916e87cc => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:02:50.975519 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26084aca-242c-485f-bce5-0e5768c38c0f None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:50.975519 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26084aca-242c-485f-bce5-0e5768c38c0f None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:50.975519 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26084aca-242c-485f-bce5-0e5768c38c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:50.976056 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-26084aca-242c-485f-bce5-0e5768c38c0f None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:50.977291 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-26084aca-242c-485f-bce5-0e5768c38c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:51.071418 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1162/2305] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:02:51.078513 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f4ddb-7d84-49e6-921b-ba397ee43cc8 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:51.081114 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-8d1f4ddb-7d84-49e6-921b-ba397ee43cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:51.146648 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f4ddb-7d84-49e6-921b-ba397ee43cc8 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:51.153730 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f623eb4-8afd-4749-8727-f5b46a013055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:51.154393 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f623eb4-8afd-4749-8727-f5b46a013055 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:51.155095 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f623eb4-8afd-4749-8727-f5b46a013055 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:51.155095 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f623eb4-8afd-4749-8727-f5b46a013055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:51.167798 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f623eb4-8afd-4749-8727-f5b46a013055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:51.169648 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f623eb4-8afd-4749-8727-f5b46a013055 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:51.182776 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1144/2306] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:02:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:02:51.894617 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26084aca-242c-485f-bce5-0e5768c38c0f None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:51.899440 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-26084aca-242c-485f-bce5-0e5768c38c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:51.908748 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26084aca-242c-485f-bce5-0e5768c38c0f None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:51.913664 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3463f41f-3eb5-4a6b-8532-0f1b72dcfce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:51.914613 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463f41f-3eb5-4a6b-8532-0f1b72dcfce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:51.914966 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463f41f-3eb5-4a6b-8532-0f1b72dcfce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:51.915461 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463f41f-3eb5-4a6b-8532-0f1b72dcfce7 admin admin] PATH_INFO: `/v3/projects/96bba18706b54ff2b7732851a9b8de25` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:51.916866 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3463f41f-3eb5-4a6b-8532-0f1b72dcfce7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96bba18706b54ff2b7732851a9b8de25)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:51.919239 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3463f41f-3eb5-4a6b-8532-0f1b72dcfce7 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:52.057310 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f623eb4-8afd-4749-8727-f5b46a013055 service neutron] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:52.062599 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-3f623eb4-8afd-4749-8727-f5b46a013055 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:52.077205 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f623eb4-8afd-4749-8727-f5b46a013055 service neutron] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:52.086680 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3463f41f-3eb5-4a6b-8532-0f1b72dcfce7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96bba18706b54ff2b7732851a9b8de25', 'request_id': 'req-3463f41f-3eb5-4a6b-8532-0f1b72dcfce7'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:52.093457 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3463f41f-3eb5-4a6b-8532-0f1b72dcfce7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96bba18706b54ff2b7732851a9b8de25', 'request_id': 'req-3463f41f-3eb5-4a6b-8532-0f1b72dcfce7'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:52.150879 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794dac0f-c36b-4102-9572-69d72a0ae302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:52.152068 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794dac0f-c36b-4102-9572-69d72a0ae302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:52.152356 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794dac0f-c36b-4102-9572-69d72a0ae302 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:52.152633 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794dac0f-c36b-4102-9572-69d72a0ae302 admin admin] PATH_INFO: `/v3/users/0669d8dce2d64715948615519bf0eac9` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:52.153926 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794dac0f-c36b-4102-9572-69d72a0ae302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0669d8dce2d64715948615519bf0eac9)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:52.155892 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794dac0f-c36b-4102-9572-69d72a0ae302 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:52.167404 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3463f41f-3eb5-4a6b-8532-0f1b72dcfce7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96bba18706b54ff2b7732851a9b8de25', 'request_id': 'req-3463f41f-3eb5-4a6b-8532-0f1b72dcfce7'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:52.179491 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3463f41f-3eb5-4a6b-8532-0f1b72dcfce7 admin admin] The token cache is being invalidate because project 96bba18706b54ff2b7732851a9b8de25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:02:52.180008 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3463f41f-3eb5-4a6b-8532-0f1b72dcfce7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:52.180849 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3463f41f-3eb5-4a6b-8532-0f1b72dcfce7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:52.182648 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1163/2307] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:02:51 2022] DELETE /identity/v3/projects/96bba18706b54ff2b7732851a9b8de25 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:02:52.200624 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508a108-bc96-4f6d-8b1f-509ac5928693 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:52.200624 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508a108-bc96-4f6d-8b1f-509ac5928693 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:52.200624 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508a108-bc96-4f6d-8b1f-509ac5928693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:52.209497 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-b508a108-bc96-4f6d-8b1f-509ac5928693 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:52.210923 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-b508a108-bc96-4f6d-8b1f-509ac5928693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:52.225768 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1164/2308] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:02:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:02:52.227557 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af381e-6c79-445b-8f0b-b0a76e756a2f None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:52.227892 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af381e-6c79-445b-8f0b-b0a76e756a2f None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:52.228169 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af381e-6c79-445b-8f0b-b0a76e756a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:52.248043 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-e7af381e-6c79-445b-8f0b-b0a76e756a2f None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:52.258385 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-e7af381e-6c79-445b-8f0b-b0a76e756a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:52.258385 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1165/2309] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:02:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:02:52.262213 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af381e-6c79-445b-8f0b-b0a76e756a2f None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:52.271989 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af381e-6c79-445b-8f0b-b0a76e756a2f None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:52.277760 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40581a-1180-42af-adf8-a333652c6a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:52.278430 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40581a-1180-42af-adf8-a333652c6a09 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:52.278718 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40581a-1180-42af-adf8-a333652c6a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:52.278997 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40581a-1180-42af-adf8-a333652c6a09 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:52.279807 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40581a-1180-42af-adf8-a333652c6a09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:02:52.280060 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40581a-1180-42af-adf8-a333652c6a09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:52.282442 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40581a-1180-42af-adf8-a333652c6a09 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:52.295693 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1166/2310] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 15:02:52.302513 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40581a-1180-42af-adf8-a333652c6a09 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:52.314790 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40581a-1180-42af-adf8-a333652c6a09 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:52.320512 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1517ae1-0dfd-4424-9a00-5c59d306ecfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:52.321248 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1517ae1-0dfd-4424-9a00-5c59d306ecfa admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:52.321537 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1517ae1-0dfd-4424-9a00-5c59d306ecfa admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:52.321818 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1517ae1-0dfd-4424-9a00-5c59d306ecfa admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:52.322564 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1517ae1-0dfd-4424-9a00-5c59d306ecfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:52.324483 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1517ae1-0dfd-4424-9a00-5c59d306ecfa admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:52.403273 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-794dac0f-c36b-4102-9572-69d72a0ae302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0669d8dce2d64715948615519bf0eac9'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:52.413963 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-794dac0f-c36b-4102-9572-69d72a0ae302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0669d8dce2d64715948615519bf0eac9'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:52.415130 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-794dac0f-c36b-4102-9572-69d72a0ae302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0669d8dce2d64715948615519bf0eac9'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:52.423854 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1167/2311] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:02:52 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:02:52.433938 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1517ae1-0dfd-4424-9a00-5c59d306ecfa admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:52.492247 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-794dac0f-c36b-4102-9572-69d72a0ae302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0669d8dce2d64715948615519bf0eac9'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:52.523085 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-794dac0f-c36b-4102-9572-69d72a0ae302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0669d8dce2d64715948615519bf0eac9'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:52.532815 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1145/2312] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:02:52 2022] DELETE /identity/v3/users/0669d8dce2d64715948615519bf0eac9 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:02:52.584287 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1517ae1-0dfd-4424-9a00-5c59d306ecfa admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:52.666080 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80f351-a558-418a-855e-c59031f6c521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:52.666913 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80f351-a558-418a-855e-c59031f6c521 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:52.667295 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80f351-a558-418a-855e-c59031f6c521 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:52.667668 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80f351-a558-418a-855e-c59031f6c521 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:52.668493 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80f351-a558-418a-855e-c59031f6c521 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:52.670669 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80f351-a558-418a-855e-c59031f6c521 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:52.789290 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1168/2313] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:02:52 2022] POST /identity/v3/users => generated 286 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:02:52.789462 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794dac0f-c36b-4102-9572-69d72a0ae302 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:52.791044 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-794dac0f-c36b-4102-9572-69d72a0ae302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:52.829034 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794dac0f-c36b-4102-9572-69d72a0ae302 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:52.864144 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a460d3b-2a95-496f-8d22-4c40937f75ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:52.865532 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a460d3b-2a95-496f-8d22-4c40937f75ab admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:52.866046 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a460d3b-2a95-496f-8d22-4c40937f75ab admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:52.866550 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a460d3b-2a95-496f-8d22-4c40937f75ab admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:52.870155 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a460d3b-2a95-496f-8d22-4c40937f75ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:52.872584 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a460d3b-2a95-496f-8d22-4c40937f75ab admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:52.889738 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1146/2314] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:02:52.893835 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80f351-a558-418a-855e-c59031f6c521 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:52.910453 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80f351-a558-418a-855e-c59031f6c521 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:52.911778 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a460d3b-2a95-496f-8d22-4c40937f75ab admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:52.915110 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-9a460d3b-2a95-496f-8d22-4c40937f75ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:52.921054 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55cf51-7c25-4e15-b2ef-20c4ba0a477e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:52.922730 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55cf51-7c25-4e15-b2ef-20c4ba0a477e admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:52.923120 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55cf51-7c25-4e15-b2ef-20c4ba0a477e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:52.923500 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55cf51-7c25-4e15-b2ef-20c4ba0a477e admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:52.924939 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55cf51-7c25-4e15-b2ef-20c4ba0a477e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:52.927804 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55cf51-7c25-4e15-b2ef-20c4ba0a477e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:52.943503 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1169/2315] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:02:52.947704 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a460d3b-2a95-496f-8d22-4c40937f75ab admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:52.949708 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55cf51-7c25-4e15-b2ef-20c4ba0a477e admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:52.966934 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b884b62-884a-4e51-8de0-c2d1fca5e9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:52.967830 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b884b62-884a-4e51-8de0-c2d1fca5e9fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:52.968674 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b884b62-884a-4e51-8de0-c2d1fca5e9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:52.968956 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b884b62-884a-4e51-8de0-c2d1fca5e9fc admin admin] PATH_INFO: `/v3/projects/e785ec07120a4184acdbf74f73489ce8` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:52.971107 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b884b62-884a-4e51-8de0-c2d1fca5e9fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e785ec07120a4184acdbf74f73489ce8)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:52.972407 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b884b62-884a-4e51-8de0-c2d1fca5e9fc admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:52.976957 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55cf51-7c25-4e15-b2ef-20c4ba0a477e admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:52.993588 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0ae5c-de90-48cc-80f0-267c3fef8a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:52.996125 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0ae5c-de90-48cc-80f0-267c3fef8a39 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:52.998143 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0ae5c-de90-48cc-80f0-267c3fef8a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:52.998565 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0ae5c-de90-48cc-80f0-267c3fef8a39 admin admin] PATH_INFO: `/v3/projects/c3797435200949c8a45be6c5b0525dc0/users/f5d3596bbc03474dafde93a63ea3e344/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:53.031502 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0ae5c-de90-48cc-80f0-267c3fef8a39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3797435200949c8a45be6c5b0525dc0, user_id=f5d3596bbc03474dafde93a63ea3e344, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:53.034744 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0ae5c-de90-48cc-80f0-267c3fef8a39 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:53.142059 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1170/2316] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:02:52 2022] PUT /identity/v3/projects/c3797435200949c8a45be6c5b0525dc0/users/f5d3596bbc03474dafde93a63ea3e344/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:02:53.147982 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39628951-c4cd-4431-8739-135e2c30812e None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:53.148454 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39628951-c4cd-4431-8739-135e2c30812e None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:53.150363 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39628951-c4cd-4431-8739-135e2c30812e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:53.198865 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-3b884b62-884a-4e51-8de0-c2d1fca5e9fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e785ec07120a4184acdbf74f73489ce8', 'request_id': 'req-3b884b62-884a-4e51-8de0-c2d1fca5e9fc'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:53.207367 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-3b884b62-884a-4e51-8de0-c2d1fca5e9fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e785ec07120a4184acdbf74f73489ce8', 'request_id': 'req-3b884b62-884a-4e51-8de0-c2d1fca5e9fc'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:53.217547 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-3b884b62-884a-4e51-8de0-c2d1fca5e9fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e785ec07120a4184acdbf74f73489ce8', 'request_id': 'req-3b884b62-884a-4e51-8de0-c2d1fca5e9fc'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:53.222410 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-39628951-c4cd-4431-8739-135e2c30812e None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:53.224136 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-39628951-c4cd-4431-8739-135e2c30812e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:53.295363 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-3b884b62-884a-4e51-8de0-c2d1fca5e9fc admin admin] The token cache is being invalidate because project e785ec07120a4184acdbf74f73489ce8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:02:53.295597 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-3b884b62-884a-4e51-8de0-c2d1fca5e9fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:53.296823 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-3b884b62-884a-4e51-8de0-c2d1fca5e9fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:53.299980 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1147/2317] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:02:52 2022] DELETE /identity/v3/projects/e785ec07120a4184acdbf74f73489ce8 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:02:53.301969 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1171/2318] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:02:53.306521 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cd688-589f-4a19-9816-1a590d0b46e2 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:53.308221 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cd688-589f-4a19-9816-1a590d0b46e2 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:53.308670 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cd688-589f-4a19-9816-1a590d0b46e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:53.315390 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39628951-c4cd-4431-8739-135e2c30812e None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:53.317319 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-39628951-c4cd-4431-8739-135e2c30812e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:53.334014 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-250cd688-589f-4a19-9816-1a590d0b46e2 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:53.336051 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-250cd688-589f-4a19-9816-1a590d0b46e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:53.353697 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1148/2319] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:02:53.356155 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c2823-f924-4b3d-a16a-40df574228d4 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:53.356601 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c2823-f924-4b3d-a16a-40df574228d4 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:53.357095 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c2823-f924-4b3d-a16a-40df574228d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:53.378776 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-2c1c2823-f924-4b3d-a16a-40df574228d4 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:53.380279 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-2c1c2823-f924-4b3d-a16a-40df574228d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:53.395277 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1149/2320] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:02:53.397020 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c2823-f924-4b3d-a16a-40df574228d4 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:53.410935 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c2823-f924-4b3d-a16a-40df574228d4 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:53.418167 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05813d2-4da9-460f-b8ff-81f682218885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:53.419168 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05813d2-4da9-460f-b8ff-81f682218885 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:53.419605 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05813d2-4da9-460f-b8ff-81f682218885 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:53.420587 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05813d2-4da9-460f-b8ff-81f682218885 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:53.422230 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05813d2-4da9-460f-b8ff-81f682218885 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:02:53.422722 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05813d2-4da9-460f-b8ff-81f682218885 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:53.425390 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05813d2-4da9-460f-b8ff-81f682218885 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:53.446822 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1150/2321] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 15:02:53.448865 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05813d2-4da9-460f-b8ff-81f682218885 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:53.472698 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05813d2-4da9-460f-b8ff-81f682218885 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:53.476879 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39628951-c4cd-4431-8739-135e2c30812e None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:53.480756 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ffcd7-9296-46cb-9ff6-628aa96cc4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:53.481704 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ffcd7-9296-46cb-9ff6-628aa96cc4f9 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:53.481827 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688b619-b916-45c9-a479-0e7551b8c417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:53.482281 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ffcd7-9296-46cb-9ff6-628aa96cc4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:53.482477 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688b619-b916-45c9-a479-0e7551b8c417 service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:53.482760 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688b619-b916-45c9-a479-0e7551b8c417 service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:53.483024 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ffcd7-9296-46cb-9ff6-628aa96cc4f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:53.483146 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688b619-b916-45c9-a479-0e7551b8c417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:53.484208 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ffcd7-9296-46cb-9ff6-628aa96cc4f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:53.485219 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-8688b619-b916-45c9-a479-0e7551b8c417 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:53.486542 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ffcd7-9296-46cb-9ff6-628aa96cc4f9 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:53.530584 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8688b619-b916-45c9-a479-0e7551b8c417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:53.532328 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8688b619-b916-45c9-a479-0e7551b8c417 service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:53.558412 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1172/2322] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:02:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:02:53.630714 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1151/2323] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:02:53 2022] POST /identity/v3/projects => generated 373 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:02:53.635045 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688b619-b916-45c9-a479-0e7551b8c417 service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:53.651685 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688b619-b916-45c9-a479-0e7551b8c417 service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:53.747321 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2598f0e4-4be8-476e-827e-984620c7f40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:53.748644 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598f0e4-4be8-476e-827e-984620c7f40b admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:53.750577 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598f0e4-4be8-476e-827e-984620c7f40b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:53.752707 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598f0e4-4be8-476e-827e-984620c7f40b admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:53.753754 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2598f0e4-4be8-476e-827e-984620c7f40b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:53.756478 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2598f0e4-4be8-476e-827e-984620c7f40b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:53.841088 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1173/2324] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:02:53 2022] POST /identity/v3/users => generated 287 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:02:53.842062 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ffcd7-9296-46cb-9ff6-628aa96cc4f9 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:53.857636 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ffcd7-9296-46cb-9ff6-628aa96cc4f9 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:53.866633 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cabfa-aa17-4dfa-a8fe-acb1238c1b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:53.867852 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cabfa-aa17-4dfa-a8fe-acb1238c1b87 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:53.868298 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cabfa-aa17-4dfa-a8fe-acb1238c1b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:53.868723 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cabfa-aa17-4dfa-a8fe-acb1238c1b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:53.869665 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71cabfa-aa17-4dfa-a8fe-acb1238c1b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:53.871427 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71cabfa-aa17-4dfa-a8fe-acb1238c1b87 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:53.886551 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1152/2325] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:02:53.890262 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2598f0e4-4be8-476e-827e-984620c7f40b admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:53.907541 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2598f0e4-4be8-476e-827e-984620c7f40b admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:53.915149 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e290d99-f3a7-4b22-a701-55aef6a67943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:53.915965 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e290d99-f3a7-4b22-a701-55aef6a67943 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:53.916254 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e290d99-f3a7-4b22-a701-55aef6a67943 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:53.916571 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e290d99-f3a7-4b22-a701-55aef6a67943 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:53.917937 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e290d99-f3a7-4b22-a701-55aef6a67943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:53.919802 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e290d99-f3a7-4b22-a701-55aef6a67943 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:53.950838 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1174/2326] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:02:53.957867 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cabfa-aa17-4dfa-a8fe-acb1238c1b87 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:53.971132 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cabfa-aa17-4dfa-a8fe-acb1238c1b87 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:53.985221 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7828df-5070-4882-82d4-0813d0a35ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:53.988621 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7828df-5070-4882-82d4-0813d0a35ae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:53.988928 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7828df-5070-4882-82d4-0813d0a35ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:53.989236 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7828df-5070-4882-82d4-0813d0a35ae5 admin admin] PATH_INFO: `/v3/projects/27614f6e32454ccaa602817f1658ac5a/users/834a19c6c1e9406fb4adc38f0b13d021/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:54.027335 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7828df-5070-4882-82d4-0813d0a35ae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27614f6e32454ccaa602817f1658ac5a, user_id=834a19c6c1e9406fb4adc38f0b13d021, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:54.030087 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7828df-5070-4882-82d4-0813d0a35ae5 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:54.193580 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa413f9-4a3d-4421-8ecc-6eead83c9352 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:54.194721 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa413f9-4a3d-4421-8ecc-6eead83c9352 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:54.195004 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa413f9-4a3d-4421-8ecc-6eead83c9352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:54.196470 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1153/2327] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:02:53 2022] PUT /identity/v3/projects/27614f6e32454ccaa602817f1658ac5a/users/834a19c6c1e9406fb4adc38f0b13d021/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:02:54.226876 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-5aa413f9-4a3d-4421-8ecc-6eead83c9352 None None] MFA Rules not processed for user `834a19c6c1e9406fb4adc38f0b13d021`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:54.228146 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-5aa413f9-4a3d-4421-8ecc-6eead83c9352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:54.328330 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1175/2328] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:02:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:02:54.335730 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7828df-5070-4882-82d4-0813d0a35ae5 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:54.343643 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-dd7828df-5070-4882-82d4-0813d0a35ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:54.450224 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7828df-5070-4882-82d4-0813d0a35ae5 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:54.463705 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0421ce-47ce-45b9-b753-16bccda2715e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:54.464721 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0421ce-47ce-45b9-b753-16bccda2715e service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:54.465011 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0421ce-47ce-45b9-b753-16bccda2715e service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:54.465315 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0421ce-47ce-45b9-b753-16bccda2715e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:54.489521 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0421ce-47ce-45b9-b753-16bccda2715e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:54.490995 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0421ce-47ce-45b9-b753-16bccda2715e service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:54.521330 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1154/2329] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:02:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:02:54.865705 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecebe88-aba7-448d-b90d-07baeb13d106 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:54.866316 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecebe88-aba7-448d-b90d-07baeb13d106 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:54.866841 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecebe88-aba7-448d-b90d-07baeb13d106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:54.899540 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-7ecebe88-aba7-448d-b90d-07baeb13d106 None None] MFA Rules not processed for user `29314b0be6534c79b36f31402d51d17b`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:54.908829 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-7ecebe88-aba7-448d-b90d-07baeb13d106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:54.991555 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1176/2330] 10.222.0.30 () {58 vars in 967 bytes} [Wed Jan 5 15:02:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:02:55.006488 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0421ce-47ce-45b9-b753-16bccda2715e service cinder] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:55.009920 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-5a0421ce-47ce-45b9-b753-16bccda2715e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:55.104556 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0421ce-47ce-45b9-b753-16bccda2715e service cinder] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:55.114285 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb96e36-714b-4de9-a917-5e3c2617bcff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ea13fd3e704b16aad5a38606ddc049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:55.115109 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb96e36-714b-4de9-a917-5e3c2617bcff service swift] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:55.115495 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb96e36-714b-4de9-a917-5e3c2617bcff service swift] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:55.115878 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb96e36-714b-4de9-a917-5e3c2617bcff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:55.134308 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb96e36-714b-4de9-a917-5e3c2617bcff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:55.136424 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb96e36-714b-4de9-a917-5e3c2617bcff service swift] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:55.167062 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1155/2331] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jan 5 15:02:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 15:02:57.638031 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f857f10-2123-49b9-8a71-1e3d92f68e7a None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:57.638636 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f857f10-2123-49b9-8a71-1e3d92f68e7a None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:57.638816 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f857f10-2123-49b9-8a71-1e3d92f68e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:57.658037 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-5f857f10-2123-49b9-8a71-1e3d92f68e7a None None] MFA Rules not processed for user `834a19c6c1e9406fb4adc38f0b13d021`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:57.659005 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-5f857f10-2123-49b9-8a71-1e3d92f68e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:57.670840 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1177/2332] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:02:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:02:58.318158 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1673f8b-4b9c-414e-9410-d38dd693f544 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:58.319117 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1673f8b-4b9c-414e-9410-d38dd693f544 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:58.319712 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1673f8b-4b9c-414e-9410-d38dd693f544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:58.349689 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-e1673f8b-4b9c-414e-9410-d38dd693f544 None None] MFA Rules not processed for user `036ba058101541b891732f6d9591c876`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:58.351728 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-e1673f8b-4b9c-414e-9410-d38dd693f544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:58.487949 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1156/2333] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:02:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:02:58.781355 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f857f10-2123-49b9-8a71-1e3d92f68e7a None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:58.782911 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-5f857f10-2123-49b9-8a71-1e3d92f68e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:02:58.878662 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f857f10-2123-49b9-8a71-1e3d92f68e7a None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:58.885409 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c0c62-a932-479e-a0f9-78e19e7ac3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:58.886706 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c0c62-a932-479e-a0f9-78e19e7ac3be admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:58.887372 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c0c62-a932-479e-a0f9-78e19e7ac3be admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:58.887883 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c0c62-a932-479e-a0f9-78e19e7ac3be admin admin] PATH_INFO: `/v3/users/4295ba06618a45988ebeb45a82230bb0` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:58.889772 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2c0c62-a932-479e-a0f9-78e19e7ac3be admin admin] RBAC: Authorizing `identity:delete_user(user_id=4295ba06618a45988ebeb45a82230bb0)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:58.892193 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2c0c62-a932-479e-a0f9-78e19e7ac3be admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:59.183941 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-ab2c0c62-a932-479e-a0f9-78e19e7ac3be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4295ba06618a45988ebeb45a82230bb0'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:59.185682 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-ab2c0c62-a932-479e-a0f9-78e19e7ac3be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4295ba06618a45988ebeb45a82230bb0'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:59.186943 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-ab2c0c62-a932-479e-a0f9-78e19e7ac3be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4295ba06618a45988ebeb45a82230bb0'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:59.187560 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-ab2c0c62-a932-479e-a0f9-78e19e7ac3be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4295ba06618a45988ebeb45a82230bb0'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:59.264119 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-ab2c0c62-a932-479e-a0f9-78e19e7ac3be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4295ba06618a45988ebeb45a82230bb0'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:59.293503 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1178/2334] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:02:58 2022] DELETE /identity/v3/users/4295ba06618a45988ebeb45a82230bb0 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:02:59.558145 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1673f8b-4b9c-414e-9410-d38dd693f544 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:02:59.579316 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1673f8b-4b9c-414e-9410-d38dd693f544 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:02:59.682811 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5c2c9-ad19-4441-addd-ff7c3677b70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:02:59.683674 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5c2c9-ad19-4441-addd-ff7c3677b70f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:59.683949 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5c2c9-ad19-4441-addd-ff7c3677b70f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:59.684459 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5c2c9-ad19-4441-addd-ff7c3677b70f admin admin] PATH_INFO: `/v3/projects/9c7d005c6e9e454fa506907144639917` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:59.686374 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5c2c9-ad19-4441-addd-ff7c3677b70f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c7d005c6e9e454fa506907144639917)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:02:59.688365 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5c2c9-ad19-4441-addd-ff7c3677b70f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:02:59.823015 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-72a5c2c9-ad19-4441-addd-ff7c3677b70f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c7d005c6e9e454fa506907144639917', 'request_id': 'req-72a5c2c9-ad19-4441-addd-ff7c3677b70f'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:59.830169 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-72a5c2c9-ad19-4441-addd-ff7c3677b70f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c7d005c6e9e454fa506907144639917', 'request_id': 'req-72a5c2c9-ad19-4441-addd-ff7c3677b70f'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:59.836607 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-72a5c2c9-ad19-4441-addd-ff7c3677b70f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c7d005c6e9e454fa506907144639917', 'request_id': 'req-72a5c2c9-ad19-4441-addd-ff7c3677b70f'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:59.930463 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-72a5c2c9-ad19-4441-addd-ff7c3677b70f admin admin] The token cache is being invalidate because project 9c7d005c6e9e454fa506907144639917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:02:59.930938 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-72a5c2c9-ad19-4441-addd-ff7c3677b70f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:59.931604 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-72a5c2c9-ad19-4441-addd-ff7c3677b70f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:02:59.949100 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1157/2335] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:02:59 2022] DELETE /identity/v3/projects/9c7d005c6e9e454fa506907144639917 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:02:59.955208 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc24196-165d-4bc7-a91f-94899c4ed928 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:02:59.959045 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc24196-165d-4bc7-a91f-94899c4ed928 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:02:59.959045 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc24196-165d-4bc7-a91f-94899c4ed928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:02:59.996647 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-ccc24196-165d-4bc7-a91f-94899c4ed928 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:02:59.999721 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-ccc24196-165d-4bc7-a91f-94899c4ed928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:00.151899 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1179/2336] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:02:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:03:00.159434 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49473b1f-70b6-4acf-9dce-ae2f68f9b312 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:00.159621 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49473b1f-70b6-4acf-9dce-ae2f68f9b312 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:00.159906 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49473b1f-70b6-4acf-9dce-ae2f68f9b312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:00.184275 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-49473b1f-70b6-4acf-9dce-ae2f68f9b312 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:00.185653 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-49473b1f-70b6-4acf-9dce-ae2f68f9b312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:00.198064 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1158/2337] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:03:00.199619 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc24196-165d-4bc7-a91f-94899c4ed928 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:00.221038 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc24196-165d-4bc7-a91f-94899c4ed928 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:00.226437 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1648e57-b795-4595-a233-ce2af48c0f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:00.227405 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1648e57-b795-4595-a233-ce2af48c0f98 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:00.227916 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1648e57-b795-4595-a233-ce2af48c0f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:00.228401 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1648e57-b795-4595-a233-ce2af48c0f98 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:00.229657 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1648e57-b795-4595-a233-ce2af48c0f98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:03:00.230162 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1648e57-b795-4595-a233-ce2af48c0f98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:00.232197 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1648e57-b795-4595-a233-ce2af48c0f98 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:00.252111 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49473b1f-70b6-4acf-9dce-ae2f68f9b312 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:00.252681 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1180/2338] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 15:03:00.262106 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49473b1f-70b6-4acf-9dce-ae2f68f9b312 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:00.270200 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b0af1-e0c9-4a9a-ac18-4bfad812a91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:00.270830 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b0af1-e0c9-4a9a-ac18-4bfad812a91c admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:00.271116 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b0af1-e0c9-4a9a-ac18-4bfad812a91c admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:00.271400 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b0af1-e0c9-4a9a-ac18-4bfad812a91c admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:00.273290 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b0af1-e0c9-4a9a-ac18-4bfad812a91c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:00.277282 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b0af1-e0c9-4a9a-ac18-4bfad812a91c admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:00.370217 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1159/2339] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:03:00 2022] POST /identity/v3/projects => generated 357 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:03:00.374942 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1648e57-b795-4595-a233-ce2af48c0f98 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:00.386714 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1648e57-b795-4595-a233-ce2af48c0f98 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:00.509953 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266b619-7ce0-4c3d-95fb-7df1f92e6819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:00.515373 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266b619-7ce0-4c3d-95fb-7df1f92e6819 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:00.515814 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266b619-7ce0-4c3d-95fb-7df1f92e6819 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:00.516272 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266b619-7ce0-4c3d-95fb-7df1f92e6819 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:00.517218 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266b619-7ce0-4c3d-95fb-7df1f92e6819 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:00.519875 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266b619-7ce0-4c3d-95fb-7df1f92e6819 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:00.612592 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1181/2340] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:03:00 2022] POST /identity/v3/users => generated 279 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:03:00.617009 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b0af1-e0c9-4a9a-ac18-4bfad812a91c admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:00.640969 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b0af1-e0c9-4a9a-ac18-4bfad812a91c admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:00.658856 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f99479-a131-4af9-a6ab-e3f18190137d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:00.659556 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f99479-a131-4af9-a6ab-e3f18190137d admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:00.659836 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f99479-a131-4af9-a6ab-e3f18190137d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:00.660110 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f99479-a131-4af9-a6ab-e3f18190137d admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:00.661055 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f99479-a131-4af9-a6ab-e3f18190137d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:00.662742 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f99479-a131-4af9-a6ab-e3f18190137d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:00.684049 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1160/2341] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:03:00.688844 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266b619-7ce0-4c3d-95fb-7df1f92e6819 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:00.700503 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266b619-7ce0-4c3d-95fb-7df1f92e6819 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:00.705664 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37aa34b-a763-4e78-9667-de95e359f190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:00.706340 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37aa34b-a763-4e78-9667-de95e359f190 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:00.706630 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37aa34b-a763-4e78-9667-de95e359f190 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:00.706911 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37aa34b-a763-4e78-9667-de95e359f190 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:00.707650 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37aa34b-a763-4e78-9667-de95e359f190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:00.709333 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37aa34b-a763-4e78-9667-de95e359f190 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:00.728211 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1182/2342] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:03:00.733128 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f99479-a131-4af9-a6ab-e3f18190137d admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:00.747243 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f99479-a131-4af9-a6ab-e3f18190137d admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:00.760508 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdca83-993c-46b2-826e-4daa91777cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:00.763135 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdca83-993c-46b2-826e-4daa91777cdf admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:00.766999 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdca83-993c-46b2-826e-4daa91777cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:00.766999 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdca83-993c-46b2-826e-4daa91777cdf admin admin] PATH_INFO: `/v3/projects/9dcf9814e9b341a48dffd5d5cf728580/users/3d0a944488da42de9db0f9019f571492/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:00.789262 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cdca83-993c-46b2-826e-4daa91777cdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dcf9814e9b341a48dffd5d5cf728580, user_id=3d0a944488da42de9db0f9019f571492, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:00.793626 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cdca83-993c-46b2-826e-4daa91777cdf admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:00.959476 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1161/2343] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:03:00 2022] PUT /identity/v3/projects/9dcf9814e9b341a48dffd5d5cf728580/users/3d0a944488da42de9db0f9019f571492/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:03:00.970915 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dad6a4-d4d2-4c2d-a902-d363b630cfbe None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:00.971415 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dad6a4-d4d2-4c2d-a902-d363b630cfbe None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:00.971529 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dad6a4-d4d2-4c2d-a902-d363b630cfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:01.003161 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-b5dad6a4-d4d2-4c2d-a902-d363b630cfbe None None] MFA Rules not processed for user `3d0a944488da42de9db0f9019f571492`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:01.004361 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-b5dad6a4-d4d2-4c2d-a902-d363b630cfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:01.110540 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1183/2344] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:03:00 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:03:01.116268 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdca83-993c-46b2-826e-4daa91777cdf admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:01.186731 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdca83-993c-46b2-826e-4daa91777cdf admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:01.191466 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd6722-e847-464d-b739-2640ab6f25eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:01.192119 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd6722-e847-464d-b739-2640ab6f25eb admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:01.192399 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd6722-e847-464d-b739-2640ab6f25eb admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:01.192668 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd6722-e847-464d-b739-2640ab6f25eb admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:01.193433 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd6722-e847-464d-b739-2640ab6f25eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:01.195359 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd6722-e847-464d-b739-2640ab6f25eb admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:01.437902 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1162/2345] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:03:01 2022] POST /identity/v3/projects => generated 355 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:03:01.441798 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dad6a4-d4d2-4c2d-a902-d363b630cfbe None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:01.454056 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dad6a4-d4d2-4c2d-a902-d363b630cfbe None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:01.551225 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8035c-52ce-4c3f-a9e7-f8d40fe25dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:01.557882 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8035c-52ce-4c3f-a9e7-f8d40fe25dcd admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:01.558190 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8035c-52ce-4c3f-a9e7-f8d40fe25dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:01.558477 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8035c-52ce-4c3f-a9e7-f8d40fe25dcd admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:01.561226 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8035c-52ce-4c3f-a9e7-f8d40fe25dcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:01.567106 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8035c-52ce-4c3f-a9e7-f8d40fe25dcd admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:01.666273 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1184/2346] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:03:01 2022] POST /identity/v3/users => generated 284 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:03:01.669470 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd6722-e847-464d-b739-2640ab6f25eb admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:01.682315 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd6722-e847-464d-b739-2640ab6f25eb admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:01.688543 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111524e-acac-40ab-96ee-6f73c5309145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:01.689252 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111524e-acac-40ab-96ee-6f73c5309145 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:01.689541 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111524e-acac-40ab-96ee-6f73c5309145 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:01.689816 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111524e-acac-40ab-96ee-6f73c5309145 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:01.690562 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111524e-acac-40ab-96ee-6f73c5309145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:01.694042 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111524e-acac-40ab-96ee-6f73c5309145 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:01.712520 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1163/2347] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:03:01.720322 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8035c-52ce-4c3f-a9e7-f8d40fe25dcd admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:01.729047 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8035c-52ce-4c3f-a9e7-f8d40fe25dcd admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:01.734383 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111f32c-0f84-459d-9e7c-87c0986dca36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:01.735305 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111f32c-0f84-459d-9e7c-87c0986dca36 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:01.735587 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111f32c-0f84-459d-9e7c-87c0986dca36 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:01.743014 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111f32c-0f84-459d-9e7c-87c0986dca36 admin admin] PATH_INFO: `/v3/projects/bda5c991169d449fbf3e957eb34228f1/users/8bd08acf99d644e8932c2cd414c7f6e2/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:01.752768 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111f32c-0f84-459d-9e7c-87c0986dca36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bda5c991169d449fbf3e957eb34228f1, user_id=8bd08acf99d644e8932c2cd414c7f6e2, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:01.755836 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111f32c-0f84-459d-9e7c-87c0986dca36 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:01.851041 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1185/2348] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:03:01 2022] PUT /identity/v3/projects/bda5c991169d449fbf3e957eb34228f1/users/8bd08acf99d644e8932c2cd414c7f6e2/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:03:01.851935 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111524e-acac-40ab-96ee-6f73c5309145 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:01.864054 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111524e-acac-40ab-96ee-6f73c5309145 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:01.948099 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44e4fb-7109-4c14-ab46-263a89814306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:01.948989 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44e4fb-7109-4c14-ab46-263a89814306 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:01.949461 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44e4fb-7109-4c14-ab46-263a89814306 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:01.949886 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44e4fb-7109-4c14-ab46-263a89814306 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:01.950777 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44e4fb-7109-4c14-ab46-263a89814306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:01.953262 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44e4fb-7109-4c14-ab46-263a89814306 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:01.964562 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1164/2349] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:03:01.968572 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111f32c-0f84-459d-9e7c-87c0986dca36 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:01.980579 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111f32c-0f84-459d-9e7c-87c0986dca36 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:01.991877 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7763b-2fad-4d72-8ff7-c86d7230c5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:01.998030 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7763b-2fad-4d72-8ff7-c86d7230c5d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:01.998030 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7763b-2fad-4d72-8ff7-c86d7230c5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:01.998030 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7763b-2fad-4d72-8ff7-c86d7230c5d9 admin admin] PATH_INFO: `/v3/projects/bda5c991169d449fbf3e957eb34228f1/users/8bd08acf99d644e8932c2cd414c7f6e2/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:02.002026 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7763b-2fad-4d72-8ff7-c86d7230c5d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bda5c991169d449fbf3e957eb34228f1, user_id=8bd08acf99d644e8932c2cd414c7f6e2, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:02.005022 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7763b-2fad-4d72-8ff7-c86d7230c5d9 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:02.027732 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1186/2350] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:03:01 2022] PUT /identity/v3/projects/bda5c991169d449fbf3e957eb34228f1/users/8bd08acf99d644e8932c2cd414c7f6e2/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:03:02.030029 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace98570-50e9-4a24-a79f-6fd0c634afd8 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:02.030242 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace98570-50e9-4a24-a79f-6fd0c634afd8 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:02.030555 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace98570-50e9-4a24-a79f-6fd0c634afd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:02.076182 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-ace98570-50e9-4a24-a79f-6fd0c634afd8 None None] MFA Rules not processed for user `8bd08acf99d644e8932c2cd414c7f6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:02.077876 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-ace98570-50e9-4a24-a79f-6fd0c634afd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:02.212515 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1165/2351] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:03:02 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:03:02.219743 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7763b-2fad-4d72-8ff7-c86d7230c5d9 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:02.222108 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-96e7763b-2fad-4d72-8ff7-c86d7230c5d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:02.341900 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7763b-2fad-4d72-8ff7-c86d7230c5d9 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:02.350333 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb885ab-8075-4570-a54d-7d3c14d39fe7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:02.351011 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb885ab-8075-4570-a54d-7d3c14d39fe7 service cinder] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:02.351298 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb885ab-8075-4570-a54d-7d3c14d39fe7 service cinder] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:02.351578 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb885ab-8075-4570-a54d-7d3c14d39fe7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:02.377558 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb885ab-8075-4570-a54d-7d3c14d39fe7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:02.381540 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb885ab-8075-4570-a54d-7d3c14d39fe7 service cinder] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:02.430848 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1187/2352] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:03:02 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:03:02.578645 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a7746-5110-46af-8e50-d92a69c18f08 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:02.578929 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a7746-5110-46af-8e50-d92a69c18f08 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:02.579203 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a7746-5110-46af-8e50-d92a69c18f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:02.624389 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-368a7746-5110-46af-8e50-d92a69c18f08 None None] MFA Rules not processed for user `f5d3596bbc03474dafde93a63ea3e344`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:02.626306 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-368a7746-5110-46af-8e50-d92a69c18f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:02.732213 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1166/2353] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:03:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:03:02.739566 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb885ab-8075-4570-a54d-7d3c14d39fe7 service cinder] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:02.739566 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-5fb885ab-8075-4570-a54d-7d3c14d39fe7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:02.757021 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a7746-5110-46af-8e50-d92a69c18f08 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:02.770189 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a7746-5110-46af-8e50-d92a69c18f08 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:02.775376 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f327633-ab8d-4433-b02c-c8012f0f2807 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:02.776062 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f327633-ab8d-4433-b02c-c8012f0f2807 service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:02.776391 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f327633-ab8d-4433-b02c-c8012f0f2807 service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:02.776627 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f327633-ab8d-4433-b02c-c8012f0f2807 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:02.829345 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb885ab-8075-4570-a54d-7d3c14d39fe7 service cinder] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:02.834403 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492ef99-a9c2-4d9b-b3f4-8615848f1804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:02.835081 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492ef99-a9c2-4d9b-b3f4-8615848f1804 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:02.835392 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492ef99-a9c2-4d9b-b3f4-8615848f1804 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:02.835713 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492ef99-a9c2-4d9b-b3f4-8615848f1804 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:02.836397 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492ef99-a9c2-4d9b-b3f4-8615848f1804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:02.838538 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492ef99-a9c2-4d9b-b3f4-8615848f1804 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:02.848691 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f327633-ab8d-4433-b02c-c8012f0f2807 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:02.850806 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f327633-ab8d-4433-b02c-c8012f0f2807 service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:02.862290 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1167/2354] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:03:02 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:03:02.935708 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1188/2355] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:03:02 2022] POST /identity/v3/projects => generated 373 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:03:02.939838 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f327633-ab8d-4433-b02c-c8012f0f2807 service cinder] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:02.950856 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f327633-ab8d-4433-b02c-c8012f0f2807 service cinder] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:03.027047 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8447ca-3ec7-4116-8957-43858f828657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:03.028138 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8447ca-3ec7-4116-8957-43858f828657 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:03.028138 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8447ca-3ec7-4116-8957-43858f828657 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:03.028138 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8447ca-3ec7-4116-8957-43858f828657 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:03.029145 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8447ca-3ec7-4116-8957-43858f828657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:03.031570 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8447ca-3ec7-4116-8957-43858f828657 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:03.213326 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1168/2356] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:03:02 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:03:03.214522 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492ef99-a9c2-4d9b-b3f4-8615848f1804 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:03.226224 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492ef99-a9c2-4d9b-b3f4-8615848f1804 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:03.231058 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b82f1-845e-4e90-b1fe-d876bbc74aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:03.231715 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b82f1-845e-4e90-b1fe-d876bbc74aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:03.232001 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b82f1-845e-4e90-b1fe-d876bbc74aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:03.232276 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b82f1-845e-4e90-b1fe-d876bbc74aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:03.233019 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b82f1-845e-4e90-b1fe-d876bbc74aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:03.235227 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b82f1-845e-4e90-b1fe-d876bbc74aa0 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:03.245831 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1189/2357] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:03:03.250113 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8447ca-3ec7-4116-8957-43858f828657 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:03.260057 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8447ca-3ec7-4116-8957-43858f828657 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:03.264850 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c42ecf-78d4-4c70-abce-1251a4f740b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:03.265804 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c42ecf-78d4-4c70-abce-1251a4f740b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:03.266088 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c42ecf-78d4-4c70-abce-1251a4f740b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:03.266364 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c42ecf-78d4-4c70-abce-1251a4f740b2 admin admin] PATH_INFO: `/v3/projects/876c395cd3f14110b4af4a7988e9b4c1/users/0b556d32ef164705a403d0dcd9df62f8/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:03.282319 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c42ecf-78d4-4c70-abce-1251a4f740b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=876c395cd3f14110b4af4a7988e9b4c1, user_id=0b556d32ef164705a403d0dcd9df62f8, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:03.285003 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c42ecf-78d4-4c70-abce-1251a4f740b2 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:03.393294 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1169/2358] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:03:03 2022] PUT /identity/v3/projects/876c395cd3f14110b4af4a7988e9b4c1/users/0b556d32ef164705a403d0dcd9df62f8/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:03:03.397121 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b82f1-845e-4e90-b1fe-d876bbc74aa0 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:03.407780 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b82f1-845e-4e90-b1fe-d876bbc74aa0 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:03.523767 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81cf30-2fd0-4107-91e6-8c324e053408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:03.524800 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81cf30-2fd0-4107-91e6-8c324e053408 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:03.525121 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81cf30-2fd0-4107-91e6-8c324e053408 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:03.525412 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81cf30-2fd0-4107-91e6-8c324e053408 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:03.526155 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81cf30-2fd0-4107-91e6-8c324e053408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:03.527821 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81cf30-2fd0-4107-91e6-8c324e053408 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:03.538755 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1190/2359] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:03:03.542860 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c42ecf-78d4-4c70-abce-1251a4f740b2 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:03.557762 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c42ecf-78d4-4c70-abce-1251a4f740b2 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:03.563260 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8335d2a-4124-442d-844d-a89672a31bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:03.564168 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8335d2a-4124-442d-844d-a89672a31bc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:03.564456 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8335d2a-4124-442d-844d-a89672a31bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:03.564765 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8335d2a-4124-442d-844d-a89672a31bc1 admin admin] PATH_INFO: `/v3/projects/876c395cd3f14110b4af4a7988e9b4c1/users/0b556d32ef164705a403d0dcd9df62f8/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:03.568023 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8335d2a-4124-442d-844d-a89672a31bc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=876c395cd3f14110b4af4a7988e9b4c1, user_id=0b556d32ef164705a403d0dcd9df62f8, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:03.571301 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8335d2a-4124-442d-844d-a89672a31bc1 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:03.585819 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1170/2360] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:03:03 2022] PUT /identity/v3/projects/876c395cd3f14110b4af4a7988e9b4c1/users/0b556d32ef164705a403d0dcd9df62f8/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:03:04.035347 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab753aa-93c4-407e-bd75-16ac2713a9fa None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:04.035634 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab753aa-93c4-407e-bd75-16ac2713a9fa None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:04.036293 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab753aa-93c4-407e-bd75-16ac2713a9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:04.061541 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-cab753aa-93c4-407e-bd75-16ac2713a9fa None None] MFA Rules not processed for user `29314b0be6534c79b36f31402d51d17b`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:04.064371 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-cab753aa-93c4-407e-bd75-16ac2713a9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:04.148969 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1191/2361] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Jan 5 15:03:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:03:04.181238 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8335d2a-4124-442d-844d-a89672a31bc1 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:04.183122 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-b8335d2a-4124-442d-844d-a89672a31bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:04.264274 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8335d2a-4124-442d-844d-a89672a31bc1 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:04.272628 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1eca6b-7692-4afb-b098-9ab12b2abe34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ea13fd3e704b16aad5a38606ddc049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:04.273725 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1eca6b-7692-4afb-b098-9ab12b2abe34 service swift] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:04.274297 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1eca6b-7692-4afb-b098-9ab12b2abe34 service swift] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:04.274815 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1eca6b-7692-4afb-b098-9ab12b2abe34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:04.286267 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1eca6b-7692-4afb-b098-9ab12b2abe34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:04.288743 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1eca6b-7692-4afb-b098-9ab12b2abe34 service swift] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:04.319231 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1171/2362] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jan 5 15:03:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 15:03:14.106049 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2541154-c62a-4548-8753-7835213dc612 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:14.123229 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2541154-c62a-4548-8753-7835213dc612 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:14.123229 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2541154-c62a-4548-8753-7835213dc612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:14.178127 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-f2541154-c62a-4548-8753-7835213dc612 None None] MFA Rules not processed for user `0b556d32ef164705a403d0dcd9df62f8`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:14.180521 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-f2541154-c62a-4548-8753-7835213dc612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:14.450514 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1192/2363] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:03:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:03:14.464394 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1eca6b-7692-4afb-b098-9ab12b2abe34 service swift] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:14.467068 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-eb1eca6b-7692-4afb-b098-9ab12b2abe34 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:14.605103 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1eca6b-7692-4afb-b098-9ab12b2abe34 service swift] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:14.612272 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ccd73-22d9-4cda-b0b0-cad34ce349c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:14.612928 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ccd73-22d9-4cda-b0b0-cad34ce349c4 service nova] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:14.613247 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ccd73-22d9-4cda-b0b0-cad34ce349c4 service nova] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:14.613530 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ccd73-22d9-4cda-b0b0-cad34ce349c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:14.682102 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ccd73-22d9-4cda-b0b0-cad34ce349c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:14.684456 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ccd73-22d9-4cda-b0b0-cad34ce349c4 service nova] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:14.696675 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1172/2364] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:03:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:03:18.480899 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa0b62-d776-4522-9b47-ef93afbc299d None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:18.481562 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa0b62-d776-4522-9b47-ef93afbc299d None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:18.481562 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa0b62-d776-4522-9b47-ef93afbc299d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:18.501679 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-4efa0b62-d776-4522-9b47-ef93afbc299d None None] MFA Rules not processed for user `f5d3596bbc03474dafde93a63ea3e344`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:18.502925 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-4efa0b62-d776-4522-9b47-ef93afbc299d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:18.510832 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1193/2365] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:03:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:03:25.531704 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ccd73-22d9-4cda-b0b0-cad34ce349c4 service nova] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:25.594646 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ccd73-22d9-4cda-b0b0-cad34ce349c4 service nova] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:25.599415 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30114e5b-9824-4dbe-925d-df8eb7d5c7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:25.600280 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30114e5b-9824-4dbe-925d-df8eb7d5c7c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:25.600600 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30114e5b-9824-4dbe-925d-df8eb7d5c7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:25.600875 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30114e5b-9824-4dbe-925d-df8eb7d5c7c5 admin admin] PATH_INFO: `/v3/users/3d0a944488da42de9db0f9019f571492` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:25.602122 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30114e5b-9824-4dbe-925d-df8eb7d5c7c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d0a944488da42de9db0f9019f571492)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:25.604557 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30114e5b-9824-4dbe-925d-df8eb7d5c7c5 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:25.807700 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-30114e5b-9824-4dbe-925d-df8eb7d5c7c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d0a944488da42de9db0f9019f571492'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:25.814513 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-30114e5b-9824-4dbe-925d-df8eb7d5c7c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d0a944488da42de9db0f9019f571492'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:25.815216 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-30114e5b-9824-4dbe-925d-df8eb7d5c7c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d0a944488da42de9db0f9019f571492'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:25.914558 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-30114e5b-9824-4dbe-925d-df8eb7d5c7c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d0a944488da42de9db0f9019f571492'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:25.927885 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-30114e5b-9824-4dbe-925d-df8eb7d5c7c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d0a944488da42de9db0f9019f571492'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:25.933778 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1173/2366] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:03:25 2022] DELETE /identity/v3/users/3d0a944488da42de9db0f9019f571492 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:03:25.938578 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c8a9a-05a5-4db3-be6d-9c7e84d634c4 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:25.944768 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c8a9a-05a5-4db3-be6d-9c7e84d634c4 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:25.944768 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c8a9a-05a5-4db3-be6d-9c7e84d634c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:25.957898 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-620c8a9a-05a5-4db3-be6d-9c7e84d634c4 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:25.959093 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-620c8a9a-05a5-4db3-be6d-9c7e84d634c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:26.018830 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1194/2367] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:03:26.028445 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30114e5b-9824-4dbe-925d-df8eb7d5c7c5 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:26.029861 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-30114e5b-9824-4dbe-925d-df8eb7d5c7c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:26.090023 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30114e5b-9824-4dbe-925d-df8eb7d5c7c5 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:26.094173 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2410bb4-af5f-434c-9f02-fd57af3b3500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:26.094805 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2410bb4-af5f-434c-9f02-fd57af3b3500 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:26.095150 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2410bb4-af5f-434c-9f02-fd57af3b3500 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:26.095415 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2410bb4-af5f-434c-9f02-fd57af3b3500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:26.104341 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2410bb4-af5f-434c-9f02-fd57af3b3500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:26.105807 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2410bb4-af5f-434c-9f02-fd57af3b3500 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:26.114901 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1174/2368] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:03:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 15:03:26.489787 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e2748-854b-4637-bc20-961106d1cde5 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:26.490137 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e2748-854b-4637-bc20-961106d1cde5 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:26.490438 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e2748-854b-4637-bc20-961106d1cde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:26.509039 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-456e2748-854b-4637-bc20-961106d1cde5 None None] MFA Rules not processed for user `29314b0be6534c79b36f31402d51d17b`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:26.511406 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-456e2748-854b-4637-bc20-961106d1cde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:26.563393 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1195/2369] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Jan 5 15:03:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:03:26.568616 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2410bb4-af5f-434c-9f02-fd57af3b3500 service neutron] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:26.571830 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-b2410bb4-af5f-434c-9f02-fd57af3b3500 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:26.581843 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e2748-854b-4637-bc20-961106d1cde5 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:26.584272 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-456e2748-854b-4637-bc20-961106d1cde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:26.584909 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2410bb4-af5f-434c-9f02-fd57af3b3500 service neutron] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:26.605855 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df793f76-a72a-472c-9ae1-bd71c31a2956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:26.609042 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df793f76-a72a-472c-9ae1-bd71c31a2956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:26.609042 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df793f76-a72a-472c-9ae1-bd71c31a2956 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:26.609042 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df793f76-a72a-472c-9ae1-bd71c31a2956 admin admin] PATH_INFO: `/v3/projects/9dcf9814e9b341a48dffd5d5cf728580` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:26.609042 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df793f76-a72a-472c-9ae1-bd71c31a2956 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dcf9814e9b341a48dffd5d5cf728580)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:26.611202 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df793f76-a72a-472c-9ae1-bd71c31a2956 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:26.662960 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e2748-854b-4637-bc20-961106d1cde5 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:26.667959 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a700ca6-74ab-48e4-b8fb-5775dde1aa5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ea13fd3e704b16aad5a38606ddc049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:26.668599 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a700ca6-74ab-48e4-b8fb-5775dde1aa5c service swift] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:26.668879 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a700ca6-74ab-48e4-b8fb-5775dde1aa5c service swift] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:26.669182 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a700ca6-74ab-48e4-b8fb-5775dde1aa5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:26.677685 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a700ca6-74ab-48e4-b8fb-5775dde1aa5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:26.679489 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a700ca6-74ab-48e4-b8fb-5775dde1aa5c service swift] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:26.688981 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1196/2370] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jan 5 15:03:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 05 15:03:26.737472 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-df793f76-a72a-472c-9ae1-bd71c31a2956 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dcf9814e9b341a48dffd5d5cf728580', 'request_id': 'req-df793f76-a72a-472c-9ae1-bd71c31a2956'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:26.744814 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-df793f76-a72a-472c-9ae1-bd71c31a2956 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dcf9814e9b341a48dffd5d5cf728580', 'request_id': 'req-df793f76-a72a-472c-9ae1-bd71c31a2956'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:26.751147 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-df793f76-a72a-472c-9ae1-bd71c31a2956 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dcf9814e9b341a48dffd5d5cf728580', 'request_id': 'req-df793f76-a72a-472c-9ae1-bd71c31a2956'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:26.850030 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-df793f76-a72a-472c-9ae1-bd71c31a2956 admin admin] The token cache is being invalidate because project 9dcf9814e9b341a48dffd5d5cf728580 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:03:26.850548 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-df793f76-a72a-472c-9ae1-bd71c31a2956 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:26.851376 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-df793f76-a72a-472c-9ae1-bd71c31a2956 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:26.854341 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1175/2371] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:03:26 2022] DELETE /identity/v3/projects/9dcf9814e9b341a48dffd5d5cf728580 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:03:26.858959 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a700ca6-74ab-48e4-b8fb-5775dde1aa5c service swift] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:26.869630 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a700ca6-74ab-48e4-b8fb-5775dde1aa5c service swift] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:26.948259 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7abf99-f092-49b5-9a02-9e4d474d6ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:26.949054 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7abf99-f092-49b5-9a02-9e4d474d6ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:26.949571 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7abf99-f092-49b5-9a02-9e4d474d6ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:26.949928 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7abf99-f092-49b5-9a02-9e4d474d6ab6 admin admin] PATH_INFO: `/v3/users/8bd08acf99d644e8932c2cd414c7f6e2` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:26.951370 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7abf99-f092-49b5-9a02-9e4d474d6ab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bd08acf99d644e8932c2cd414c7f6e2)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:26.953432 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7abf99-f092-49b5-9a02-9e4d474d6ab6 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:27.313748 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-6f7abf99-f092-49b5-9a02-9e4d474d6ab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bd08acf99d644e8932c2cd414c7f6e2'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:27.321013 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-6f7abf99-f092-49b5-9a02-9e4d474d6ab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bd08acf99d644e8932c2cd414c7f6e2'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:27.321727 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-6f7abf99-f092-49b5-9a02-9e4d474d6ab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bd08acf99d644e8932c2cd414c7f6e2'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:27.322431 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-6f7abf99-f092-49b5-9a02-9e4d474d6ab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bd08acf99d644e8932c2cd414c7f6e2'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:27.415130 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-6f7abf99-f092-49b5-9a02-9e4d474d6ab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bd08acf99d644e8932c2cd414c7f6e2'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:27.433191 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1197/2372] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:03:26 2022] DELETE /identity/v3/users/8bd08acf99d644e8932c2cd414c7f6e2 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:03:27.546197 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c209c-178b-4487-a215-1d6892f32f28 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:27.546489 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c209c-178b-4487-a215-1d6892f32f28 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:27.546772 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c209c-178b-4487-a215-1d6892f32f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:27.564848 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-123c209c-178b-4487-a215-1d6892f32f28 None None] MFA Rules not processed for user `29314b0be6534c79b36f31402d51d17b`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:27.568944 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-123c209c-178b-4487-a215-1d6892f32f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:27.621959 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1176/2373] 10.222.0.30 () {58 vars in 967 bytes} [Wed Jan 5 15:03:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:03:27.636565 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7abf99-f092-49b5-9a02-9e4d474d6ab6 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:27.638170 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-6f7abf99-f092-49b5-9a02-9e4d474d6ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:27.711159 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7abf99-f092-49b5-9a02-9e4d474d6ab6 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:27.718324 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369fd298-112b-4f2e-932c-8fc93c175b3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ea13fd3e704b16aad5a38606ddc049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:27.719027 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fd298-112b-4f2e-932c-8fc93c175b3f service swift] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:27.719306 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fd298-112b-4f2e-932c-8fc93c175b3f service swift] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:27.719579 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fd298-112b-4f2e-932c-8fc93c175b3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:27.729419 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369fd298-112b-4f2e-932c-8fc93c175b3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:27.731061 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369fd298-112b-4f2e-932c-8fc93c175b3f service swift] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:27.740743 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1198/2374] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jan 5 15:03:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 05 15:03:27.924944 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c209c-178b-4487-a215-1d6892f32f28 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:27.926380 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-123c209c-178b-4487-a215-1d6892f32f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:28.005513 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c209c-178b-4487-a215-1d6892f32f28 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:28.010033 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ec731-ea6d-4409-a91f-e74e85fbd1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:28.010988 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ec731-ea6d-4409-a91f-e74e85fbd1af admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:28.011220 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ec731-ea6d-4409-a91f-e74e85fbd1af admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:28.011497 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ec731-ea6d-4409-a91f-e74e85fbd1af admin admin] PATH_INFO: `/v3/projects/bda5c991169d449fbf3e957eb34228f1` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:28.012693 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ec731-ea6d-4409-a91f-e74e85fbd1af admin admin] RBAC: Authorizing `identity:delete_project(project_id=bda5c991169d449fbf3e957eb34228f1)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:28.015269 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ec731-ea6d-4409-a91f-e74e85fbd1af admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:28.187479 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e38ec731-ea6d-4409-a91f-e74e85fbd1af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bda5c991169d449fbf3e957eb34228f1', 'request_id': 'req-e38ec731-ea6d-4409-a91f-e74e85fbd1af'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:28.193974 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e38ec731-ea6d-4409-a91f-e74e85fbd1af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bda5c991169d449fbf3e957eb34228f1', 'request_id': 'req-e38ec731-ea6d-4409-a91f-e74e85fbd1af'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:28.200310 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e38ec731-ea6d-4409-a91f-e74e85fbd1af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bda5c991169d449fbf3e957eb34228f1', 'request_id': 'req-e38ec731-ea6d-4409-a91f-e74e85fbd1af'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:28.308959 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e38ec731-ea6d-4409-a91f-e74e85fbd1af admin admin] The token cache is being invalidate because project bda5c991169d449fbf3e957eb34228f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:03:28.309283 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e38ec731-ea6d-4409-a91f-e74e85fbd1af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:28.309917 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e38ec731-ea6d-4409-a91f-e74e85fbd1af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:28.312367 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1177/2375] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:03:27 2022] DELETE /identity/v3/projects/bda5c991169d449fbf3e957eb34228f1 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:03:28.317894 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd28aaf-7d8f-4aa6-a804-fdc50e1492e6 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:28.318401 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd28aaf-7d8f-4aa6-a804-fdc50e1492e6 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:28.318592 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd28aaf-7d8f-4aa6-a804-fdc50e1492e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:28.340666 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-dcd28aaf-7d8f-4aa6-a804-fdc50e1492e6 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:28.342074 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-dcd28aaf-7d8f-4aa6-a804-fdc50e1492e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:28.405338 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1199/2376] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:03:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:03:28.413719 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54eedb5-7b84-4909-94e2-c4a84f49facf None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:28.414019 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54eedb5-7b84-4909-94e2-c4a84f49facf None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:28.417454 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54eedb5-7b84-4909-94e2-c4a84f49facf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:28.434251 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-d54eedb5-7b84-4909-94e2-c4a84f49facf None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:28.435657 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-d54eedb5-7b84-4909-94e2-c4a84f49facf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:28.445108 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1178/2377] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:03:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:03:28.454891 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd28aaf-7d8f-4aa6-a804-fdc50e1492e6 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:28.459135 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd28aaf-7d8f-4aa6-a804-fdc50e1492e6 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:28.463910 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19167f5a-0790-4de2-a899-03e36b140745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:28.464556 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19167f5a-0790-4de2-a899-03e36b140745 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:28.464837 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19167f5a-0790-4de2-a899-03e36b140745 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:28.465344 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19167f5a-0790-4de2-a899-03e36b140745 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:28.466243 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19167f5a-0790-4de2-a899-03e36b140745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:03:28.466550 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19167f5a-0790-4de2-a899-03e36b140745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:28.472661 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19167f5a-0790-4de2-a899-03e36b140745 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:28.483671 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1200/2378] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 15:03:28.487347 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54eedb5-7b84-4909-94e2-c4a84f49facf None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:28.496823 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54eedb5-7b84-4909-94e2-c4a84f49facf None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:28.502207 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971e544-a5ad-4598-9ea2-4a3ad7475d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:28.502860 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971e544-a5ad-4598-9ea2-4a3ad7475d46 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:28.503141 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971e544-a5ad-4598-9ea2-4a3ad7475d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:28.503418 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971e544-a5ad-4598-9ea2-4a3ad7475d46 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:28.504163 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971e544-a5ad-4598-9ea2-4a3ad7475d46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:28.506098 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971e544-a5ad-4598-9ea2-4a3ad7475d46 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:28.599869 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1179/2379] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:03:28 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:03:28.604396 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19167f5a-0790-4de2-a899-03e36b140745 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:28.614675 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19167f5a-0790-4de2-a899-03e36b140745 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:28.672326 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2d47e-0c52-4efa-8e85-8aa19fdd270a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:28.673053 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2d47e-0c52-4efa-8e85-8aa19fdd270a admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:28.673372 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2d47e-0c52-4efa-8e85-8aa19fdd270a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:28.673653 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2d47e-0c52-4efa-8e85-8aa19fdd270a admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:28.674486 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2d47e-0c52-4efa-8e85-8aa19fdd270a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:28.676430 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2d47e-0c52-4efa-8e85-8aa19fdd270a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:28.754017 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8fab8-6b5f-4ea6-8295-a166c586953d None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:28.754305 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8fab8-6b5f-4ea6-8295-a166c586953d None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:28.754584 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8fab8-6b5f-4ea6-8295-a166c586953d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:28.773086 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-01b8fab8-6b5f-4ea6-8295-a166c586953d None None] MFA Rules not processed for user `29314b0be6534c79b36f31402d51d17b`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:28.774656 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-01b8fab8-6b5f-4ea6-8295-a166c586953d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:28.820322 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1201/2380] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:03:28 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:03:28.823017 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2d47e-0c52-4efa-8e85-8aa19fdd270a admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:28.832804 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2d47e-0c52-4efa-8e85-8aa19fdd270a admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:28.835235 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1180/2381] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Jan 5 15:03:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:03:28.837708 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4428252-3e5a-4198-9b54-de3ea0d80edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:28.838353 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4428252-3e5a-4198-9b54-de3ea0d80edf admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:28.838635 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4428252-3e5a-4198-9b54-de3ea0d80edf admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:28.838908 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4428252-3e5a-4198-9b54-de3ea0d80edf admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:28.839637 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4428252-3e5a-4198-9b54-de3ea0d80edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:28.841252 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4428252-3e5a-4198-9b54-de3ea0d80edf admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:28.847605 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8fab8-6b5f-4ea6-8295-a166c586953d None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:28.848973 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-01b8fab8-6b5f-4ea6-8295-a166c586953d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:28.852684 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1202/2382] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:03:28.856627 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4428252-3e5a-4198-9b54-de3ea0d80edf admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:28.866756 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4428252-3e5a-4198-9b54-de3ea0d80edf admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:28.871861 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60e04f-5a89-4308-9862-414c3a1fc753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:28.872502 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60e04f-5a89-4308-9862-414c3a1fc753 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:28.872786 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60e04f-5a89-4308-9862-414c3a1fc753 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:28.873086 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60e04f-5a89-4308-9862-414c3a1fc753 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:28.873845 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd60e04f-5a89-4308-9862-414c3a1fc753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:28.875494 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd60e04f-5a89-4308-9862-414c3a1fc753 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:28.889437 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1203/2383] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:03:28.890853 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60e04f-5a89-4308-9862-414c3a1fc753 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:28.900711 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60e04f-5a89-4308-9862-414c3a1fc753 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:28.905929 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cd9a9-db7e-400c-95b3-ce414dec2a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:28.906783 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cd9a9-db7e-400c-95b3-ce414dec2a2e admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:28.907066 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cd9a9-db7e-400c-95b3-ce414dec2a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:28.907342 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cd9a9-db7e-400c-95b3-ce414dec2a2e admin admin] PATH_INFO: `/v3/projects/2c06135fc8ef44298712e69b66cfa064/users/f82dd1b82a5c4478a472119fd06f794b/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:28.915945 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8fab8-6b5f-4ea6-8295-a166c586953d None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:28.921212 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bdffca-f23f-4ea8-afeb-b88176687b27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ea13fd3e704b16aad5a38606ddc049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:28.921756 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cd9a9-db7e-400c-95b3-ce414dec2a2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c06135fc8ef44298712e69b66cfa064, user_id=f82dd1b82a5c4478a472119fd06f794b, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:28.921975 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdffca-f23f-4ea8-afeb-b88176687b27 service swift] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:28.922164 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdffca-f23f-4ea8-afeb-b88176687b27 service swift] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:28.922439 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdffca-f23f-4ea8-afeb-b88176687b27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:28.924397 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cd9a9-db7e-400c-95b3-ce414dec2a2e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:28.930628 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bdffca-f23f-4ea8-afeb-b88176687b27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:28.932183 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bdffca-f23f-4ea8-afeb-b88176687b27 service swift] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:28.940547 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1181/2384] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jan 5 15:03:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 05 15:03:29.001092 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1204/2385] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:03:28 2022] PUT /identity/v3/projects/2c06135fc8ef44298712e69b66cfa064/users/f82dd1b82a5c4478a472119fd06f794b/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:03:29.011195 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344052c8-b311-4abf-b1eb-d63ef078cfce None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:29.011476 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344052c8-b311-4abf-b1eb-d63ef078cfce None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:29.011755 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344052c8-b311-4abf-b1eb-d63ef078cfce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:29.038204 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-344052c8-b311-4abf-b1eb-d63ef078cfce None None] MFA Rules not processed for user `f82dd1b82a5c4478a472119fd06f794b`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:29.039497 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-344052c8-b311-4abf-b1eb-d63ef078cfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:29.107965 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1182/2386] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:03:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:03:29.112922 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cd9a9-db7e-400c-95b3-ce414dec2a2e admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:29.176309 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cd9a9-db7e-400c-95b3-ce414dec2a2e admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:29.180975 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e590fe-fe2e-4d5a-bdc0-72b2a2cf9e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:29.181678 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e590fe-fe2e-4d5a-bdc0-72b2a2cf9e6b admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:29.181960 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e590fe-fe2e-4d5a-bdc0-72b2a2cf9e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:29.182231 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e590fe-fe2e-4d5a-bdc0-72b2a2cf9e6b admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:29.182935 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e590fe-fe2e-4d5a-bdc0-72b2a2cf9e6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:29.185040 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e590fe-fe2e-4d5a-bdc0-72b2a2cf9e6b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:29.305861 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1205/2387] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:03:29 2022] POST /identity/v3/projects => generated 387 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:03:29.306982 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344052c8-b311-4abf-b1eb-d63ef078cfce None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:29.318414 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344052c8-b311-4abf-b1eb-d63ef078cfce None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:29.374907 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fa3a4-c9c3-444d-aad4-a34dc3e5e862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:29.375572 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fa3a4-c9c3-444d-aad4-a34dc3e5e862 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:29.375857 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fa3a4-c9c3-444d-aad4-a34dc3e5e862 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:29.376126 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fa3a4-c9c3-444d-aad4-a34dc3e5e862 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:29.377218 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fa3a4-c9c3-444d-aad4-a34dc3e5e862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:29.380773 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fa3a4-c9c3-444d-aad4-a34dc3e5e862 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:29.464501 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1183/2388] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:03:29 2022] POST /identity/v3/users => generated 300 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:03:29.466037 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e590fe-fe2e-4d5a-bdc0-72b2a2cf9e6b admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:29.476819 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e590fe-fe2e-4d5a-bdc0-72b2a2cf9e6b admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:29.481945 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e015af-de06-477c-8c89-be6102029587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:29.482474 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e015af-de06-477c-8c89-be6102029587 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:29.482940 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e015af-de06-477c-8c89-be6102029587 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:29.483087 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e015af-de06-477c-8c89-be6102029587 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:29.484358 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e015af-de06-477c-8c89-be6102029587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:29.485973 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e015af-de06-477c-8c89-be6102029587 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:29.498386 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1206/2389] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:03:29.502392 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fa3a4-c9c3-444d-aad4-a34dc3e5e862 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:29.513570 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fa3a4-c9c3-444d-aad4-a34dc3e5e862 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:29.519030 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b8948-5aa6-40e8-8306-3c79a6fb310e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:29.519906 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b8948-5aa6-40e8-8306-3c79a6fb310e admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:29.520192 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b8948-5aa6-40e8-8306-3c79a6fb310e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:29.520472 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b8948-5aa6-40e8-8306-3c79a6fb310e admin admin] PATH_INFO: `/v3/projects/f7fb6224dfc9469389aae2ad9c9eeecd/users/4c87764c37a24a52b9e48681dfd47b26/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:29.548135 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b8948-5aa6-40e8-8306-3c79a6fb310e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7fb6224dfc9469389aae2ad9c9eeecd, user_id=4c87764c37a24a52b9e48681dfd47b26, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:29.550827 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b8948-5aa6-40e8-8306-3c79a6fb310e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:29.638736 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6af61-13d2-4118-8377-0a16d7f26c21 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:29.639030 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6af61-13d2-4118-8377-0a16d7f26c21 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:29.639396 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6af61-13d2-4118-8377-0a16d7f26c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:29.658218 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-b6a6af61-13d2-4118-8377-0a16d7f26c21 None None] MFA Rules not processed for user `29314b0be6534c79b36f31402d51d17b`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:29.659516 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-b6a6af61-13d2-4118-8377-0a16d7f26c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:29.661735 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1184/2390] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:03:29 2022] PUT /identity/v3/projects/f7fb6224dfc9469389aae2ad9c9eeecd/users/4c87764c37a24a52b9e48681dfd47b26/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:03:29.665991 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b8948-5aa6-40e8-8306-3c79a6fb310e admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:29.720268 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1207/2391] 10.222.0.30 () {58 vars in 967 bytes} [Wed Jan 5 15:03:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:03:29.726726 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b8948-5aa6-40e8-8306-3c79a6fb310e admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:29.731709 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade79596-c7f5-43b7-8dd4-a3cb158200bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:29.732374 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade79596-c7f5-43b7-8dd4-a3cb158200bc admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:29.732659 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade79596-c7f5-43b7-8dd4-a3cb158200bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:29.732937 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade79596-c7f5-43b7-8dd4-a3cb158200bc admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:29.734244 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6af61-13d2-4118-8377-0a16d7f26c21 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:29.734357 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade79596-c7f5-43b7-8dd4-a3cb158200bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:29.735865 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade79596-c7f5-43b7-8dd4-a3cb158200bc admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:29.745964 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1185/2392] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:03:29.749923 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade79596-c7f5-43b7-8dd4-a3cb158200bc admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:29.759716 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade79596-c7f5-43b7-8dd4-a3cb158200bc admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:29.765021 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4a23f-2704-45ad-983e-89010507ba6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:29.765989 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4a23f-2704-45ad-983e-89010507ba6b admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:29.766276 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4a23f-2704-45ad-983e-89010507ba6b admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:29.766549 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4a23f-2704-45ad-983e-89010507ba6b admin admin] PATH_INFO: `/v3/projects/f7fb6224dfc9469389aae2ad9c9eeecd/users/4c87764c37a24a52b9e48681dfd47b26/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:29.768560 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4a23f-2704-45ad-983e-89010507ba6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7fb6224dfc9469389aae2ad9c9eeecd, user_id=4c87764c37a24a52b9e48681dfd47b26, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:29.771238 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4a23f-2704-45ad-983e-89010507ba6b admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:29.782558 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1186/2393] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:03:29 2022] PUT /identity/v3/projects/f7fb6224dfc9469389aae2ad9c9eeecd/users/4c87764c37a24a52b9e48681dfd47b26/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:03:29.792413 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c1fe2-55ed-4ccf-848a-1b211554177c None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:29.792691 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c1fe2-55ed-4ccf-848a-1b211554177c None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:29.792972 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c1fe2-55ed-4ccf-848a-1b211554177c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:29.804440 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6af61-13d2-4118-8377-0a16d7f26c21 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:29.818913 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-b68c1fe2-55ed-4ccf-848a-1b211554177c None None] MFA Rules not processed for user `4c87764c37a24a52b9e48681dfd47b26`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:29.820355 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-b68c1fe2-55ed-4ccf-848a-1b211554177c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:29.869704 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a5603-1fa7-4373-94a9-d5b38b651271 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ea13fd3e704b16aad5a38606ddc049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:29.870358 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a5603-1fa7-4373-94a9-d5b38b651271 service swift] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:29.870638 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a5603-1fa7-4373-94a9-d5b38b651271 service swift] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:29.870913 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a5603-1fa7-4373-94a9-d5b38b651271 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:29.897196 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1187/2394] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:03:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:03:29.904591 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c1fe2-55ed-4ccf-848a-1b211554177c None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:29.907512 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-b68c1fe2-55ed-4ccf-848a-1b211554177c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:29.930421 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a5603-1fa7-4373-94a9-d5b38b651271 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:29.932024 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a5603-1fa7-4373-94a9-d5b38b651271 service swift] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:29.940689 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1208/2395] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jan 5 15:03:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 05 15:03:29.972458 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c1fe2-55ed-4ccf-848a-1b211554177c None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:29.976115 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16446c-d2ad-414c-83e4-bbeb332a292f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:29.979746 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16446c-d2ad-414c-83e4-bbeb332a292f service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:29.979746 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16446c-d2ad-414c-83e4-bbeb332a292f service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:29.979746 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16446c-d2ad-414c-83e4-bbeb332a292f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:29.986915 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16446c-d2ad-414c-83e4-bbeb332a292f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:29.988361 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16446c-d2ad-414c-83e4-bbeb332a292f service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:29.998437 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1188/2396] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:03:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 15:03:30.062629 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a5603-1fa7-4373-94a9-d5b38b651271 service swift] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:30.125778 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a5603-1fa7-4373-94a9-d5b38b651271 service swift] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:30.130383 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a54ea6-bb49-4685-bb73-084caae34266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:30.131247 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a54ea6-bb49-4685-bb73-084caae34266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:30.131527 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a54ea6-bb49-4685-bb73-084caae34266 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:30.131801 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a54ea6-bb49-4685-bb73-084caae34266 admin admin] PATH_INFO: `/v3/users/f82dd1b82a5c4478a472119fd06f794b` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:30.132985 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a54ea6-bb49-4685-bb73-084caae34266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f82dd1b82a5c4478a472119fd06f794b)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:30.134944 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a54ea6-bb49-4685-bb73-084caae34266 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:30.413308 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-f5a54ea6-bb49-4685-bb73-084caae34266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f82dd1b82a5c4478a472119fd06f794b'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:30.420190 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-f5a54ea6-bb49-4685-bb73-084caae34266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f82dd1b82a5c4478a472119fd06f794b'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:30.420967 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-f5a54ea6-bb49-4685-bb73-084caae34266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f82dd1b82a5c4478a472119fd06f794b'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:30.421781 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-f5a54ea6-bb49-4685-bb73-084caae34266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f82dd1b82a5c4478a472119fd06f794b'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:30.501085 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-f5a54ea6-bb49-4685-bb73-084caae34266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f82dd1b82a5c4478a472119fd06f794b'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:30.527189 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1209/2397] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:03:30 2022] DELETE /identity/v3/users/f82dd1b82a5c4478a472119fd06f794b => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:03:30.532599 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c2dd7-34d0-462e-b24d-4a2ef34379c6 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:30.533205 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c2dd7-34d0-462e-b24d-4a2ef34379c6 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:30.538729 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c2dd7-34d0-462e-b24d-4a2ef34379c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:30.554489 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-be5c2dd7-34d0-462e-b24d-4a2ef34379c6 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:30.555796 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-be5c2dd7-34d0-462e-b24d-4a2ef34379c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:30.618910 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1189/2398] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:03:30.629384 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a54ea6-bb49-4685-bb73-084caae34266 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:30.630859 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-f5a54ea6-bb49-4685-bb73-084caae34266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:30.696063 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a54ea6-bb49-4685-bb73-084caae34266 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:30.700982 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b662c4-1cb9-4b9b-8e30-f63cede795dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:30.701754 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b662c4-1cb9-4b9b-8e30-f63cede795dd service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:30.702172 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b662c4-1cb9-4b9b-8e30-f63cede795dd service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:30.702452 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b662c4-1cb9-4b9b-8e30-f63cede795dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:30.712730 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b662c4-1cb9-4b9b-8e30-f63cede795dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:30.715413 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b662c4-1cb9-4b9b-8e30-f63cede795dd service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:30.727015 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1210/2399] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:03:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 15:03:31.168412 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c2dd7-34d0-462e-b24d-4a2ef34379c6 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:31.169553 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-be5c2dd7-34d0-462e-b24d-4a2ef34379c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:31.184789 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c2dd7-34d0-462e-b24d-4a2ef34379c6 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:31.191491 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b38f41-5be5-4f3a-b573-7942335efa3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:31.194216 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b38f41-5be5-4f3a-b573-7942335efa3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:31.194216 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b38f41-5be5-4f3a-b573-7942335efa3d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:31.194216 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b38f41-5be5-4f3a-b573-7942335efa3d admin admin] PATH_INFO: `/v3/projects/2c06135fc8ef44298712e69b66cfa064` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:31.194216 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b38f41-5be5-4f3a-b573-7942335efa3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c06135fc8ef44298712e69b66cfa064)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:31.196210 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b38f41-5be5-4f3a-b573-7942335efa3d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:31.336783 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-d6b38f41-5be5-4f3a-b573-7942335efa3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c06135fc8ef44298712e69b66cfa064', 'request_id': 'req-d6b38f41-5be5-4f3a-b573-7942335efa3d'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:31.344534 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-d6b38f41-5be5-4f3a-b573-7942335efa3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c06135fc8ef44298712e69b66cfa064', 'request_id': 'req-d6b38f41-5be5-4f3a-b573-7942335efa3d'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:31.354324 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-d6b38f41-5be5-4f3a-b573-7942335efa3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c06135fc8ef44298712e69b66cfa064', 'request_id': 'req-d6b38f41-5be5-4f3a-b573-7942335efa3d'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:31.412343 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-d6b38f41-5be5-4f3a-b573-7942335efa3d admin admin] The token cache is being invalidate because project 2c06135fc8ef44298712e69b66cfa064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:03:31.412779 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-d6b38f41-5be5-4f3a-b573-7942335efa3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:31.413429 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-d6b38f41-5be5-4f3a-b573-7942335efa3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:31.415036 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1190/2400] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:03:31 2022] DELETE /identity/v3/projects/2c06135fc8ef44298712e69b66cfa064 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:03:31.419072 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b662c4-1cb9-4b9b-8e30-f63cede795dd service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:31.429676 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b662c4-1cb9-4b9b-8e30-f63cede795dd service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:31.487213 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de86e0f-de55-4eb1-8c5e-15b444e447f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:31.488069 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de86e0f-de55-4eb1-8c5e-15b444e447f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:31.488373 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de86e0f-de55-4eb1-8c5e-15b444e447f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:31.488646 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de86e0f-de55-4eb1-8c5e-15b444e447f2 admin admin] PATH_INFO: `/v3/users/4c87764c37a24a52b9e48681dfd47b26` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:31.489870 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de86e0f-de55-4eb1-8c5e-15b444e447f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c87764c37a24a52b9e48681dfd47b26)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:31.491985 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de86e0f-de55-4eb1-8c5e-15b444e447f2 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:31.696069 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-4de86e0f-de55-4eb1-8c5e-15b444e447f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c87764c37a24a52b9e48681dfd47b26'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:31.702687 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-4de86e0f-de55-4eb1-8c5e-15b444e447f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c87764c37a24a52b9e48681dfd47b26'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:31.703345 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-4de86e0f-de55-4eb1-8c5e-15b444e447f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c87764c37a24a52b9e48681dfd47b26'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:31.703954 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-4de86e0f-de55-4eb1-8c5e-15b444e447f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c87764c37a24a52b9e48681dfd47b26'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:31.771858 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-4de86e0f-de55-4eb1-8c5e-15b444e447f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c87764c37a24a52b9e48681dfd47b26'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:31.789297 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1211/2401] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:03:31 2022] DELETE /identity/v3/users/4c87764c37a24a52b9e48681dfd47b26 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:03:32.264604 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b38f41-5be5-4f3a-b573-7942335efa3d admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:32.266428 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-d6b38f41-5be5-4f3a-b573-7942335efa3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:32.279428 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b38f41-5be5-4f3a-b573-7942335efa3d admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:32.333699 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b820c1-f05f-4e81-98b2-74598f4d4cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:32.334550 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b820c1-f05f-4e81-98b2-74598f4d4cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:32.334831 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b820c1-f05f-4e81-98b2-74598f4d4cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:32.335104 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b820c1-f05f-4e81-98b2-74598f4d4cd6 admin admin] PATH_INFO: `/v3/projects/f7fb6224dfc9469389aae2ad9c9eeecd` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:32.336277 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b820c1-f05f-4e81-98b2-74598f4d4cd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7fb6224dfc9469389aae2ad9c9eeecd)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:32.338209 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b820c1-f05f-4e81-98b2-74598f4d4cd6 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:32.466430 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-c3b820c1-f05f-4e81-98b2-74598f4d4cd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7fb6224dfc9469389aae2ad9c9eeecd', 'request_id': 'req-c3b820c1-f05f-4e81-98b2-74598f4d4cd6'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:32.473079 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-c3b820c1-f05f-4e81-98b2-74598f4d4cd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7fb6224dfc9469389aae2ad9c9eeecd', 'request_id': 'req-c3b820c1-f05f-4e81-98b2-74598f4d4cd6'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:32.478287 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-c3b820c1-f05f-4e81-98b2-74598f4d4cd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7fb6224dfc9469389aae2ad9c9eeecd', 'request_id': 'req-c3b820c1-f05f-4e81-98b2-74598f4d4cd6'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:32.568883 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-c3b820c1-f05f-4e81-98b2-74598f4d4cd6 admin admin] The token cache is being invalidate because project f7fb6224dfc9469389aae2ad9c9eeecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:03:32.569221 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-c3b820c1-f05f-4e81-98b2-74598f4d4cd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:32.570225 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-c3b820c1-f05f-4e81-98b2-74598f4d4cd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:32.571423 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1191/2402] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:03:32 2022] DELETE /identity/v3/projects/f7fb6224dfc9469389aae2ad9c9eeecd => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:03:32.578438 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90489366-b4c6-4b08-8713-25b17d703396 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:32.578724 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90489366-b4c6-4b08-8713-25b17d703396 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:32.579027 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90489366-b4c6-4b08-8713-25b17d703396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:32.589713 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b820c1-f05f-4e81-98b2-74598f4d4cd6 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:32.591107 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-c3b820c1-f05f-4e81-98b2-74598f4d4cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:32.598371 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-90489366-b4c6-4b08-8713-25b17d703396 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:32.599530 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-90489366-b4c6-4b08-8713-25b17d703396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:32.652753 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b820c1-f05f-4e81-98b2-74598f4d4cd6 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:32.658185 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acf76c-8c9c-48b5-9d4a-0c2cdc6b1e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:32.659002 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1212/2403] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:03:32.659194 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acf76c-8c9c-48b5-9d4a-0c2cdc6b1e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:32.659530 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acf76c-8c9c-48b5-9d4a-0c2cdc6b1e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:32.659816 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acf76c-8c9c-48b5-9d4a-0c2cdc6b1e90 admin admin] PATH_INFO: `/v3/users/834a19c6c1e9406fb4adc38f0b13d021` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:32.661035 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acf76c-8c9c-48b5-9d4a-0c2cdc6b1e90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=834a19c6c1e9406fb4adc38f0b13d021)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:32.662994 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acf76c-8c9c-48b5-9d4a-0c2cdc6b1e90 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:32.666530 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ca035-b066-4947-8277-ca9fa78c5567 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:32.666819 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ca035-b066-4947-8277-ca9fa78c5567 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:32.667097 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ca035-b066-4947-8277-ca9fa78c5567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:32.685412 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-6e8ca035-b066-4947-8277-ca9fa78c5567 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:32.686887 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-6e8ca035-b066-4947-8277-ca9fa78c5567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:32.694659 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1213/2404] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:03:32.700366 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ca035-b066-4947-8277-ca9fa78c5567 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:32.709215 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ca035-b066-4947-8277-ca9fa78c5567 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:32.713772 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb10a2-9d1c-41d0-8fe7-30d1c431c04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:32.714391 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb10a2-9d1c-41d0-8fe7-30d1c431c04f admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:32.714674 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb10a2-9d1c-41d0-8fe7-30d1c431c04f admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:32.714952 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb10a2-9d1c-41d0-8fe7-30d1c431c04f admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:32.715668 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb10a2-9d1c-41d0-8fe7-30d1c431c04f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:03:32.715971 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb10a2-9d1c-41d0-8fe7-30d1c431c04f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:32.718272 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb10a2-9d1c-41d0-8fe7-30d1c431c04f admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:32.729755 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1214/2405] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 15:03:32.739960 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb10a2-9d1c-41d0-8fe7-30d1c431c04f admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:32.750158 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb10a2-9d1c-41d0-8fe7-30d1c431c04f admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:32.754827 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967a3d1-f2de-46d9-9fd3-895bdd940bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:32.755441 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967a3d1-f2de-46d9-9fd3-895bdd940bce admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:32.755723 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967a3d1-f2de-46d9-9fd3-895bdd940bce admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:32.755997 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967a3d1-f2de-46d9-9fd3-895bdd940bce admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:32.756674 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967a3d1-f2de-46d9-9fd3-895bdd940bce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:32.758559 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967a3d1-f2de-46d9-9fd3-895bdd940bce admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:32.898882 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1215/2406] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:03:32 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:03:32.902986 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967a3d1-f2de-46d9-9fd3-895bdd940bce admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:32.944954 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-a7acf76c-8c9c-48b5-9d4a-0c2cdc6b1e90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '834a19c6c1e9406fb4adc38f0b13d021'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:32.951624 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-a7acf76c-8c9c-48b5-9d4a-0c2cdc6b1e90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '834a19c6c1e9406fb4adc38f0b13d021'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:32.952789 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-a7acf76c-8c9c-48b5-9d4a-0c2cdc6b1e90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '834a19c6c1e9406fb4adc38f0b13d021'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:32.962371 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967a3d1-f2de-46d9-9fd3-895bdd940bce admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:32.967208 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24f0f9-0750-424e-8469-e50ccbf008ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:32.968509 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24f0f9-0750-424e-8469-e50ccbf008ca admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:32.968798 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24f0f9-0750-424e-8469-e50ccbf008ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:32.969083 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24f0f9-0750-424e-8469-e50ccbf008ca admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:32.969802 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24f0f9-0750-424e-8469-e50ccbf008ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:32.971742 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24f0f9-0750-424e-8469-e50ccbf008ca admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:33.051364 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-a7acf76c-8c9c-48b5-9d4a-0c2cdc6b1e90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '834a19c6c1e9406fb4adc38f0b13d021'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:33.063623 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-a7acf76c-8c9c-48b5-9d4a-0c2cdc6b1e90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '834a19c6c1e9406fb4adc38f0b13d021'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:33.069608 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1192/2407] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:03:32 2022] DELETE /identity/v3/users/834a19c6c1e9406fb4adc38f0b13d021 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:03:33.074001 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f934d9-7e3c-4a14-8467-6ecbe1fa7260 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:33.074275 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f934d9-7e3c-4a14-8467-6ecbe1fa7260 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:33.074550 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f934d9-7e3c-4a14-8467-6ecbe1fa7260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:33.093885 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-08f934d9-7e3c-4a14-8467-6ecbe1fa7260 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:33.095136 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-08f934d9-7e3c-4a14-8467-6ecbe1fa7260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:33.098461 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1216/2408] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:03:32 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:03:33.102338 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24f0f9-0750-424e-8469-e50ccbf008ca admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:33.104402 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-ba24f0f9-0750-424e-8469-e50ccbf008ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:33.116473 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24f0f9-0750-424e-8469-e50ccbf008ca admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:33.158139 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1193/2409] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:03:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:03:33.167879 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f934d9-7e3c-4a14-8467-6ecbe1fa7260 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:33.169701 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-08f934d9-7e3c-4a14-8467-6ecbe1fa7260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:33.174787 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6bee4-5607-4f04-938f-f4ae1218d052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:33.175473 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6bee4-5607-4f04-938f-f4ae1218d052 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:33.175729 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6bee4-5607-4f04-938f-f4ae1218d052 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:33.176000 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6bee4-5607-4f04-938f-f4ae1218d052 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:33.176743 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6bee4-5607-4f04-938f-f4ae1218d052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:33.178414 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6bee4-5607-4f04-938f-f4ae1218d052 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:33.191659 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1217/2410] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:03:33.192665 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6bee4-5607-4f04-938f-f4ae1218d052 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:33.202799 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6bee4-5607-4f04-938f-f4ae1218d052 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:33.207681 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f90dc-9d93-430c-b1d4-3372b386e30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:33.208333 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f90dc-9d93-430c-b1d4-3372b386e30e admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:33.208614 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f90dc-9d93-430c-b1d4-3372b386e30e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:33.208890 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f90dc-9d93-430c-b1d4-3372b386e30e admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:33.209641 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f90dc-9d93-430c-b1d4-3372b386e30e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:33.211265 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f90dc-9d93-430c-b1d4-3372b386e30e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:33.222397 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1218/2411] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:03:33.226355 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f90dc-9d93-430c-b1d4-3372b386e30e admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:33.228057 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f934d9-7e3c-4a14-8467-6ecbe1fa7260 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:33.232040 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5d1af-90db-4503-abef-12e4cd636d84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:33.232781 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5d1af-90db-4503-abef-12e4cd636d84 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:33.233530 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5d1af-90db-4503-abef-12e4cd636d84 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:33.233530 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5d1af-90db-4503-abef-12e4cd636d84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:33.237357 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f90dc-9d93-430c-b1d4-3372b386e30e admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:33.242132 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737b359-d224-4104-a6ca-a76bb6732588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:33.243005 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737b359-d224-4104-a6ca-a76bb6732588 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:33.243364 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737b359-d224-4104-a6ca-a76bb6732588 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:33.243565 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737b359-d224-4104-a6ca-a76bb6732588 admin admin] PATH_INFO: `/v3/projects/afde703eb736423c9b831087ebd120b1/users/2a699646c927494da5a8e4c082dffc5a/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:33.244375 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5d1af-90db-4503-abef-12e4cd636d84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:33.245910 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5d1af-90db-4503-abef-12e4cd636d84 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:33.257008 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1194/2412] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:03:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:03:33.259431 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737b359-d224-4104-a6ca-a76bb6732588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afde703eb736423c9b831087ebd120b1, user_id=2a699646c927494da5a8e4c082dffc5a, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:33.262128 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737b359-d224-4104-a6ca-a76bb6732588 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:33.333928 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1219/2413] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:03:33 2022] PUT /identity/v3/projects/afde703eb736423c9b831087ebd120b1/users/2a699646c927494da5a8e4c082dffc5a/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:03:33.343989 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2335968-4e54-403d-88e9-d7747fc0e278 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:33.344843 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2335968-4e54-403d-88e9-d7747fc0e278 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:33.345163 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2335968-4e54-403d-88e9-d7747fc0e278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:33.372641 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-d2335968-4e54-403d-88e9-d7747fc0e278 None None] MFA Rules not processed for user `2a699646c927494da5a8e4c082dffc5a`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:33.374485 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-d2335968-4e54-403d-88e9-d7747fc0e278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:33.450062 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1195/2414] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:03:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:03:33.454992 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737b359-d224-4104-a6ca-a76bb6732588 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:33.526068 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2335968-4e54-403d-88e9-d7747fc0e278 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:33.527624 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-d2335968-4e54-403d-88e9-d7747fc0e278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:33.535046 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737b359-d224-4104-a6ca-a76bb6732588 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:33.541858 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fd721-23f7-4438-a963-a19b325dfaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:33.542607 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fd721-23f7-4438-a963-a19b325dfaf1 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:33.543022 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fd721-23f7-4438-a963-a19b325dfaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:33.543366 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fd721-23f7-4438-a963-a19b325dfaf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:33.544286 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3fd721-23f7-4438-a963-a19b325dfaf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:33.550734 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3fd721-23f7-4438-a963-a19b325dfaf1 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:33.551004 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2335968-4e54-403d-88e9-d7747fc0e278 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:33.554226 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e860f5-7951-4c36-aece-39af9c506e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:33.555418 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e860f5-7951-4c36-aece-39af9c506e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:33.556737 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e860f5-7951-4c36-aece-39af9c506e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:33.567328 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e860f5-7951-4c36-aece-39af9c506e78 admin admin] PATH_INFO: `/v3/projects/27614f6e32454ccaa602817f1658ac5a` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:33.569306 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e860f5-7951-4c36-aece-39af9c506e78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27614f6e32454ccaa602817f1658ac5a)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:33.571652 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e860f5-7951-4c36-aece-39af9c506e78 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:33.674429 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1220/2415] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:03:33 2022] POST /identity/v3/projects => generated 387 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:03:33.678715 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fd721-23f7-4438-a963-a19b325dfaf1 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:33.685041 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-53e860f5-7951-4c36-aece-39af9c506e78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27614f6e32454ccaa602817f1658ac5a', 'request_id': 'req-53e860f5-7951-4c36-aece-39af9c506e78'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:33.691842 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-53e860f5-7951-4c36-aece-39af9c506e78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27614f6e32454ccaa602817f1658ac5a', 'request_id': 'req-53e860f5-7951-4c36-aece-39af9c506e78'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:33.700820 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-53e860f5-7951-4c36-aece-39af9c506e78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27614f6e32454ccaa602817f1658ac5a', 'request_id': 'req-53e860f5-7951-4c36-aece-39af9c506e78'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:33.743022 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fd721-23f7-4438-a963-a19b325dfaf1 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:33.747767 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef22e1-febf-4480-b262-10da2f7dd5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:33.748424 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef22e1-febf-4480-b262-10da2f7dd5f6 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:33.749370 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef22e1-febf-4480-b262-10da2f7dd5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:33.749789 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef22e1-febf-4480-b262-10da2f7dd5f6 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:33.750796 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef22e1-febf-4480-b262-10da2f7dd5f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:33.753692 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef22e1-febf-4480-b262-10da2f7dd5f6 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:33.783133 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-53e860f5-7951-4c36-aece-39af9c506e78 admin admin] The token cache is being invalidate because project 27614f6e32454ccaa602817f1658ac5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:03:33.783430 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-53e860f5-7951-4c36-aece-39af9c506e78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:33.784130 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-53e860f5-7951-4c36-aece-39af9c506e78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:33.785730 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1196/2416] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:03:33 2022] DELETE /identity/v3/projects/27614f6e32454ccaa602817f1658ac5a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:03:33.794453 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdb3ea-cbfb-47f0-9eea-ef7fe1edb9f3 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:33.794741 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdb3ea-cbfb-47f0-9eea-ef7fe1edb9f3 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:33.795006 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdb3ea-cbfb-47f0-9eea-ef7fe1edb9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:33.817916 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-4cfdb3ea-cbfb-47f0-9eea-ef7fe1edb9f3 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:33.819098 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-4cfdb3ea-cbfb-47f0-9eea-ef7fe1edb9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:33.827274 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1197/2417] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:03:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:03:33.834359 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab01499-072c-4c02-9227-294b66f76d23 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:33.834648 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab01499-072c-4c02-9227-294b66f76d23 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:33.834925 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab01499-072c-4c02-9227-294b66f76d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:33.853397 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-0ab01499-072c-4c02-9227-294b66f76d23 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:33.854819 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-0ab01499-072c-4c02-9227-294b66f76d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:33.860781 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1221/2418] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:03:33 2022] POST /identity/v3/users => generated 294 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:03:33.861874 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef22e1-febf-4480-b262-10da2f7dd5f6 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:33.863767 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1198/2419] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:03:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:03:33.865510 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-1eef22e1-febf-4480-b262-10da2f7dd5f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:33.875122 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab01499-072c-4c02-9227-294b66f76d23 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:33.878346 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef22e1-febf-4480-b262-10da2f7dd5f6 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:33.883035 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6c1b7-90a5-4e96-a0c7-90f4c91c6c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:33.883712 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6c1b7-90a5-4e96-a0c7-90f4c91c6c18 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:33.883990 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6c1b7-90a5-4e96-a0c7-90f4c91c6c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:33.884261 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6c1b7-90a5-4e96-a0c7-90f4c91c6c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:33.884409 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab01499-072c-4c02-9227-294b66f76d23 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:33.885022 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6c1b7-90a5-4e96-a0c7-90f4c91c6c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:33.886717 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6c1b7-90a5-4e96-a0c7-90f4c91c6c18 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:33.889152 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cbb2f-79cd-4086-9b35-2095d80eb718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:33.889769 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cbb2f-79cd-4086-9b35-2095d80eb718 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:33.890102 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cbb2f-79cd-4086-9b35-2095d80eb718 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:33.890363 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cbb2f-79cd-4086-9b35-2095d80eb718 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:33.891114 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cbb2f-79cd-4086-9b35-2095d80eb718 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:03:33.891418 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cbb2f-79cd-4086-9b35-2095d80eb718 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:33.893117 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cbb2f-79cd-4086-9b35-2095d80eb718 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:33.896732 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1222/2420] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:03:33.902605 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6c1b7-90a5-4e96-a0c7-90f4c91c6c18 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:33.910291 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1199/2421] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 15:03:33.911512 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cbb2f-79cd-4086-9b35-2095d80eb718 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:33.912733 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6c1b7-90a5-4e96-a0c7-90f4c91c6c18 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:33.917445 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25ca75-bc75-47e3-a89a-67bba0cf7b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:33.918084 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25ca75-bc75-47e3-a89a-67bba0cf7b9a admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:33.918395 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25ca75-bc75-47e3-a89a-67bba0cf7b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:33.918852 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25ca75-bc75-47e3-a89a-67bba0cf7b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:33.919485 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25ca75-bc75-47e3-a89a-67bba0cf7b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:33.921104 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25ca75-bc75-47e3-a89a-67bba0cf7b9a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:33.921273 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cbb2f-79cd-4086-9b35-2095d80eb718 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:33.926668 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbd67c-bd09-46b4-bfc0-e06d9a28f43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:33.927295 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbd67c-bd09-46b4-bfc0-e06d9a28f43e admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:33.927572 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbd67c-bd09-46b4-bfc0-e06d9a28f43e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:33.927843 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbd67c-bd09-46b4-bfc0-e06d9a28f43e admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:33.928559 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbd67c-bd09-46b4-bfc0-e06d9a28f43e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:33.930447 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbd67c-bd09-46b4-bfc0-e06d9a28f43e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:33.935116 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1223/2422] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:03:33.935877 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25ca75-bc75-47e3-a89a-67bba0cf7b9a admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:33.945428 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25ca75-bc75-47e3-a89a-67bba0cf7b9a admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:33.950091 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b854416-6dd4-47a0-bce2-99c5f38f8d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:33.957324 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b854416-6dd4-47a0-bce2-99c5f38f8d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:33.957324 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b854416-6dd4-47a0-bce2-99c5f38f8d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:33.957324 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b854416-6dd4-47a0-bce2-99c5f38f8d31 admin admin] PATH_INFO: `/v3/projects/9ae7f2fddb8e440ca72925dcf89512db/users/de5fe7f5d62b4e4a943e3cdf4836b945/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:33.965710 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b854416-6dd4-47a0-bce2-99c5f38f8d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ae7f2fddb8e440ca72925dcf89512db, user_id=de5fe7f5d62b4e4a943e3cdf4836b945, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:33.968906 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b854416-6dd4-47a0-bce2-99c5f38f8d31 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:34.031465 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1200/2423] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:03:33 2022] POST /identity/v3/projects => generated 391 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:03:34.040324 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbd67c-bd09-46b4-bfc0-e06d9a28f43e admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:34.069685 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1224/2424] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:03:33 2022] PUT /identity/v3/projects/9ae7f2fddb8e440ca72925dcf89512db/users/de5fe7f5d62b4e4a943e3cdf4836b945/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:03:34.087635 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3791a-340f-4190-b3b9-0bdda97c1f54 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:34.087923 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3791a-340f-4190-b3b9-0bdda97c1f54 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:34.088225 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3791a-340f-4190-b3b9-0bdda97c1f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:34.095746 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbd67c-bd09-46b4-bfc0-e06d9a28f43e admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:34.116691 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-6ea3791a-340f-4190-b3b9-0bdda97c1f54 None None] MFA Rules not processed for user `de5fe7f5d62b4e4a943e3cdf4836b945`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:34.118012 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-6ea3791a-340f-4190-b3b9-0bdda97c1f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:34.149083 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cb975-2609-442b-89a8-5c57b3fbed32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:34.149797 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cb975-2609-442b-89a8-5c57b3fbed32 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:34.150145 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cb975-2609-442b-89a8-5c57b3fbed32 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:34.150426 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cb975-2609-442b-89a8-5c57b3fbed32 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:34.151148 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039cb975-2609-442b-89a8-5c57b3fbed32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:34.153105 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039cb975-2609-442b-89a8-5c57b3fbed32 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:34.181314 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1225/2425] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:03:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:03:34.185675 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3791a-340f-4190-b3b9-0bdda97c1f54 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:34.195692 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3791a-340f-4190-b3b9-0bdda97c1f54 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:34.200200 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27b12c-5865-47e6-ba82-4e42cb7e2313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:34.200839 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27b12c-5865-47e6-ba82-4e42cb7e2313 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:34.201158 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27b12c-5865-47e6-ba82-4e42cb7e2313 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:34.201436 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27b12c-5865-47e6-ba82-4e42cb7e2313 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:34.202160 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27b12c-5865-47e6-ba82-4e42cb7e2313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:34.204046 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27b12c-5865-47e6-ba82-4e42cb7e2313 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:34.269311 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1201/2426] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:03:34 2022] POST /identity/v3/users => generated 296 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:03:34.273097 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cb975-2609-442b-89a8-5c57b3fbed32 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:34.282857 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cb975-2609-442b-89a8-5c57b3fbed32 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:34.287760 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d27754-ae90-4d2e-a252-c1644a2a1139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:34.288381 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d27754-ae90-4d2e-a252-c1644a2a1139 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:34.288660 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d27754-ae90-4d2e-a252-c1644a2a1139 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:34.288933 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d27754-ae90-4d2e-a252-c1644a2a1139 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:34.289751 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d27754-ae90-4d2e-a252-c1644a2a1139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:34.291343 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d27754-ae90-4d2e-a252-c1644a2a1139 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:34.300908 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1202/2427] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:03:34.306412 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1226/2428] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:03:34 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:03:34.309015 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d27754-ae90-4d2e-a252-c1644a2a1139 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:34.309303 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27b12c-5865-47e6-ba82-4e42cb7e2313 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:34.319136 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d27754-ae90-4d2e-a252-c1644a2a1139 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:34.373733 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27b12c-5865-47e6-ba82-4e42cb7e2313 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:34.374646 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6d2d0-67c5-4462-872b-538fd74675bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:34.375571 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6d2d0-67c5-4462-872b-538fd74675bb admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:34.375904 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6d2d0-67c5-4462-872b-538fd74675bb admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:34.376262 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6d2d0-67c5-4462-872b-538fd74675bb admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:34.377214 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6d2d0-67c5-4462-872b-538fd74675bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:34.379240 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6d2d0-67c5-4462-872b-538fd74675bb admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:34.380108 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96bb2d-eff3-4e53-bd0e-2b29860748f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:34.380772 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96bb2d-eff3-4e53-bd0e-2b29860748f6 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:34.381056 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96bb2d-eff3-4e53-bd0e-2b29860748f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:34.381383 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96bb2d-eff3-4e53-bd0e-2b29860748f6 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:34.382062 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce96bb2d-eff3-4e53-bd0e-2b29860748f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:34.383999 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce96bb2d-eff3-4e53-bd0e-2b29860748f6 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:34.391981 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1203/2429] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:03:34.396117 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6d2d0-67c5-4462-872b-538fd74675bb admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:34.406223 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6d2d0-67c5-4462-872b-538fd74675bb admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:34.410728 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38bcf2-7aa7-4354-9bc8-4acb4e603d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:34.415296 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38bcf2-7aa7-4354-9bc8-4acb4e603d5a admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:34.415296 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38bcf2-7aa7-4354-9bc8-4acb4e603d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:34.415296 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38bcf2-7aa7-4354-9bc8-4acb4e603d5a admin admin] PATH_INFO: `/v3/projects/38366a8d0fe7487480ec8ce2f34e68bc/users/588b85b8cad546b981184c7693bc887d/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:34.428309 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38bcf2-7aa7-4354-9bc8-4acb4e603d5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=38366a8d0fe7487480ec8ce2f34e68bc, user_id=588b85b8cad546b981184c7693bc887d, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:34.431018 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38bcf2-7aa7-4354-9bc8-4acb4e603d5a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:34.501184 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1227/2430] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:03:34 2022] POST /identity/v3/users => generated 300 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:03:34.505153 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96bb2d-eff3-4e53-bd0e-2b29860748f6 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:34.515833 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96bb2d-eff3-4e53-bd0e-2b29860748f6 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:34.520580 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b23d0a-e318-43e2-9c28-3de38c7dafc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:34.521285 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b23d0a-e318-43e2-9c28-3de38c7dafc5 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:34.521574 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b23d0a-e318-43e2-9c28-3de38c7dafc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:34.521856 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b23d0a-e318-43e2-9c28-3de38c7dafc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:34.522644 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b23d0a-e318-43e2-9c28-3de38c7dafc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:34.524377 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b23d0a-e318-43e2-9c28-3de38c7dafc5 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:34.529979 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1204/2431] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:03:34 2022] PUT /identity/v3/projects/38366a8d0fe7487480ec8ce2f34e68bc/users/588b85b8cad546b981184c7693bc887d/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:03:34.539173 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1228/2432] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:03:34.540223 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38bcf2-7aa7-4354-9bc8-4acb4e603d5a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:34.540930 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25a2a3-2cf3-495c-8341-3e1d361c440f None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:34.541261 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25a2a3-2cf3-495c-8341-3e1d361c440f None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:34.541542 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25a2a3-2cf3-495c-8341-3e1d361c440f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:34.569715 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-8e25a2a3-2cf3-495c-8341-3e1d361c440f None None] MFA Rules not processed for user `588b85b8cad546b981184c7693bc887d`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:34.570938 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-8e25a2a3-2cf3-495c-8341-3e1d361c440f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:34.605009 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38bcf2-7aa7-4354-9bc8-4acb4e603d5a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:34.610052 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8813b-183a-429b-bfff-91693e45901d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:34.610947 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8813b-183a-429b-bfff-91693e45901d admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:34.611231 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8813b-183a-429b-bfff-91693e45901d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:34.611507 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8813b-183a-429b-bfff-91693e45901d admin admin] PATH_INFO: `/v3/projects/384017be1a854c4c88477b8dc0c93840/users/7d84386c63294899b767555ae8ba1d35/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:34.626042 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e8813b-183a-429b-bfff-91693e45901d admin admin] RBAC: Authorizing `identity:create_grant(project_id=384017be1a854c4c88477b8dc0c93840, user_id=7d84386c63294899b767555ae8ba1d35, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:34.628727 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e8813b-183a-429b-bfff-91693e45901d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:34.637087 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1229/2433] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:03:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:03:34.647223 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25a2a3-2cf3-495c-8341-3e1d361c440f None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:34.648513 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-8e25a2a3-2cf3-495c-8341-3e1d361c440f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:34.695331 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1205/2434] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:03:34 2022] PUT /identity/v3/projects/384017be1a854c4c88477b8dc0c93840/users/7d84386c63294899b767555ae8ba1d35/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:03:34.700299 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8813b-183a-429b-bfff-91693e45901d admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:34.707767 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25a2a3-2cf3-495c-8341-3e1d361c440f None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:34.754882 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc80402-3a78-4b8b-b89e-299903fbe78f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:34.755545 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc80402-3a78-4b8b-b89e-299903fbe78f service cinder] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:34.755781 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc80402-3a78-4b8b-b89e-299903fbe78f service cinder] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:34.756052 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc80402-3a78-4b8b-b89e-299903fbe78f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:34.759628 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8813b-183a-429b-bfff-91693e45901d admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:34.764364 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05a0dd-97f4-4afc-b1a3-4b5914030898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:34.765568 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05a0dd-97f4-4afc-b1a3-4b5914030898 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:34.765855 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05a0dd-97f4-4afc-b1a3-4b5914030898 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:34.766126 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05a0dd-97f4-4afc-b1a3-4b5914030898 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:34.766861 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc05a0dd-97f4-4afc-b1a3-4b5914030898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:34.768464 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc05a0dd-97f4-4afc-b1a3-4b5914030898 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:34.778106 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1206/2435] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:03:34.782914 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05a0dd-97f4-4afc-b1a3-4b5914030898 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:34.792183 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05a0dd-97f4-4afc-b1a3-4b5914030898 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:34.797165 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b59d38-20f3-4f0b-9f0f-232fe93660d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:34.798033 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b59d38-20f3-4f0b-9f0f-232fe93660d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:34.798311 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b59d38-20f3-4f0b-9f0f-232fe93660d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:34.798582 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b59d38-20f3-4f0b-9f0f-232fe93660d0 admin admin] PATH_INFO: `/v3/projects/384017be1a854c4c88477b8dc0c93840/users/7d84386c63294899b767555ae8ba1d35/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:34.800663 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b59d38-20f3-4f0b-9f0f-232fe93660d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=384017be1a854c4c88477b8dc0c93840, user_id=7d84386c63294899b767555ae8ba1d35, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:34.803325 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b59d38-20f3-4f0b-9f0f-232fe93660d0 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:34.812340 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc80402-3a78-4b8b-b89e-299903fbe78f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:34.813959 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc80402-3a78-4b8b-b89e-299903fbe78f service cinder] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:34.814321 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1207/2436] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:03:34 2022] PUT /identity/v3/projects/384017be1a854c4c88477b8dc0c93840/users/7d84386c63294899b767555ae8ba1d35/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:03:34.823631 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1230/2437] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:03:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 15:03:34.824168 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d0ff1-a47c-4c77-a060-27c77290c184 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:34.824461 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d0ff1-a47c-4c77-a060-27c77290c184 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:34.824744 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d0ff1-a47c-4c77-a060-27c77290c184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:34.850809 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-2e2d0ff1-a47c-4c77-a060-27c77290c184 None None] MFA Rules not processed for user `7d84386c63294899b767555ae8ba1d35`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:34.852003 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-2e2d0ff1-a47c-4c77-a060-27c77290c184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:34.916677 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1208/2438] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:03:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:03:34.926321 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc80402-3a78-4b8b-b89e-299903fbe78f service cinder] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:34.927766 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-edc80402-3a78-4b8b-b89e-299903fbe78f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:34.939065 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc80402-3a78-4b8b-b89e-299903fbe78f service cinder] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:34.989523 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce9f55-82e9-4cad-8ca9-cb7f1f3a7c40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:34.990093 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce9f55-82e9-4cad-8ca9-cb7f1f3a7c40 service cinder] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:34.990379 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce9f55-82e9-4cad-8ca9-cb7f1f3a7c40 service cinder] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:34.990654 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce9f55-82e9-4cad-8ca9-cb7f1f3a7c40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:35.001637 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce9f55-82e9-4cad-8ca9-cb7f1f3a7c40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:35.003115 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce9f55-82e9-4cad-8ca9-cb7f1f3a7c40 service cinder] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:35.013644 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1231/2439] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:03:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:03:36.144202 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d0ff1-a47c-4c77-a060-27c77290c184 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:36.153762 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d0ff1-a47c-4c77-a060-27c77290c184 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:36.158068 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75970076-2936-4a2b-9a54-9d10fe80d26b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:36.158774 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75970076-2936-4a2b-9a54-9d10fe80d26b service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:36.158980 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75970076-2936-4a2b-9a54-9d10fe80d26b service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:36.159258 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75970076-2936-4a2b-9a54-9d10fe80d26b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:36.161951 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-75970076-2936-4a2b-9a54-9d10fe80d26b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:36.218375 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75970076-2936-4a2b-9a54-9d10fe80d26b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:36.219752 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75970076-2936-4a2b-9a54-9d10fe80d26b service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:36.228428 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1209/2440] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:03:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:03:37.027098 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce9f55-82e9-4cad-8ca9-cb7f1f3a7c40 service cinder] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:37.028496 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-b9ce9f55-82e9-4cad-8ca9-cb7f1f3a7c40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:37.084371 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce9f55-82e9-4cad-8ca9-cb7f1f3a7c40 service cinder] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:37.088002 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ea162-516e-4c71-9d57-5b40d6104ee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:37.088699 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ea162-516e-4c71-9d57-5b40d6104ee6 service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:37.088987 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ea162-516e-4c71-9d57-5b40d6104ee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:37.089313 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ea162-516e-4c71-9d57-5b40d6104ee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:37.091098 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-e39ea162-516e-4c71-9d57-5b40d6104ee6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:37.152319 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ea162-516e-4c71-9d57-5b40d6104ee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:37.153844 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ea162-516e-4c71-9d57-5b40d6104ee6 service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:37.164784 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1232/2441] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:03:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:03:46.719180 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75970076-2936-4a2b-9a54-9d10fe80d26b service cinder] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:46.730198 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75970076-2936-4a2b-9a54-9d10fe80d26b service cinder] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:46.734096 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc46d51-c150-47c7-b355-67dc4a61417c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:46.734814 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc46d51-c150-47c7-b355-67dc4a61417c service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:46.735161 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc46d51-c150-47c7-b355-67dc4a61417c service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:46.735690 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc46d51-c150-47c7-b355-67dc4a61417c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:46.812426 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc46d51-c150-47c7-b355-67dc4a61417c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:46.813829 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc46d51-c150-47c7-b355-67dc4a61417c service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:46.824899 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1210/2442] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:03:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:03:53.721435 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ea162-516e-4c71-9d57-5b40d6104ee6 service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:53.798993 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ea162-516e-4c71-9d57-5b40d6104ee6 service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:53.804409 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724e16d-2199-4a71-b19d-f7adc90a09a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:53.805344 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724e16d-2199-4a71-b19d-f7adc90a09a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:53.805629 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724e16d-2199-4a71-b19d-f7adc90a09a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:53.805909 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724e16d-2199-4a71-b19d-f7adc90a09a6 admin admin] PATH_INFO: `/v3/users/2a699646c927494da5a8e4c082dffc5a` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:53.807114 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724e16d-2199-4a71-b19d-f7adc90a09a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a699646c927494da5a8e4c082dffc5a)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:53.809207 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724e16d-2199-4a71-b19d-f7adc90a09a6 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:54.032697 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3724e16d-2199-4a71-b19d-f7adc90a09a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a699646c927494da5a8e4c082dffc5a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:54.039963 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3724e16d-2199-4a71-b19d-f7adc90a09a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a699646c927494da5a8e4c082dffc5a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:54.040766 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3724e16d-2199-4a71-b19d-f7adc90a09a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a699646c927494da5a8e4c082dffc5a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:54.041457 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3724e16d-2199-4a71-b19d-f7adc90a09a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a699646c927494da5a8e4c082dffc5a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:54.268457 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3724e16d-2199-4a71-b19d-f7adc90a09a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a699646c927494da5a8e4c082dffc5a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:54.286950 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1233/2443] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:03:53 2022] DELETE /identity/v3/users/2a699646c927494da5a8e4c082dffc5a => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:03:54.291269 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdba76-b595-453a-86ba-eb513f81db23 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:54.291771 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdba76-b595-453a-86ba-eb513f81db23 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:54.291868 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdba76-b595-453a-86ba-eb513f81db23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:54.309823 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-59cdba76-b595-453a-86ba-eb513f81db23 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:54.311044 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-59cdba76-b595-453a-86ba-eb513f81db23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:54.367696 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1211/2444] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:03:54.377191 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724e16d-2199-4a71-b19d-f7adc90a09a6 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:54.378628 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-3724e16d-2199-4a71-b19d-f7adc90a09a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:54.436717 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724e16d-2199-4a71-b19d-f7adc90a09a6 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:54.440416 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70226186-5b0f-4b55-ac12-c451ab9575de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:54.441053 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70226186-5b0f-4b55-ac12-c451ab9575de service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:54.441359 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70226186-5b0f-4b55-ac12-c451ab9575de service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:54.441632 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70226186-5b0f-4b55-ac12-c451ab9575de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:54.450589 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70226186-5b0f-4b55-ac12-c451ab9575de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:54.452023 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70226186-5b0f-4b55-ac12-c451ab9575de service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:54.465121 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1234/2445] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:03:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:03:54.932711 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cdba76-b595-453a-86ba-eb513f81db23 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:54.934174 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-59cdba76-b595-453a-86ba-eb513f81db23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:54.948228 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cdba76-b595-453a-86ba-eb513f81db23 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:54.953345 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19210826-392b-4fe6-b758-73a4f95858a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:54.955001 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19210826-392b-4fe6-b758-73a4f95858a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:54.955289 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19210826-392b-4fe6-b758-73a4f95858a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:54.955557 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19210826-392b-4fe6-b758-73a4f95858a1 admin admin] PATH_INFO: `/v3/projects/afde703eb736423c9b831087ebd120b1` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:54.957187 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19210826-392b-4fe6-b758-73a4f95858a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afde703eb736423c9b831087ebd120b1)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:54.959683 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19210826-392b-4fe6-b758-73a4f95858a1 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:55.097766 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-19210826-392b-4fe6-b758-73a4f95858a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afde703eb736423c9b831087ebd120b1', 'request_id': 'req-19210826-392b-4fe6-b758-73a4f95858a1'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:55.104661 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-19210826-392b-4fe6-b758-73a4f95858a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afde703eb736423c9b831087ebd120b1', 'request_id': 'req-19210826-392b-4fe6-b758-73a4f95858a1'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:55.110884 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-19210826-392b-4fe6-b758-73a4f95858a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afde703eb736423c9b831087ebd120b1', 'request_id': 'req-19210826-392b-4fe6-b758-73a4f95858a1'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:55.265544 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-19210826-392b-4fe6-b758-73a4f95858a1 admin admin] The token cache is being invalidate because project afde703eb736423c9b831087ebd120b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:03:55.265832 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-19210826-392b-4fe6-b758-73a4f95858a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:55.266486 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-19210826-392b-4fe6-b758-73a4f95858a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:55.268091 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1212/2446] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:03:54 2022] DELETE /identity/v3/projects/afde703eb736423c9b831087ebd120b1 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:03:55.272050 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70226186-5b0f-4b55-ac12-c451ab9575de service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:55.282110 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70226186-5b0f-4b55-ac12-c451ab9575de service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:55.339801 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c47c8-711c-41d7-a0d2-5aadbddfc57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:55.340799 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c47c8-711c-41d7-a0d2-5aadbddfc57d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:55.340936 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c47c8-711c-41d7-a0d2-5aadbddfc57d admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:55.341652 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c47c8-711c-41d7-a0d2-5aadbddfc57d admin admin] PATH_INFO: `/v3/users/de5fe7f5d62b4e4a943e3cdf4836b945` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:55.342636 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c47c8-711c-41d7-a0d2-5aadbddfc57d admin admin] RBAC: Authorizing `identity:delete_user(user_id=de5fe7f5d62b4e4a943e3cdf4836b945)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:55.344685 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c47c8-711c-41d7-a0d2-5aadbddfc57d admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:55.546444 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-f42c47c8-711c-41d7-a0d2-5aadbddfc57d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de5fe7f5d62b4e4a943e3cdf4836b945'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:55.560332 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-f42c47c8-711c-41d7-a0d2-5aadbddfc57d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de5fe7f5d62b4e4a943e3cdf4836b945'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:55.564345 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-f42c47c8-711c-41d7-a0d2-5aadbddfc57d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de5fe7f5d62b4e4a943e3cdf4836b945'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:55.566383 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-f42c47c8-711c-41d7-a0d2-5aadbddfc57d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de5fe7f5d62b4e4a943e3cdf4836b945'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:55.632120 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-f42c47c8-711c-41d7-a0d2-5aadbddfc57d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de5fe7f5d62b4e4a943e3cdf4836b945'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:55.650107 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1235/2447] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:03:55 2022] DELETE /identity/v3/users/de5fe7f5d62b4e4a943e3cdf4836b945 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:03:56.062762 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee11c53-0d58-4477-a4c5-9fe33ab5c8f5 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:56.063234 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee11c53-0d58-4477-a4c5-9fe33ab5c8f5 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:56.063348 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee11c53-0d58-4477-a4c5-9fe33ab5c8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:56.082301 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-aee11c53-0d58-4477-a4c5-9fe33ab5c8f5 None None] MFA Rules not processed for user `2de1d8ec06134669a4db8ca248feceae`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:56.083710 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-aee11c53-0d58-4477-a4c5-9fe33ab5c8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:56.121241 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c47c8-711c-41d7-a0d2-5aadbddfc57d admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:56.123029 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-f42c47c8-711c-41d7-a0d2-5aadbddfc57d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:56.149276 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1213/2448] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:03:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:03:56.210500 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c47c8-711c-41d7-a0d2-5aadbddfc57d admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:56.217839 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ee37d-172f-4544-8fad-74c7dea998fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:56.219279 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ee37d-172f-4544-8fad-74c7dea998fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:56.219750 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ee37d-172f-4544-8fad-74c7dea998fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:56.220038 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ee37d-172f-4544-8fad-74c7dea998fd admin admin] PATH_INFO: `/v3/projects/9ae7f2fddb8e440ca72925dcf89512db` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:56.220486 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee11c53-0d58-4477-a4c5-9fe33ab5c8f5 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:56.221444 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ee37d-172f-4544-8fad-74c7dea998fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ae7f2fddb8e440ca72925dcf89512db)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:56.222620 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-aee11c53-0d58-4477-a4c5-9fe33ab5c8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:56.223848 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ee37d-172f-4544-8fad-74c7dea998fd admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:56.242593 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee11c53-0d58-4477-a4c5-9fe33ab5c8f5 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:56.247685 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cd64f-684d-4f38-b2a0-aa5d87ad65d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:56.248814 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cd64f-684d-4f38-b2a0-aa5d87ad65d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:56.249133 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cd64f-684d-4f38-b2a0-aa5d87ad65d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:56.249416 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cd64f-684d-4f38-b2a0-aa5d87ad65d3 admin admin] PATH_INFO: `/v3/users/588b85b8cad546b981184c7693bc887d` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:56.250772 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22cd64f-684d-4f38-b2a0-aa5d87ad65d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=588b85b8cad546b981184c7693bc887d)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:56.252780 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22cd64f-684d-4f38-b2a0-aa5d87ad65d3 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:56.333088 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-4f1ee37d-172f-4544-8fad-74c7dea998fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ae7f2fddb8e440ca72925dcf89512db', 'request_id': 'req-4f1ee37d-172f-4544-8fad-74c7dea998fd'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:56.339736 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-4f1ee37d-172f-4544-8fad-74c7dea998fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ae7f2fddb8e440ca72925dcf89512db', 'request_id': 'req-4f1ee37d-172f-4544-8fad-74c7dea998fd'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:56.405793 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-4f1ee37d-172f-4544-8fad-74c7dea998fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ae7f2fddb8e440ca72925dcf89512db', 'request_id': 'req-4f1ee37d-172f-4544-8fad-74c7dea998fd'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:56.417031 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-4f1ee37d-172f-4544-8fad-74c7dea998fd admin admin] The token cache is being invalidate because project 9ae7f2fddb8e440ca72925dcf89512db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:03:56.419417 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-4f1ee37d-172f-4544-8fad-74c7dea998fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:56.419417 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-4f1ee37d-172f-4544-8fad-74c7dea998fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:56.419608 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1236/2449] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:03:56 2022] DELETE /identity/v3/projects/9ae7f2fddb8e440ca72925dcf89512db => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:03:56.424121 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ee37d-172f-4544-8fad-74c7dea998fd admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:56.425493 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-4f1ee37d-172f-4544-8fad-74c7dea998fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:56.450700 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e22cd64f-684d-4f38-b2a0-aa5d87ad65d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '588b85b8cad546b981184c7693bc887d'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:56.460148 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e22cd64f-684d-4f38-b2a0-aa5d87ad65d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '588b85b8cad546b981184c7693bc887d'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:56.461259 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e22cd64f-684d-4f38-b2a0-aa5d87ad65d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '588b85b8cad546b981184c7693bc887d'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:56.491383 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ee37d-172f-4544-8fad-74c7dea998fd admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:56.496457 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac56022-24f9-4d37-b6f2-ad0a586af72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:56.497494 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac56022-24f9-4d37-b6f2-ad0a586af72a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:56.497784 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac56022-24f9-4d37-b6f2-ad0a586af72a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:56.498061 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac56022-24f9-4d37-b6f2-ad0a586af72a admin admin] PATH_INFO: `/v3/users/7d84386c63294899b767555ae8ba1d35` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:56.499282 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac56022-24f9-4d37-b6f2-ad0a586af72a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d84386c63294899b767555ae8ba1d35)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:56.501304 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac56022-24f9-4d37-b6f2-ad0a586af72a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:56.531900 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e22cd64f-684d-4f38-b2a0-aa5d87ad65d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '588b85b8cad546b981184c7693bc887d'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:56.544361 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e22cd64f-684d-4f38-b2a0-aa5d87ad65d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '588b85b8cad546b981184c7693bc887d'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:56.554181 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1214/2450] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:03:56 2022] DELETE /identity/v3/users/588b85b8cad546b981184c7693bc887d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:03:56.555763 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5fc33-bb66-4fce-a6e4-e71752d065e8 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:56.556112 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5fc33-bb66-4fce-a6e4-e71752d065e8 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:56.556455 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5fc33-bb66-4fce-a6e4-e71752d065e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:56.574401 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-8bc5fc33-bb66-4fce-a6e4-e71752d065e8 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:56.576129 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-8bc5fc33-bb66-4fce-a6e4-e71752d065e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:56.634185 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1215/2451] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:03:56.643974 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5fc33-bb66-4fce-a6e4-e71752d065e8 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:56.645412 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-8bc5fc33-bb66-4fce-a6e4-e71752d065e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:56.689722 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-dac56022-24f9-4d37-b6f2-ad0a586af72a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d84386c63294899b767555ae8ba1d35'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:56.698161 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-dac56022-24f9-4d37-b6f2-ad0a586af72a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d84386c63294899b767555ae8ba1d35'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:56.698643 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-dac56022-24f9-4d37-b6f2-ad0a586af72a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d84386c63294899b767555ae8ba1d35'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:56.700639 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-dac56022-24f9-4d37-b6f2-ad0a586af72a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d84386c63294899b767555ae8ba1d35'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:56.710107 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5fc33-bb66-4fce-a6e4-e71752d065e8 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:56.714073 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecac75c-1ff0-4049-a45d-ca02c246164d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:56.714724 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecac75c-1ff0-4049-a45d-ca02c246164d service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:56.715006 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecac75c-1ff0-4049-a45d-ca02c246164d service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:56.715284 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecac75c-1ff0-4049-a45d-ca02c246164d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:56.717132 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-5ecac75c-1ff0-4049-a45d-ca02c246164d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:56.729920 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecac75c-1ff0-4049-a45d-ca02c246164d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:56.731393 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecac75c-1ff0-4049-a45d-ca02c246164d service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:56.741660 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1216/2452] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:03:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 15:03:56.789315 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-dac56022-24f9-4d37-b6f2-ad0a586af72a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d84386c63294899b767555ae8ba1d35'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:56.811349 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1237/2453] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:03:56 2022] DELETE /identity/v3/users/7d84386c63294899b767555ae8ba1d35 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:03:57.379861 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecac75c-1ff0-4049-a45d-ca02c246164d service neutron] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:57.381473 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-5ecac75c-1ff0-4049-a45d-ca02c246164d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:57.398840 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecac75c-1ff0-4049-a45d-ca02c246164d service neutron] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:57.410332 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac56022-24f9-4d37-b6f2-ad0a586af72a admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:57.411828 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-dac56022-24f9-4d37-b6f2-ad0a586af72a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:57.483378 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96143fb7-fcad-49ad-b768-97587604dded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:57.484942 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96143fb7-fcad-49ad-b768-97587604dded admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:57.485258 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96143fb7-fcad-49ad-b768-97587604dded admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:57.485537 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96143fb7-fcad-49ad-b768-97587604dded admin admin] PATH_INFO: `/v3/projects/38366a8d0fe7487480ec8ce2f34e68bc` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:57.486782 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96143fb7-fcad-49ad-b768-97587604dded admin admin] RBAC: Authorizing `identity:delete_project(project_id=38366a8d0fe7487480ec8ce2f34e68bc)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:57.488105 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac56022-24f9-4d37-b6f2-ad0a586af72a admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:57.490343 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96143fb7-fcad-49ad-b768-97587604dded admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:57.494253 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964a7ed-a3a4-4519-884c-9c449df44f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:57.495359 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964a7ed-a3a4-4519-884c-9c449df44f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:57.495768 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964a7ed-a3a4-4519-884c-9c449df44f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:57.496106 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964a7ed-a3a4-4519-884c-9c449df44f91 admin admin] PATH_INFO: `/v3/projects/384017be1a854c4c88477b8dc0c93840` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:57.497429 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964a7ed-a3a4-4519-884c-9c449df44f91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=384017be1a854c4c88477b8dc0c93840)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:57.499411 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964a7ed-a3a4-4519-884c-9c449df44f91 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:57.651243 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-96143fb7-fcad-49ad-b768-97587604dded admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38366a8d0fe7487480ec8ce2f34e68bc', 'request_id': 'req-96143fb7-fcad-49ad-b768-97587604dded'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:57.651746 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a964a7ed-a3a4-4519-884c-9c449df44f91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '384017be1a854c4c88477b8dc0c93840', 'request_id': 'req-a964a7ed-a3a4-4519-884c-9c449df44f91'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:57.658974 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a964a7ed-a3a4-4519-884c-9c449df44f91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '384017be1a854c4c88477b8dc0c93840', 'request_id': 'req-a964a7ed-a3a4-4519-884c-9c449df44f91'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:57.659826 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-96143fb7-fcad-49ad-b768-97587604dded admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38366a8d0fe7487480ec8ce2f34e68bc', 'request_id': 'req-96143fb7-fcad-49ad-b768-97587604dded'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:57.666069 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-96143fb7-fcad-49ad-b768-97587604dded admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38366a8d0fe7487480ec8ce2f34e68bc', 'request_id': 'req-96143fb7-fcad-49ad-b768-97587604dded'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:57.731105 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a964a7ed-a3a4-4519-884c-9c449df44f91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '384017be1a854c4c88477b8dc0c93840', 'request_id': 'req-a964a7ed-a3a4-4519-884c-9c449df44f91'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:57.742595 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a964a7ed-a3a4-4519-884c-9c449df44f91 admin admin] The token cache is being invalidate because project 384017be1a854c4c88477b8dc0c93840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:03:57.742936 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a964a7ed-a3a4-4519-884c-9c449df44f91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:57.743589 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a964a7ed-a3a4-4519-884c-9c449df44f91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:57.745174 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1238/2454] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:03:57 2022] DELETE /identity/v3/projects/384017be1a854c4c88477b8dc0c93840 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:03:57.752175 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f4cbb-c6a4-4d25-8a96-6d26b28014f5 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:57.752466 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f4cbb-c6a4-4d25-8a96-6d26b28014f5 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:57.752746 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f4cbb-c6a4-4d25-8a96-6d26b28014f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:57.772278 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-514f4cbb-c6a4-4d25-8a96-6d26b28014f5 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:57.773509 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-514f4cbb-c6a4-4d25-8a96-6d26b28014f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:57.831965 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-96143fb7-fcad-49ad-b768-97587604dded admin admin] The token cache is being invalidate because project 38366a8d0fe7487480ec8ce2f34e68bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:03:57.832260 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-96143fb7-fcad-49ad-b768-97587604dded admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:57.835397 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-96143fb7-fcad-49ad-b768-97587604dded admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:03:57.835397 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1217/2455] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:03:57 2022] DELETE /identity/v3/projects/38366a8d0fe7487480ec8ce2f34e68bc => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:03:57.835638 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1239/2456] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:03:57.843873 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b40ed-feb5-4c03-a965-b4b89612ff17 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:57.844154 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b40ed-feb5-4c03-a965-b4b89612ff17 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:57.844434 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b40ed-feb5-4c03-a965-b4b89612ff17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:57.865370 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-686b40ed-feb5-4c03-a965-b4b89612ff17 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:57.869990 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-686b40ed-feb5-4c03-a965-b4b89612ff17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:57.875380 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1218/2457] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:03:57.880045 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f4cbb-c6a4-4d25-8a96-6d26b28014f5 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:57.881507 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-514f4cbb-c6a4-4d25-8a96-6d26b28014f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:57.894864 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f4cbb-c6a4-4d25-8a96-6d26b28014f5 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:57.900087 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17546f7a-5ab8-4bd9-a75f-c3ebd49bdf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:57.900781 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17546f7a-5ab8-4bd9-a75f-c3ebd49bdf3e admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:57.901079 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17546f7a-5ab8-4bd9-a75f-c3ebd49bdf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:57.901370 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17546f7a-5ab8-4bd9-a75f-c3ebd49bdf3e admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:57.902126 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17546f7a-5ab8-4bd9-a75f-c3ebd49bdf3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:03:57.902435 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17546f7a-5ab8-4bd9-a75f-c3ebd49bdf3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:57.904085 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17546f7a-5ab8-4bd9-a75f-c3ebd49bdf3e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:57.917145 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1240/2458] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 15:03:57.921908 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b40ed-feb5-4c03-a965-b4b89612ff17 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:57.931828 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b40ed-feb5-4c03-a965-b4b89612ff17 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:57.939132 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec0144-9ed6-45b3-9911-9118d1cac130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:57.944567 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec0144-9ed6-45b3-9911-9118d1cac130 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:57.944567 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec0144-9ed6-45b3-9911-9118d1cac130 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:57.944567 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec0144-9ed6-45b3-9911-9118d1cac130 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:57.944567 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec0144-9ed6-45b3-9911-9118d1cac130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:57.944567 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec0144-9ed6-45b3-9911-9118d1cac130 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:58.126104 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1219/2459] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:03:57 2022] POST /identity/v3/projects => generated 385 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:03:58.128202 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17546f7a-5ab8-4bd9-a75f-c3ebd49bdf3e admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:58.138707 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17546f7a-5ab8-4bd9-a75f-c3ebd49bdf3e admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:58.199795 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78bbe4-6c9d-4fc6-a956-cff42c2c2ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:58.200461 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78bbe4-6c9d-4fc6-a956-cff42c2c2ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:58.200824 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78bbe4-6c9d-4fc6-a956-cff42c2c2ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:58.201116 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78bbe4-6c9d-4fc6-a956-cff42c2c2ee1 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:58.201814 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78bbe4-6c9d-4fc6-a956-cff42c2c2ee1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:58.204486 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78bbe4-6c9d-4fc6-a956-cff42c2c2ee1 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:58.315616 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1241/2460] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:03:58 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:03:58.316074 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec0144-9ed6-45b3-9911-9118d1cac130 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:58.326866 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec0144-9ed6-45b3-9911-9118d1cac130 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:58.334785 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2504879-3379-43e2-8435-f398e3000678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:58.334785 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2504879-3379-43e2-8435-f398e3000678 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:58.334785 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2504879-3379-43e2-8435-f398e3000678 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:58.334785 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2504879-3379-43e2-8435-f398e3000678 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:58.335629 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2504879-3379-43e2-8435-f398e3000678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:58.337016 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2504879-3379-43e2-8435-f398e3000678 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:58.350196 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1220/2461] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:03:58.354505 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78bbe4-6c9d-4fc6-a956-cff42c2c2ee1 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:58.365481 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78bbe4-6c9d-4fc6-a956-cff42c2c2ee1 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:58.370247 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f30d7b-81e9-4ef6-80f3-64a0e82de989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:58.371002 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f30d7b-81e9-4ef6-80f3-64a0e82de989 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:58.371352 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f30d7b-81e9-4ef6-80f3-64a0e82de989 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:58.371698 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f30d7b-81e9-4ef6-80f3-64a0e82de989 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:58.372509 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f30d7b-81e9-4ef6-80f3-64a0e82de989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:58.374237 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f30d7b-81e9-4ef6-80f3-64a0e82de989 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:58.385623 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1242/2462] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:03:58.389788 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2504879-3379-43e2-8435-f398e3000678 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:58.400345 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2504879-3379-43e2-8435-f398e3000678 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:58.406964 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee07e90-4aac-4f18-a548-3150b3ad90a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:58.416292 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee07e90-4aac-4f18-a548-3150b3ad90a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:58.416292 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee07e90-4aac-4f18-a548-3150b3ad90a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:58.416292 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee07e90-4aac-4f18-a548-3150b3ad90a6 admin admin] PATH_INFO: `/v3/projects/017b5da3f4084be79e0ae2a899dfff0f/users/271f97bd52e74991a53a75d8e2bd33dc/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:58.424880 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee07e90-4aac-4f18-a548-3150b3ad90a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=017b5da3f4084be79e0ae2a899dfff0f, user_id=271f97bd52e74991a53a75d8e2bd33dc, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:58.427785 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee07e90-4aac-4f18-a548-3150b3ad90a6 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:58.519853 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1221/2463] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:03:58 2022] PUT /identity/v3/projects/017b5da3f4084be79e0ae2a899dfff0f/users/271f97bd52e74991a53a75d8e2bd33dc/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:03:58.536839 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaa793-c106-4cd4-b940-e309b872b4bc None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:58.537339 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaa793-c106-4cd4-b940-e309b872b4bc None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:58.537448 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaa793-c106-4cd4-b940-e309b872b4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:58.565726 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-bbdaa793-c106-4cd4-b940-e309b872b4bc None None] MFA Rules not processed for user `271f97bd52e74991a53a75d8e2bd33dc`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:58.566952 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-bbdaa793-c106-4cd4-b940-e309b872b4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:58.632088 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1243/2464] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:03:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:03:58.636699 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee07e90-4aac-4f18-a548-3150b3ad90a6 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:58.696465 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee07e90-4aac-4f18-a548-3150b3ad90a6 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:58.701302 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371353ca-c576-4d4c-aa45-6a874b7ea334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:58.701960 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371353ca-c576-4d4c-aa45-6a874b7ea334 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:58.702247 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371353ca-c576-4d4c-aa45-6a874b7ea334 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:58.702525 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371353ca-c576-4d4c-aa45-6a874b7ea334 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:58.703233 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371353ca-c576-4d4c-aa45-6a874b7ea334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:58.705168 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371353ca-c576-4d4c-aa45-6a874b7ea334 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:58.799925 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1222/2465] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:03:58 2022] POST /identity/v3/projects => generated 387 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:03:58.803926 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdaa793-c106-4cd4-b940-e309b872b4bc None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:58.814834 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdaa793-c106-4cd4-b940-e309b872b4bc None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:58.873257 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf274f4-9a94-454c-add4-bfb23f393474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:58.873994 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf274f4-9a94-454c-add4-bfb23f393474 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:58.874281 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf274f4-9a94-454c-add4-bfb23f393474 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:58.874600 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf274f4-9a94-454c-add4-bfb23f393474 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:58.875334 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf274f4-9a94-454c-add4-bfb23f393474 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:58.877370 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf274f4-9a94-454c-add4-bfb23f393474 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:58.951880 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1244/2466] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:03:58 2022] POST /identity/v3/users => generated 300 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:03:58.953689 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371353ca-c576-4d4c-aa45-6a874b7ea334 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:58.964127 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371353ca-c576-4d4c-aa45-6a874b7ea334 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:58.969644 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7bdde-888c-408f-af07-53d21e73d50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:58.970310 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7bdde-888c-408f-af07-53d21e73d50f admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:58.970590 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7bdde-888c-408f-af07-53d21e73d50f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:58.970866 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7bdde-888c-408f-af07-53d21e73d50f admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:58.971609 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7bdde-888c-408f-af07-53d21e73d50f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:58.973223 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7bdde-888c-408f-af07-53d21e73d50f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:58.984083 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1223/2467] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:03:58.988342 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf274f4-9a94-454c-add4-bfb23f393474 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:58.998826 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf274f4-9a94-454c-add4-bfb23f393474 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:59.003568 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e87250-fd30-4ef9-973f-42b312fdb8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:59.012457 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e87250-fd30-4ef9-973f-42b312fdb8fb admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:59.012457 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e87250-fd30-4ef9-973f-42b312fdb8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:59.012457 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e87250-fd30-4ef9-973f-42b312fdb8fb admin admin] PATH_INFO: `/v3/projects/53474641f2ef4ebaaa331d3912f280ed/users/c11fdb144b5e444ca2b6645cca33339e/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:59.020669 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e87250-fd30-4ef9-973f-42b312fdb8fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=53474641f2ef4ebaaa331d3912f280ed, user_id=c11fdb144b5e444ca2b6645cca33339e, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:59.023352 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e87250-fd30-4ef9-973f-42b312fdb8fb admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:59.114982 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1245/2468] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:03:58 2022] PUT /identity/v3/projects/53474641f2ef4ebaaa331d3912f280ed/users/c11fdb144b5e444ca2b6645cca33339e/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:03:59.119419 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7bdde-888c-408f-af07-53d21e73d50f admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:59.129987 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7bdde-888c-408f-af07-53d21e73d50f admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:59.186106 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee5a68-7cf5-4e97-830d-adf074c3c860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:59.186802 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee5a68-7cf5-4e97-830d-adf074c3c860 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:59.187232 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee5a68-7cf5-4e97-830d-adf074c3c860 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:59.188092 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee5a68-7cf5-4e97-830d-adf074c3c860 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:59.188856 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee5a68-7cf5-4e97-830d-adf074c3c860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:59.190523 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee5a68-7cf5-4e97-830d-adf074c3c860 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:59.201387 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1224/2469] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:03:59.205881 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e87250-fd30-4ef9-973f-42b312fdb8fb admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:59.218838 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e87250-fd30-4ef9-973f-42b312fdb8fb admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:59.224016 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2633c7b-dd11-40f7-9ab3-c5606dacefcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:59.225037 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2633c7b-dd11-40f7-9ab3-c5606dacefcc admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:59.225473 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2633c7b-dd11-40f7-9ab3-c5606dacefcc admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:59.225753 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2633c7b-dd11-40f7-9ab3-c5606dacefcc admin admin] PATH_INFO: `/v3/projects/53474641f2ef4ebaaa331d3912f280ed/users/c11fdb144b5e444ca2b6645cca33339e/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:59.228327 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2633c7b-dd11-40f7-9ab3-c5606dacefcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=53474641f2ef4ebaaa331d3912f280ed, user_id=c11fdb144b5e444ca2b6645cca33339e, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:59.231410 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2633c7b-dd11-40f7-9ab3-c5606dacefcc admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:59.242726 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1246/2470] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:03:59 2022] PUT /identity/v3/projects/53474641f2ef4ebaaa331d3912f280ed/users/c11fdb144b5e444ca2b6645cca33339e/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:03:59.253316 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260b164-dba2-4068-a275-988ab779c86a None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:59.253608 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260b164-dba2-4068-a275-988ab779c86a None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:59.253889 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260b164-dba2-4068-a275-988ab779c86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:59.279110 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-b260b164-dba2-4068-a275-988ab779c86a None None] MFA Rules not processed for user `c11fdb144b5e444ca2b6645cca33339e`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:59.280298 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-b260b164-dba2-4068-a275-988ab779c86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:59.347998 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1225/2471] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:03:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:03:59.357735 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2633c7b-dd11-40f7-9ab3-c5606dacefcc admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:03:59.360056 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-c2633c7b-dd11-40f7-9ab3-c5606dacefcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:59.420598 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2633c7b-dd11-40f7-9ab3-c5606dacefcc admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:03:59.425553 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87116747-bf20-4c83-aeff-19a1099dcad0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:03:59.426205 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87116747-bf20-4c83-aeff-19a1099dcad0 service cinder] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:59.426542 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87116747-bf20-4c83-aeff-19a1099dcad0 service cinder] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:59.426747 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87116747-bf20-4c83-aeff-19a1099dcad0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:59.443408 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87116747-bf20-4c83-aeff-19a1099dcad0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:03:59.445893 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87116747-bf20-4c83-aeff-19a1099dcad0 service cinder] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:03:59.467367 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1247/2472] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:03:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:03:59.878706 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddffc2-4b83-41c0-a7be-242b136970d9 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:03:59.879193 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddffc2-4b83-41c0-a7be-242b136970d9 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:03:59.879584 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddffc2-4b83-41c0-a7be-242b136970d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:03:59.898191 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-d9ddffc2-4b83-41c0-a7be-242b136970d9 None None] MFA Rules not processed for user `d43400b4646449ce94967ec5bab4eca1`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:03:59.899370 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-d9ddffc2-4b83-41c0-a7be-242b136970d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:03:59.951237 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1226/2473] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:03:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:04:00.893599 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87116747-bf20-4c83-aeff-19a1099dcad0 service cinder] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:00.956775 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87116747-bf20-4c83-aeff-19a1099dcad0 service cinder] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:00.961696 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d588c-2a3a-47e9-bdec-26cdc4d42a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:00.962590 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d588c-2a3a-47e9-bdec-26cdc4d42a64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:00.962917 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d588c-2a3a-47e9-bdec-26cdc4d42a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:00.963201 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d588c-2a3a-47e9-bdec-26cdc4d42a64 admin admin] PATH_INFO: `/v3/users/271f97bd52e74991a53a75d8e2bd33dc` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:00.964498 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d588c-2a3a-47e9-bdec-26cdc4d42a64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=271f97bd52e74991a53a75d8e2bd33dc)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:00.966524 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d588c-2a3a-47e9-bdec-26cdc4d42a64 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:01.186103 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-380d588c-2a3a-47e9-bdec-26cdc4d42a64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '271f97bd52e74991a53a75d8e2bd33dc'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:01.193799 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-380d588c-2a3a-47e9-bdec-26cdc4d42a64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '271f97bd52e74991a53a75d8e2bd33dc'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:01.194510 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-380d588c-2a3a-47e9-bdec-26cdc4d42a64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '271f97bd52e74991a53a75d8e2bd33dc'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:01.195141 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-380d588c-2a3a-47e9-bdec-26cdc4d42a64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '271f97bd52e74991a53a75d8e2bd33dc'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:01.329826 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-380d588c-2a3a-47e9-bdec-26cdc4d42a64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '271f97bd52e74991a53a75d8e2bd33dc'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:01.358060 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1248/2474] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:04:00 2022] DELETE /identity/v3/users/271f97bd52e74991a53a75d8e2bd33dc => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:04:01.364101 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b66f1-7aa4-4533-a47c-7e987053f1e4 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:01.364637 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b66f1-7aa4-4533-a47c-7e987053f1e4 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:01.364863 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b66f1-7aa4-4533-a47c-7e987053f1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:01.384103 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-553b66f1-7aa4-4533-a47c-7e987053f1e4 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:04:01.385517 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-553b66f1-7aa4-4533-a47c-7e987053f1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:01.450816 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1227/2475] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:04:01.461374 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d588c-2a3a-47e9-bdec-26cdc4d42a64 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:01.462841 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-380d588c-2a3a-47e9-bdec-26cdc4d42a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:01.530446 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d588c-2a3a-47e9-bdec-26cdc4d42a64 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:01.534954 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4dfd16-9ef6-4186-831e-14ae79196f18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:01.535590 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dfd16-9ef6-4186-831e-14ae79196f18 service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:01.535909 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dfd16-9ef6-4186-831e-14ae79196f18 service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:01.536258 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dfd16-9ef6-4186-831e-14ae79196f18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:01.547324 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4dfd16-9ef6-4186-831e-14ae79196f18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:01.548882 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4dfd16-9ef6-4186-831e-14ae79196f18 service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:01.581108 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1249/2476] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:04:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:04:02.170243 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b66f1-7aa4-4533-a47c-7e987053f1e4 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:02.172619 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-553b66f1-7aa4-4533-a47c-7e987053f1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:02.202064 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b66f1-7aa4-4533-a47c-7e987053f1e4 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:02.213662 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21280e-3255-4856-8ca9-79efcb9a30f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:02.217977 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21280e-3255-4856-8ca9-79efcb9a30f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:02.217977 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21280e-3255-4856-8ca9-79efcb9a30f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:02.217977 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21280e-3255-4856-8ca9-79efcb9a30f8 admin admin] PATH_INFO: `/v3/projects/017b5da3f4084be79e0ae2a899dfff0f` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:02.217977 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21280e-3255-4856-8ca9-79efcb9a30f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=017b5da3f4084be79e0ae2a899dfff0f)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:02.218817 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21280e-3255-4856-8ca9-79efcb9a30f8 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:02.400686 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-1b21280e-3255-4856-8ca9-79efcb9a30f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '017b5da3f4084be79e0ae2a899dfff0f', 'request_id': 'req-1b21280e-3255-4856-8ca9-79efcb9a30f8'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:02.407644 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-1b21280e-3255-4856-8ca9-79efcb9a30f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '017b5da3f4084be79e0ae2a899dfff0f', 'request_id': 'req-1b21280e-3255-4856-8ca9-79efcb9a30f8'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:02.414448 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-1b21280e-3255-4856-8ca9-79efcb9a30f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '017b5da3f4084be79e0ae2a899dfff0f', 'request_id': 'req-1b21280e-3255-4856-8ca9-79efcb9a30f8'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:02.502317 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-1b21280e-3255-4856-8ca9-79efcb9a30f8 admin admin] The token cache is being invalidate because project 017b5da3f4084be79e0ae2a899dfff0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:04:02.502608 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-1b21280e-3255-4856-8ca9-79efcb9a30f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:02.503240 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-1b21280e-3255-4856-8ca9-79efcb9a30f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:02.504792 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1228/2477] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:04:02 2022] DELETE /identity/v3/projects/017b5da3f4084be79e0ae2a899dfff0f => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:04:02.508991 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4dfd16-9ef6-4186-831e-14ae79196f18 service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:02.518899 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4dfd16-9ef6-4186-831e-14ae79196f18 service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:02.575204 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26061fb2-e6b4-4c22-9191-d422474ae0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:02.576059 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26061fb2-e6b4-4c22-9191-d422474ae0c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:02.576343 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26061fb2-e6b4-4c22-9191-d422474ae0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:02.576621 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26061fb2-e6b4-4c22-9191-d422474ae0c9 admin admin] PATH_INFO: `/v3/users/c11fdb144b5e444ca2b6645cca33339e` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:02.577909 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26061fb2-e6b4-4c22-9191-d422474ae0c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c11fdb144b5e444ca2b6645cca33339e)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:02.579845 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26061fb2-e6b4-4c22-9191-d422474ae0c9 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:02.805533 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-26061fb2-e6b4-4c22-9191-d422474ae0c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c11fdb144b5e444ca2b6645cca33339e'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:02.812243 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-26061fb2-e6b4-4c22-9191-d422474ae0c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c11fdb144b5e444ca2b6645cca33339e'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:02.812911 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-26061fb2-e6b4-4c22-9191-d422474ae0c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c11fdb144b5e444ca2b6645cca33339e'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:02.813546 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-26061fb2-e6b4-4c22-9191-d422474ae0c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c11fdb144b5e444ca2b6645cca33339e'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:02.900619 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-26061fb2-e6b4-4c22-9191-d422474ae0c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c11fdb144b5e444ca2b6645cca33339e'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:02.919745 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1250/2478] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:04:02 2022] DELETE /identity/v3/users/c11fdb144b5e444ca2b6645cca33339e => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:04:03.505838 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21280e-3255-4856-8ca9-79efcb9a30f8 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:03.507920 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-1b21280e-3255-4856-8ca9-79efcb9a30f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:03.522003 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21280e-3255-4856-8ca9-79efcb9a30f8 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:03.582932 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c9148-e740-4736-afed-688aa4fb924a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:03.584290 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c9148-e740-4736-afed-688aa4fb924a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:03.584758 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c9148-e740-4736-afed-688aa4fb924a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:03.585033 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c9148-e740-4736-afed-688aa4fb924a admin admin] PATH_INFO: `/v3/projects/53474641f2ef4ebaaa331d3912f280ed` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:03.587155 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c9148-e740-4736-afed-688aa4fb924a admin admin] RBAC: Authorizing `identity:delete_project(project_id=53474641f2ef4ebaaa331d3912f280ed)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:03.589323 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c9148-e740-4736-afed-688aa4fb924a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:03.730286 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-f62c9148-e740-4736-afed-688aa4fb924a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53474641f2ef4ebaaa331d3912f280ed', 'request_id': 'req-f62c9148-e740-4736-afed-688aa4fb924a'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:03.736475 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-f62c9148-e740-4736-afed-688aa4fb924a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53474641f2ef4ebaaa331d3912f280ed', 'request_id': 'req-f62c9148-e740-4736-afed-688aa4fb924a'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:03.741754 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-f62c9148-e740-4736-afed-688aa4fb924a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53474641f2ef4ebaaa331d3912f280ed', 'request_id': 'req-f62c9148-e740-4736-afed-688aa4fb924a'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:03.930550 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-f62c9148-e740-4736-afed-688aa4fb924a admin admin] The token cache is being invalidate because project 53474641f2ef4ebaaa331d3912f280ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:04:03.936200 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-f62c9148-e740-4736-afed-688aa4fb924a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:03.936200 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-f62c9148-e740-4736-afed-688aa4fb924a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:03.936200 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1229/2479] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:04:03 2022] DELETE /identity/v3/projects/53474641f2ef4ebaaa331d3912f280ed => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:04:03.939463 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a59273-529e-44dc-83f4-fe3472ea2f89 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:03.939915 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a59273-529e-44dc-83f4-fe3472ea2f89 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:03.940174 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a59273-529e-44dc-83f4-fe3472ea2f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:03.961230 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-14a59273-529e-44dc-83f4-fe3472ea2f89 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:04:03.963168 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-14a59273-529e-44dc-83f4-fe3472ea2f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:04.037673 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1251/2480] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:04:04.046202 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e46e9f-b36c-4ed9-97e0-8e9c07238f61 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:04.046525 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e46e9f-b36c-4ed9-97e0-8e9c07238f61 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:04.046799 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e46e9f-b36c-4ed9-97e0-8e9c07238f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:04.065572 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-a5e46e9f-b36c-4ed9-97e0-8e9c07238f61 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:04:04.066810 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-a5e46e9f-b36c-4ed9-97e0-8e9c07238f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:04.075193 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1230/2481] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:04:04.080081 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a59273-529e-44dc-83f4-fe3472ea2f89 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:04.090145 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a59273-529e-44dc-83f4-fe3472ea2f89 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:04.094903 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d9d47-04f4-4c90-b7f2-b057e8e64e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:04.095554 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d9d47-04f4-4c90-b7f2-b057e8e64e47 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:04.095839 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d9d47-04f4-4c90-b7f2-b057e8e64e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:04.096221 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d9d47-04f4-4c90-b7f2-b057e8e64e47 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:04.096966 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d9d47-04f4-4c90-b7f2-b057e8e64e47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:04:04.097304 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d9d47-04f4-4c90-b7f2-b057e8e64e47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:04.098913 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d9d47-04f4-4c90-b7f2-b057e8e64e47 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:04.112534 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1252/2482] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 15:04:04.122391 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e46e9f-b36c-4ed9-97e0-8e9c07238f61 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:04.132262 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e46e9f-b36c-4ed9-97e0-8e9c07238f61 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:04.137256 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286d960-be53-43eb-a6e6-d050e8993f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:04.138036 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286d960-be53-43eb-a6e6-d050e8993f3f admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:04.138512 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286d960-be53-43eb-a6e6-d050e8993f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:04.138885 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286d960-be53-43eb-a6e6-d050e8993f3f admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:04.139683 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286d960-be53-43eb-a6e6-d050e8993f3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:04.142491 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286d960-be53-43eb-a6e6-d050e8993f3f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:04.339640 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1231/2483] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:04:04 2022] POST /identity/v3/projects => generated 371 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:04:04.344161 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d9d47-04f4-4c90-b7f2-b057e8e64e47 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:04.354657 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d9d47-04f4-4c90-b7f2-b057e8e64e47 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:04.420076 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a01333-ef4d-4673-bb8d-5f213d3370c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:04.420770 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a01333-ef4d-4673-bb8d-5f213d3370c0 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:04.421107 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a01333-ef4d-4673-bb8d-5f213d3370c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:04.421427 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a01333-ef4d-4673-bb8d-5f213d3370c0 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:04.422146 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a01333-ef4d-4673-bb8d-5f213d3370c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:04.424360 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a01333-ef4d-4673-bb8d-5f213d3370c0 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:04.524708 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1253/2484] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:04:04 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:04:04.528535 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286d960-be53-43eb-a6e6-d050e8993f3f admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:04.541274 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286d960-be53-43eb-a6e6-d050e8993f3f admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:04.546524 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ab778-5bd0-4629-8d16-c23760ff152e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:04.547195 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ab778-5bd0-4629-8d16-c23760ff152e admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:04.547476 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ab778-5bd0-4629-8d16-c23760ff152e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:04.547749 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ab778-5bd0-4629-8d16-c23760ff152e admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:04.548604 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ab778-5bd0-4629-8d16-c23760ff152e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:04.550408 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ab778-5bd0-4629-8d16-c23760ff152e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:04.564662 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1232/2485] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:04:04.568455 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a01333-ef4d-4673-bb8d-5f213d3370c0 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:04.580273 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a01333-ef4d-4673-bb8d-5f213d3370c0 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:04.587221 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf3fe1-d868-4b2f-876a-a29894711df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:04.589330 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf3fe1-d868-4b2f-876a-a29894711df3 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:04.589330 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf3fe1-d868-4b2f-876a-a29894711df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:04.589330 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf3fe1-d868-4b2f-876a-a29894711df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:04.589330 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf3fe1-d868-4b2f-876a-a29894711df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:04.591535 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf3fe1-d868-4b2f-876a-a29894711df3 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:04.605604 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1254/2486] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:04:04.610359 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ab778-5bd0-4629-8d16-c23760ff152e admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:04.624208 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ab778-5bd0-4629-8d16-c23760ff152e admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:04.631860 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64950e9c-9ae4-44b5-ba45-1ac0632a1f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:04.633157 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64950e9c-9ae4-44b5-ba45-1ac0632a1f27 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:04.633561 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64950e9c-9ae4-44b5-ba45-1ac0632a1f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:04.633907 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64950e9c-9ae4-44b5-ba45-1ac0632a1f27 admin admin] PATH_INFO: `/v3/projects/a7a76dae13c24b43b6094f0aa8cfb6d3/users/fb86cc7367cf400595d2d5406842c23a/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:04.654610 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64950e9c-9ae4-44b5-ba45-1ac0632a1f27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a76dae13c24b43b6094f0aa8cfb6d3, user_id=fb86cc7367cf400595d2d5406842c23a, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:04.657763 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64950e9c-9ae4-44b5-ba45-1ac0632a1f27 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:04.740945 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1233/2487] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:04:04 2022] PUT /identity/v3/projects/a7a76dae13c24b43b6094f0aa8cfb6d3/users/fb86cc7367cf400595d2d5406842c23a/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:04:04.741192 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e619a-820b-4748-a8b2-ce005fb05d98 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:04.741192 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e619a-820b-4748-a8b2-ce005fb05d98 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:04.741192 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e619a-820b-4748-a8b2-ce005fb05d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:04.754919 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-580e619a-820b-4748-a8b2-ce005fb05d98 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:04:04.756118 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-580e619a-820b-4748-a8b2-ce005fb05d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:04.835096 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1255/2488] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:04:04.844335 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64950e9c-9ae4-44b5-ba45-1ac0632a1f27 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:04.846464 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-64950e9c-9ae4-44b5-ba45-1ac0632a1f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:04.901936 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64950e9c-9ae4-44b5-ba45-1ac0632a1f27 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:04.905605 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ef181-136d-44e6-9230-74ad54e77748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:04.906772 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ef181-136d-44e6-9230-74ad54e77748 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:04.907051 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ef181-136d-44e6-9230-74ad54e77748 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:04.907329 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ef181-136d-44e6-9230-74ad54e77748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:04.916228 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ef181-136d-44e6-9230-74ad54e77748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:04.917705 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ef181-136d-44e6-9230-74ad54e77748 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:04.927180 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1234/2489] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:04:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:04:05.085858 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e619a-820b-4748-a8b2-ce005fb05d98 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:05.087627 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-580e619a-820b-4748-a8b2-ce005fb05d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:05.100297 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e619a-820b-4748-a8b2-ce005fb05d98 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:05.104382 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32596f6-42e8-4a63-8058-6b4359115fd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:05.105051 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32596f6-42e8-4a63-8058-6b4359115fd2 service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:05.105366 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32596f6-42e8-4a63-8058-6b4359115fd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:05.105647 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32596f6-42e8-4a63-8058-6b4359115fd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:05.107684 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-a32596f6-42e8-4a63-8058-6b4359115fd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:05.170599 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32596f6-42e8-4a63-8058-6b4359115fd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:05.172581 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32596f6-42e8-4a63-8058-6b4359115fd2 service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:05.182166 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1256/2490] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:04:05 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:04:06.492060 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b5b33-897a-452c-9977-69bae64bdc0c None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:06.496846 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b5b33-897a-452c-9977-69bae64bdc0c None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:06.496846 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b5b33-897a-452c-9977-69bae64bdc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:06.526006 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-a65b5b33-897a-452c-9977-69bae64bdc0c None None] MFA Rules not processed for user `fb86cc7367cf400595d2d5406842c23a`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:04:06.527234 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-a65b5b33-897a-452c-9977-69bae64bdc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:06.604445 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1235/2491] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:04:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:04:06.608743 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32596f6-42e8-4a63-8058-6b4359115fd2 service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:06.618929 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32596f6-42e8-4a63-8058-6b4359115fd2 service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:06.623466 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7f8b5-fddb-4bc6-adb8-39430fa85537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:06.624144 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7f8b5-fddb-4bc6-adb8-39430fa85537 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:06.624452 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7f8b5-fddb-4bc6-adb8-39430fa85537 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:06.624735 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7f8b5-fddb-4bc6-adb8-39430fa85537 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:06.625472 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7f8b5-fddb-4bc6-adb8-39430fa85537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:06.627365 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7f8b5-fddb-4bc6-adb8-39430fa85537 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:06.747151 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1257/2492] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:04:06 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:04:06.748439 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b5b33-897a-452c-9977-69bae64bdc0c None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:06.759561 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b5b33-897a-452c-9977-69bae64bdc0c None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:06.814090 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3362b3-09f3-45c8-9250-751b91778f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:06.814765 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3362b3-09f3-45c8-9250-751b91778f7b admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:06.815037 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3362b3-09f3-45c8-9250-751b91778f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:06.815310 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3362b3-09f3-45c8-9250-751b91778f7b admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:06.816000 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3362b3-09f3-45c8-9250-751b91778f7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:06.817974 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3362b3-09f3-45c8-9250-751b91778f7b admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:06.938463 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1236/2493] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:04:06 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:04:06.941982 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7f8b5-fddb-4bc6-adb8-39430fa85537 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:06.957495 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7f8b5-fddb-4bc6-adb8-39430fa85537 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:06.963287 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f265a06-64a6-460e-a12d-6ad24155ab5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:06.964056 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f265a06-64a6-460e-a12d-6ad24155ab5c admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:06.964417 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f265a06-64a6-460e-a12d-6ad24155ab5c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:06.964769 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f265a06-64a6-460e-a12d-6ad24155ab5c admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:06.965646 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f265a06-64a6-460e-a12d-6ad24155ab5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:06.967449 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f265a06-64a6-460e-a12d-6ad24155ab5c admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:06.981510 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1258/2494] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:04:06.983470 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3362b3-09f3-45c8-9250-751b91778f7b admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:06.998432 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3362b3-09f3-45c8-9250-751b91778f7b admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:07.006799 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd0b50-275d-4336-a7a7-f9b93b876bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:07.006799 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd0b50-275d-4336-a7a7-f9b93b876bda admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:07.006799 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd0b50-275d-4336-a7a7-f9b93b876bda admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:07.006799 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd0b50-275d-4336-a7a7-f9b93b876bda admin admin] PATH_INFO: `/v3/projects/60e4d6b05c2e44879f4e5920fddb4e06/users/34ef076b19194e6da4dbfd3213dd47ba/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:07.023222 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd0b50-275d-4336-a7a7-f9b93b876bda admin admin] RBAC: Authorizing `identity:create_grant(project_id=60e4d6b05c2e44879f4e5920fddb4e06, user_id=34ef076b19194e6da4dbfd3213dd47ba, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:07.025915 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd0b50-275d-4336-a7a7-f9b93b876bda admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:07.149230 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1237/2495] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:04:06 2022] PUT /identity/v3/projects/60e4d6b05c2e44879f4e5920fddb4e06/users/34ef076b19194e6da4dbfd3213dd47ba/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:04:07.153297 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f265a06-64a6-460e-a12d-6ad24155ab5c admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:07.164149 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f265a06-64a6-460e-a12d-6ad24155ab5c admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:07.223250 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155f3da-2cfe-483d-9daa-44709f42d845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:07.223951 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155f3da-2cfe-483d-9daa-44709f42d845 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:07.224229 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155f3da-2cfe-483d-9daa-44709f42d845 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:07.224508 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155f3da-2cfe-483d-9daa-44709f42d845 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:07.225272 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e155f3da-2cfe-483d-9daa-44709f42d845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:07.226939 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e155f3da-2cfe-483d-9daa-44709f42d845 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:07.237251 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1259/2496] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:04:07.241388 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd0b50-275d-4336-a7a7-f9b93b876bda admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:07.251631 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd0b50-275d-4336-a7a7-f9b93b876bda admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:07.256310 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db6f65-0e4a-4e1d-95f9-9783adf7f91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:07.257219 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db6f65-0e4a-4e1d-95f9-9783adf7f91e admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:07.257511 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db6f65-0e4a-4e1d-95f9-9783adf7f91e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:07.257791 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db6f65-0e4a-4e1d-95f9-9783adf7f91e admin admin] PATH_INFO: `/v3/projects/60e4d6b05c2e44879f4e5920fddb4e06/users/34ef076b19194e6da4dbfd3213dd47ba/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:07.261938 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db6f65-0e4a-4e1d-95f9-9783adf7f91e admin admin] RBAC: Authorizing `identity:create_grant(project_id=60e4d6b05c2e44879f4e5920fddb4e06, user_id=34ef076b19194e6da4dbfd3213dd47ba, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:07.264583 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db6f65-0e4a-4e1d-95f9-9783adf7f91e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:07.275938 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1238/2497] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:04:07 2022] PUT /identity/v3/projects/60e4d6b05c2e44879f4e5920fddb4e06/users/34ef076b19194e6da4dbfd3213dd47ba/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:04:09.069302 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb283d-f822-4045-9771-408f64fbece1 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:09.071133 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb283d-f822-4045-9771-408f64fbece1 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:09.071133 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb283d-f822-4045-9771-408f64fbece1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:09.106794 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-23bb283d-f822-4045-9771-408f64fbece1 None None] MFA Rules not processed for user `34ef076b19194e6da4dbfd3213dd47ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:04:09.108279 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-23bb283d-f822-4045-9771-408f64fbece1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:09.185831 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1260/2498] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:04:09 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:04:09.196867 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db6f65-0e4a-4e1d-95f9-9783adf7f91e admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:09.198687 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-93db6f65-0e4a-4e1d-95f9-9783adf7f91e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:09.274591 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db6f65-0e4a-4e1d-95f9-9783adf7f91e admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:09.280272 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231ae0c-f20b-4759-a499-aea3980d672f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:09.281500 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231ae0c-f20b-4759-a499-aea3980d672f service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:09.281939 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231ae0c-f20b-4759-a499-aea3980d672f service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:09.282365 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231ae0c-f20b-4759-a499-aea3980d672f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:09.363069 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231ae0c-f20b-4759-a499-aea3980d672f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:09.364675 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231ae0c-f20b-4759-a499-aea3980d672f service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:09.375533 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1239/2499] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:04:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:04:11.143689 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb283d-f822-4045-9771-408f64fbece1 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:11.145181 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-23bb283d-f822-4045-9771-408f64fbece1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:11.157407 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb283d-f822-4045-9771-408f64fbece1 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:11.161127 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4108d-a8c0-4d5e-bbef-f591f8d74f22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:11.161766 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4108d-a8c0-4d5e-bbef-f591f8d74f22 service cinder] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:11.162050 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4108d-a8c0-4d5e-bbef-f591f8d74f22 service cinder] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:11.162361 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4108d-a8c0-4d5e-bbef-f591f8d74f22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:11.171478 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4108d-a8c0-4d5e-bbef-f591f8d74f22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:11.172911 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4108d-a8c0-4d5e-bbef-f591f8d74f22 service cinder] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:11.182360 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1261/2500] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:04:11 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:04:22.086215 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231ae0c-f20b-4759-a499-aea3980d672f service cinder] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:22.138601 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231ae0c-f20b-4759-a499-aea3980d672f service cinder] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:22.142386 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5c02f-e3be-4668-8b2b-3ef993dece2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:22.143026 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5c02f-e3be-4668-8b2b-3ef993dece2b service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:22.143312 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5c02f-e3be-4668-8b2b-3ef993dece2b service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:22.143588 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5c02f-e3be-4668-8b2b-3ef993dece2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:22.145466 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-b2b5c02f-e3be-4668-8b2b-3ef993dece2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:22.212669 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5c02f-e3be-4668-8b2b-3ef993dece2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:22.214155 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5c02f-e3be-4668-8b2b-3ef993dece2b service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:22.225351 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1240/2501] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:04:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:04:23.417463 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4108d-a8c0-4d5e-bbef-f591f8d74f22 service cinder] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:23.426525 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4108d-a8c0-4d5e-bbef-f591f8d74f22 service cinder] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:23.430157 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad1753-4d52-4df2-bd17-191670bc6df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:23.430779 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad1753-4d52-4df2-bd17-191670bc6df4 service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:23.431066 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad1753-4d52-4df2-bd17-191670bc6df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:23.431343 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad1753-4d52-4df2-bd17-191670bc6df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:23.433093 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-97ad1753-4d52-4df2-bd17-191670bc6df4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:23.447362 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad1753-4d52-4df2-bd17-191670bc6df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:23.448784 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad1753-4d52-4df2-bd17-191670bc6df4 service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:23.460325 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1262/2502] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:04:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:04:27.448074 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5c02f-e3be-4668-8b2b-3ef993dece2b service neutron] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:27.509427 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5c02f-e3be-4668-8b2b-3ef993dece2b service neutron] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:27.514395 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa99c3f-5cf4-4934-b662-e17683bdd617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:27.515288 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa99c3f-5cf4-4934-b662-e17683bdd617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:27.515556 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa99c3f-5cf4-4934-b662-e17683bdd617 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:27.515831 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa99c3f-5cf4-4934-b662-e17683bdd617 admin admin] PATH_INFO: `/v3/users/fb86cc7367cf400595d2d5406842c23a` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:27.517035 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa99c3f-5cf4-4934-b662-e17683bdd617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb86cc7367cf400595d2d5406842c23a)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:27.519021 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa99c3f-5cf4-4934-b662-e17683bdd617 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:27.767019 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-2aa99c3f-5cf4-4934-b662-e17683bdd617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb86cc7367cf400595d2d5406842c23a'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:27.773586 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-2aa99c3f-5cf4-4934-b662-e17683bdd617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb86cc7367cf400595d2d5406842c23a'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:27.774270 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-2aa99c3f-5cf4-4934-b662-e17683bdd617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb86cc7367cf400595d2d5406842c23a'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:27.861998 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-2aa99c3f-5cf4-4934-b662-e17683bdd617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb86cc7367cf400595d2d5406842c23a'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:27.873635 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-2aa99c3f-5cf4-4934-b662-e17683bdd617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb86cc7367cf400595d2d5406842c23a'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:27.879585 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1241/2503] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:04:27 2022] DELETE /identity/v3/users/fb86cc7367cf400595d2d5406842c23a => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:04:28.202097 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad1753-4d52-4df2-bd17-191670bc6df4 service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:28.215671 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad1753-4d52-4df2-bd17-191670bc6df4 service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:28.272627 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e2cc4-4810-4dc0-821e-7437b03c1982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:28.273512 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e2cc4-4810-4dc0-821e-7437b03c1982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:28.273794 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e2cc4-4810-4dc0-821e-7437b03c1982 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:28.274066 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e2cc4-4810-4dc0-821e-7437b03c1982 admin admin] PATH_INFO: `/v3/projects/a7a76dae13c24b43b6094f0aa8cfb6d3` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:28.275266 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e2cc4-4810-4dc0-821e-7437b03c1982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7a76dae13c24b43b6094f0aa8cfb6d3)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:28.277256 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e2cc4-4810-4dc0-821e-7437b03c1982 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:28.397584 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-599e2cc4-4810-4dc0-821e-7437b03c1982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7a76dae13c24b43b6094f0aa8cfb6d3', 'request_id': 'req-599e2cc4-4810-4dc0-821e-7437b03c1982'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:28.404608 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-599e2cc4-4810-4dc0-821e-7437b03c1982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7a76dae13c24b43b6094f0aa8cfb6d3', 'request_id': 'req-599e2cc4-4810-4dc0-821e-7437b03c1982'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:28.470976 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-599e2cc4-4810-4dc0-821e-7437b03c1982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7a76dae13c24b43b6094f0aa8cfb6d3', 'request_id': 'req-599e2cc4-4810-4dc0-821e-7437b03c1982'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:28.481668 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-599e2cc4-4810-4dc0-821e-7437b03c1982 admin admin] The token cache is being invalidate because project a7a76dae13c24b43b6094f0aa8cfb6d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:04:28.481978 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-599e2cc4-4810-4dc0-821e-7437b03c1982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:28.482611 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-599e2cc4-4810-4dc0-821e-7437b03c1982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:28.484177 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1263/2504] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:04:28 2022] DELETE /identity/v3/projects/a7a76dae13c24b43b6094f0aa8cfb6d3 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:04:28.488068 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa99c3f-5cf4-4934-b662-e17683bdd617 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:28.489492 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-2aa99c3f-5cf4-4934-b662-e17683bdd617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:28.502139 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa99c3f-5cf4-4934-b662-e17683bdd617 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:28.557538 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50ac95-807a-44c0-ae3f-528b94e1248b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:28.558402 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50ac95-807a-44c0-ae3f-528b94e1248b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:28.558684 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50ac95-807a-44c0-ae3f-528b94e1248b admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:28.558958 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50ac95-807a-44c0-ae3f-528b94e1248b admin admin] PATH_INFO: `/v3/users/34ef076b19194e6da4dbfd3213dd47ba` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:28.560132 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50ac95-807a-44c0-ae3f-528b94e1248b admin admin] RBAC: Authorizing `identity:delete_user(user_id=34ef076b19194e6da4dbfd3213dd47ba)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:28.562564 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50ac95-807a-44c0-ae3f-528b94e1248b admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:28.738406 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ec50ac95-807a-44c0-ae3f-528b94e1248b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34ef076b19194e6da4dbfd3213dd47ba'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:28.745043 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ec50ac95-807a-44c0-ae3f-528b94e1248b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34ef076b19194e6da4dbfd3213dd47ba'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:28.745746 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ec50ac95-807a-44c0-ae3f-528b94e1248b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34ef076b19194e6da4dbfd3213dd47ba'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:28.798782 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ec50ac95-807a-44c0-ae3f-528b94e1248b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34ef076b19194e6da4dbfd3213dd47ba'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:28.810507 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ec50ac95-807a-44c0-ae3f-528b94e1248b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34ef076b19194e6da4dbfd3213dd47ba'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:28.816733 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1242/2505] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:04:28 2022] DELETE /identity/v3/users/34ef076b19194e6da4dbfd3213dd47ba => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:04:29.074834 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e2cc4-4810-4dc0-821e-7437b03c1982 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:29.076341 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-599e2cc4-4810-4dc0-821e-7437b03c1982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:29.090177 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e2cc4-4810-4dc0-821e-7437b03c1982 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:29.145375 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d33fd-0109-4410-a43f-634f806dc066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:29.146224 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d33fd-0109-4410-a43f-634f806dc066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:29.146503 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d33fd-0109-4410-a43f-634f806dc066 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:29.146771 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d33fd-0109-4410-a43f-634f806dc066 admin admin] PATH_INFO: `/v3/projects/60e4d6b05c2e44879f4e5920fddb4e06` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:29.147942 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d33fd-0109-4410-a43f-634f806dc066 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60e4d6b05c2e44879f4e5920fddb4e06)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:29.149870 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d33fd-0109-4410-a43f-634f806dc066 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:29.293630 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a13d33fd-0109-4410-a43f-634f806dc066 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60e4d6b05c2e44879f4e5920fddb4e06', 'request_id': 'req-a13d33fd-0109-4410-a43f-634f806dc066'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:29.300131 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a13d33fd-0109-4410-a43f-634f806dc066 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60e4d6b05c2e44879f4e5920fddb4e06', 'request_id': 'req-a13d33fd-0109-4410-a43f-634f806dc066'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:29.404680 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a13d33fd-0109-4410-a43f-634f806dc066 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60e4d6b05c2e44879f4e5920fddb4e06', 'request_id': 'req-a13d33fd-0109-4410-a43f-634f806dc066'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:29.415702 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a13d33fd-0109-4410-a43f-634f806dc066 admin admin] The token cache is being invalidate because project 60e4d6b05c2e44879f4e5920fddb4e06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:04:29.415993 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a13d33fd-0109-4410-a43f-634f806dc066 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:29.416621 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a13d33fd-0109-4410-a43f-634f806dc066 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:29.418194 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1264/2506] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:04:29 2022] DELETE /identity/v3/projects/60e4d6b05c2e44879f4e5920fddb4e06 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:04:29.424405 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b9a9f-132b-41d6-9c61-6dc8368b268f None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:29.424720 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b9a9f-132b-41d6-9c61-6dc8368b268f None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:29.424997 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b9a9f-132b-41d6-9c61-6dc8368b268f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:29.442724 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-fa5b9a9f-132b-41d6-9c61-6dc8368b268f None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:04:29.443957 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-fa5b9a9f-132b-41d6-9c61-6dc8368b268f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:29.500882 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1243/2507] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:04:29.508680 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80553f6d-e37f-4748-9857-62023fc98cc3 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:29.509642 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80553f6d-e37f-4748-9857-62023fc98cc3 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:29.509642 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80553f6d-e37f-4748-9857-62023fc98cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:29.527591 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-80553f6d-e37f-4748-9857-62023fc98cc3 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:04:29.528814 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-80553f6d-e37f-4748-9857-62023fc98cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:29.537502 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1265/2508] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:04:29.542467 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b9a9f-132b-41d6-9c61-6dc8368b268f None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:29.552387 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b9a9f-132b-41d6-9c61-6dc8368b268f None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:29.556888 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b66f61-6ff5-4da2-bd64-d4cf8c0257cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:29.557628 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b66f61-6ff5-4da2-bd64-d4cf8c0257cb admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:29.557912 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b66f61-6ff5-4da2-bd64-d4cf8c0257cb admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:29.558187 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b66f61-6ff5-4da2-bd64-d4cf8c0257cb admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:29.558912 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b66f61-6ff5-4da2-bd64-d4cf8c0257cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:04:29.559212 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b66f61-6ff5-4da2-bd64-d4cf8c0257cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:29.560789 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b66f61-6ff5-4da2-bd64-d4cf8c0257cb admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:29.571819 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1244/2509] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 15:04:29.579848 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80553f6d-e37f-4748-9857-62023fc98cc3 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:29.588973 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80553f6d-e37f-4748-9857-62023fc98cc3 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:29.594177 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f2c46-8c0b-4445-8154-bb2bfc66d187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:29.594818 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f2c46-8c0b-4445-8154-bb2bfc66d187 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:29.595106 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f2c46-8c0b-4445-8154-bb2bfc66d187 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:29.595380 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f2c46-8c0b-4445-8154-bb2bfc66d187 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:29.596093 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f2c46-8c0b-4445-8154-bb2bfc66d187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:29.598030 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f2c46-8c0b-4445-8154-bb2bfc66d187 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:29.680518 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1266/2510] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:04:29 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:04:29.684312 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b66f61-6ff5-4da2-bd64-d4cf8c0257cb admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:29.693900 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b66f61-6ff5-4da2-bd64-d4cf8c0257cb admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:29.747386 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d56e3-a35d-490f-b9e4-233572513cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:29.748054 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d56e3-a35d-490f-b9e4-233572513cbd admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:29.748334 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d56e3-a35d-490f-b9e4-233572513cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:29.748607 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d56e3-a35d-490f-b9e4-233572513cbd admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:29.749430 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d56e3-a35d-490f-b9e4-233572513cbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:29.751334 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d56e3-a35d-490f-b9e4-233572513cbd admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:29.831721 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1245/2511] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:04:29 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:04:29.835864 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f2c46-8c0b-4445-8154-bb2bfc66d187 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:29.846751 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f2c46-8c0b-4445-8154-bb2bfc66d187 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:29.851331 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a6252-82f1-45cd-8328-747b43231e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:29.851978 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a6252-82f1-45cd-8328-747b43231e1a admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:29.852319 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a6252-82f1-45cd-8328-747b43231e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:29.852540 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a6252-82f1-45cd-8328-747b43231e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:29.853303 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a6252-82f1-45cd-8328-747b43231e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:29.855175 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a6252-82f1-45cd-8328-747b43231e1a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:29.865887 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1267/2512] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:04:29.869766 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d56e3-a35d-490f-b9e4-233572513cbd admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:29.879429 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d56e3-a35d-490f-b9e4-233572513cbd admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:29.883963 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62455e66-0349-4be1-9750-526cbe61b1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:29.884605 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62455e66-0349-4be1-9750-526cbe61b1ac admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:29.884893 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62455e66-0349-4be1-9750-526cbe61b1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:29.885203 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62455e66-0349-4be1-9750-526cbe61b1ac admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:29.885928 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62455e66-0349-4be1-9750-526cbe61b1ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:29.887515 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62455e66-0349-4be1-9750-526cbe61b1ac admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:29.897463 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1246/2513] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:04:29.901258 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a6252-82f1-45cd-8328-747b43231e1a admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:29.911527 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a6252-82f1-45cd-8328-747b43231e1a admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:29.916124 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bff36b-d081-477a-b2b1-a8f03a4e9042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:29.916982 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bff36b-d081-477a-b2b1-a8f03a4e9042 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:29.917295 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bff36b-d081-477a-b2b1-a8f03a4e9042 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:29.917574 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bff36b-d081-477a-b2b1-a8f03a4e9042 admin admin] PATH_INFO: `/v3/projects/fc318dd66557476c972f7d24d4304b22/users/6d27b96700af4410974bb62c225caf41/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:29.932689 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bff36b-d081-477a-b2b1-a8f03a4e9042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc318dd66557476c972f7d24d4304b22, user_id=6d27b96700af4410974bb62c225caf41, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:29.935280 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bff36b-d081-477a-b2b1-a8f03a4e9042 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:30.039008 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1268/2514] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:04:29 2022] PUT /identity/v3/projects/fc318dd66557476c972f7d24d4304b22/users/6d27b96700af4410974bb62c225caf41/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:04:30.049157 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a3e0b-1eec-45da-8a7a-efa1cc6f497c None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:30.054187 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a3e0b-1eec-45da-8a7a-efa1cc6f497c None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:30.054187 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a3e0b-1eec-45da-8a7a-efa1cc6f497c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:30.075769 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-154a3e0b-1eec-45da-8a7a-efa1cc6f497c None None] MFA Rules not processed for user `6d27b96700af4410974bb62c225caf41`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:04:30.076938 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-154a3e0b-1eec-45da-8a7a-efa1cc6f497c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:30.139786 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1247/2515] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:04:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:04:30.144749 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bff36b-d081-477a-b2b1-a8f03a4e9042 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:30.204615 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bff36b-d081-477a-b2b1-a8f03a4e9042 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:30.209285 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431fe7e-64f9-4385-9c4b-6d6b4febd9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:30.209945 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431fe7e-64f9-4385-9c4b-6d6b4febd9ee admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:30.210228 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431fe7e-64f9-4385-9c4b-6d6b4febd9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:30.210527 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431fe7e-64f9-4385-9c4b-6d6b4febd9ee admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:30.211221 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431fe7e-64f9-4385-9c4b-6d6b4febd9ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:30.213138 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431fe7e-64f9-4385-9c4b-6d6b4febd9ee admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:30.306579 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1269/2516] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:04:30 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:04:30.310748 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a3e0b-1eec-45da-8a7a-efa1cc6f497c None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:30.322135 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a3e0b-1eec-45da-8a7a-efa1cc6f497c None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:30.380319 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53e16f-f650-496c-afc5-ab9f3af909e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:30.380994 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53e16f-f650-496c-afc5-ab9f3af909e7 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:30.381314 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53e16f-f650-496c-afc5-ab9f3af909e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:30.381596 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53e16f-f650-496c-afc5-ab9f3af909e7 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:30.382311 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53e16f-f650-496c-afc5-ab9f3af909e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:30.384239 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53e16f-f650-496c-afc5-ab9f3af909e7 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:30.466498 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1248/2517] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:04:30 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:04:30.469756 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431fe7e-64f9-4385-9c4b-6d6b4febd9ee admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:30.480265 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431fe7e-64f9-4385-9c4b-6d6b4febd9ee admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:30.485498 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81e13b-c7fa-4748-b728-4b054f1b1ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:30.486142 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81e13b-c7fa-4748-b728-4b054f1b1ddf admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:30.486421 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81e13b-c7fa-4748-b728-4b054f1b1ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:30.486692 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81e13b-c7fa-4748-b728-4b054f1b1ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:30.487415 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81e13b-c7fa-4748-b728-4b054f1b1ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:30.489154 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81e13b-c7fa-4748-b728-4b054f1b1ddf admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:30.500760 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1270/2518] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:04:30.505014 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53e16f-f650-496c-afc5-ab9f3af909e7 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:30.516371 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53e16f-f650-496c-afc5-ab9f3af909e7 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:30.523157 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56a022-4600-4b7c-b10f-c378c2321ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:30.524033 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56a022-4600-4b7c-b10f-c378c2321ce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:30.524316 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56a022-4600-4b7c-b10f-c378c2321ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:30.524593 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56a022-4600-4b7c-b10f-c378c2321ce5 admin admin] PATH_INFO: `/v3/projects/2e5eb27de7cc4a0cb52b0bc4af7d9cb1/users/79dc1b4b7be94f038c22ccd7e8cb6127/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:30.539465 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b56a022-4600-4b7c-b10f-c378c2321ce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e5eb27de7cc4a0cb52b0bc4af7d9cb1, user_id=79dc1b4b7be94f038c22ccd7e8cb6127, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:30.542194 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b56a022-4600-4b7c-b10f-c378c2321ce5 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:30.611565 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1249/2519] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:04:30 2022] PUT /identity/v3/projects/2e5eb27de7cc4a0cb52b0bc4af7d9cb1/users/79dc1b4b7be94f038c22ccd7e8cb6127/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:04:30.615865 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81e13b-c7fa-4748-b728-4b054f1b1ddf admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:30.627262 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81e13b-c7fa-4748-b728-4b054f1b1ddf admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:30.682196 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec162a-ac6e-4330-b4bc-0db8194e5745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:30.682851 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec162a-ac6e-4330-b4bc-0db8194e5745 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:30.683131 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec162a-ac6e-4330-b4bc-0db8194e5745 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:30.683407 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec162a-ac6e-4330-b4bc-0db8194e5745 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:30.684128 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec162a-ac6e-4330-b4bc-0db8194e5745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:30.685749 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec162a-ac6e-4330-b4bc-0db8194e5745 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:30.696325 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1271/2520] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:04:30.700725 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56a022-4600-4b7c-b10f-c378c2321ce5 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:30.710935 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56a022-4600-4b7c-b10f-c378c2321ce5 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:30.715528 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8708f9-14bd-4cba-bc15-e081c00646cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:30.716444 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8708f9-14bd-4cba-bc15-e081c00646cf admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:30.716759 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8708f9-14bd-4cba-bc15-e081c00646cf admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:30.716962 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8708f9-14bd-4cba-bc15-e081c00646cf admin admin] PATH_INFO: `/v3/projects/2e5eb27de7cc4a0cb52b0bc4af7d9cb1/users/79dc1b4b7be94f038c22ccd7e8cb6127/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:30.719009 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8708f9-14bd-4cba-bc15-e081c00646cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e5eb27de7cc4a0cb52b0bc4af7d9cb1, user_id=79dc1b4b7be94f038c22ccd7e8cb6127, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:30.721877 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8708f9-14bd-4cba-bc15-e081c00646cf admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:30.732540 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1250/2521] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:04:30 2022] PUT /identity/v3/projects/2e5eb27de7cc4a0cb52b0bc4af7d9cb1/users/79dc1b4b7be94f038c22ccd7e8cb6127/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:04:30.744109 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fa6b4-083e-47a0-ba75-69a9dbaa9dd2 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:30.744399 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fa6b4-083e-47a0-ba75-69a9dbaa9dd2 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:30.744680 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fa6b4-083e-47a0-ba75-69a9dbaa9dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:30.771195 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-a67fa6b4-083e-47a0-ba75-69a9dbaa9dd2 None None] MFA Rules not processed for user `79dc1b4b7be94f038c22ccd7e8cb6127`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:04:30.772390 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-a67fa6b4-083e-47a0-ba75-69a9dbaa9dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:30.839304 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1272/2522] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:04:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:04:30.849346 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8708f9-14bd-4cba-bc15-e081c00646cf admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:30.851060 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-cd8708f9-14bd-4cba-bc15-e081c00646cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:30.912904 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8708f9-14bd-4cba-bc15-e081c00646cf admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:30.916617 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf363e-2e8e-4b21-af15-0f8bd2d0f51d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:30.917289 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf363e-2e8e-4b21-af15-0f8bd2d0f51d service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:30.917578 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf363e-2e8e-4b21-af15-0f8bd2d0f51d service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:30.917858 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf363e-2e8e-4b21-af15-0f8bd2d0f51d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:30.971807 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf363e-2e8e-4b21-af15-0f8bd2d0f51d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:30.973224 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf363e-2e8e-4b21-af15-0f8bd2d0f51d service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:30.982102 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1251/2523] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:04:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:04:34.018692 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fa6b4-083e-47a0-ba75-69a9dbaa9dd2 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:34.078095 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fa6b4-083e-47a0-ba75-69a9dbaa9dd2 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:34.082617 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84bb1ba-a294-4770-958d-ac9f7958268a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:34.083464 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84bb1ba-a294-4770-958d-ac9f7958268a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:34.089583 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84bb1ba-a294-4770-958d-ac9f7958268a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:34.089583 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84bb1ba-a294-4770-958d-ac9f7958268a admin admin] PATH_INFO: `/v3/users/6d27b96700af4410974bb62c225caf41` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:34.089583 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84bb1ba-a294-4770-958d-ac9f7958268a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d27b96700af4410974bb62c225caf41)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:34.089583 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84bb1ba-a294-4770-958d-ac9f7958268a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:34.263652 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b84bb1ba-a294-4770-958d-ac9f7958268a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d27b96700af4410974bb62c225caf41'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:34.270232 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b84bb1ba-a294-4770-958d-ac9f7958268a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d27b96700af4410974bb62c225caf41'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:34.270899 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b84bb1ba-a294-4770-958d-ac9f7958268a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d27b96700af4410974bb62c225caf41'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:34.272940 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b84bb1ba-a294-4770-958d-ac9f7958268a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d27b96700af4410974bb62c225caf41'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:34.348003 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-b84bb1ba-a294-4770-958d-ac9f7958268a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d27b96700af4410974bb62c225caf41'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:34.366389 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1273/2524] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:04:34 2022] DELETE /identity/v3/users/6d27b96700af4410974bb62c225caf41 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:04:34.371028 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa4fa4-c957-45cf-8a96-a5af956c59c7 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:34.371527 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa4fa4-c957-45cf-8a96-a5af956c59c7 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:34.371626 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa4fa4-c957-45cf-8a96-a5af956c59c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:34.389298 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-09aa4fa4-c957-45cf-8a96-a5af956c59c7 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:04:34.390508 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-09aa4fa4-c957-45cf-8a96-a5af956c59c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:34.447752 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1252/2525] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:04:34.458568 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84bb1ba-a294-4770-958d-ac9f7958268a admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:34.460010 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-b84bb1ba-a294-4770-958d-ac9f7958268a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:34.518396 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84bb1ba-a294-4770-958d-ac9f7958268a admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:34.520350 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd4661-3ffe-4437-ae05-6471e989072b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:34.520988 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd4661-3ffe-4437-ae05-6471e989072b service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:34.521301 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd4661-3ffe-4437-ae05-6471e989072b service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:34.521580 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd4661-3ffe-4437-ae05-6471e989072b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:34.530587 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd4661-3ffe-4437-ae05-6471e989072b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:34.532036 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd4661-3ffe-4437-ae05-6471e989072b service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:34.541418 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1274/2526] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:04:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:04:34.964267 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa4fa4-c957-45cf-8a96-a5af956c59c7 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:34.965827 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-09aa4fa4-c957-45cf-8a96-a5af956c59c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:34.978973 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa4fa4-c957-45cf-8a96-a5af956c59c7 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:34.984622 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee4f55-7699-4c28-a9df-c65aa066d419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:34.985516 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee4f55-7699-4c28-a9df-c65aa066d419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:34.985802 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee4f55-7699-4c28-a9df-c65aa066d419 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:34.986139 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee4f55-7699-4c28-a9df-c65aa066d419 admin admin] PATH_INFO: `/v3/projects/fc318dd66557476c972f7d24d4304b22` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:34.987249 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee4f55-7699-4c28-a9df-c65aa066d419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc318dd66557476c972f7d24d4304b22)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:34.989172 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee4f55-7699-4c28-a9df-c65aa066d419 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:35.123373 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-0eee4f55-7699-4c28-a9df-c65aa066d419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc318dd66557476c972f7d24d4304b22', 'request_id': 'req-0eee4f55-7699-4c28-a9df-c65aa066d419'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:35.129387 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-0eee4f55-7699-4c28-a9df-c65aa066d419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc318dd66557476c972f7d24d4304b22', 'request_id': 'req-0eee4f55-7699-4c28-a9df-c65aa066d419'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:35.134657 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-0eee4f55-7699-4c28-a9df-c65aa066d419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc318dd66557476c972f7d24d4304b22', 'request_id': 'req-0eee4f55-7699-4c28-a9df-c65aa066d419'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:35.241034 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-0eee4f55-7699-4c28-a9df-c65aa066d419 admin admin] The token cache is being invalidate because project fc318dd66557476c972f7d24d4304b22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:04:35.241529 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-0eee4f55-7699-4c28-a9df-c65aa066d419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:35.242389 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-0eee4f55-7699-4c28-a9df-c65aa066d419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:35.244083 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1253/2527] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:04:34 2022] DELETE /identity/v3/projects/fc318dd66557476c972f7d24d4304b22 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:04:35.248189 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd4661-3ffe-4437-ae05-6471e989072b service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:35.257840 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd4661-3ffe-4437-ae05-6471e989072b service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:35.314793 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc381124-e78b-4d87-a55d-774fdaff597f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:35.315689 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc381124-e78b-4d87-a55d-774fdaff597f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:35.315972 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc381124-e78b-4d87-a55d-774fdaff597f admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:35.316246 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc381124-e78b-4d87-a55d-774fdaff597f admin admin] PATH_INFO: `/v3/users/79dc1b4b7be94f038c22ccd7e8cb6127` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:35.317477 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc381124-e78b-4d87-a55d-774fdaff597f admin admin] RBAC: Authorizing `identity:delete_user(user_id=79dc1b4b7be94f038c22ccd7e8cb6127)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:35.319465 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc381124-e78b-4d87-a55d-774fdaff597f admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:35.492718 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-dc381124-e78b-4d87-a55d-774fdaff597f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79dc1b4b7be94f038c22ccd7e8cb6127'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:35.500031 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-dc381124-e78b-4d87-a55d-774fdaff597f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79dc1b4b7be94f038c22ccd7e8cb6127'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:35.500754 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-dc381124-e78b-4d87-a55d-774fdaff597f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79dc1b4b7be94f038c22ccd7e8cb6127'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:35.501411 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-dc381124-e78b-4d87-a55d-774fdaff597f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79dc1b4b7be94f038c22ccd7e8cb6127'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:35.579767 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-dc381124-e78b-4d87-a55d-774fdaff597f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79dc1b4b7be94f038c22ccd7e8cb6127'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:35.597056 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1275/2528] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:04:35 2022] DELETE /identity/v3/users/79dc1b4b7be94f038c22ccd7e8cb6127 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:04:35.981320 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee4f55-7699-4c28-a9df-c65aa066d419 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:35.983076 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-0eee4f55-7699-4c28-a9df-c65aa066d419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:35.996823 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee4f55-7699-4c28-a9df-c65aa066d419 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:36.021337 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc381124-e78b-4d87-a55d-774fdaff597f admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:36.022849 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-dc381124-e78b-4d87-a55d-774fdaff597f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:36.052953 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed870c0b-7f14-445d-a8ad-0cfd34844bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:36.053850 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed870c0b-7f14-445d-a8ad-0cfd34844bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:36.054135 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed870c0b-7f14-445d-a8ad-0cfd34844bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:36.054411 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed870c0b-7f14-445d-a8ad-0cfd34844bb9 admin admin] PATH_INFO: `/v3/projects/2e5eb27de7cc4a0cb52b0bc4af7d9cb1` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:36.055600 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed870c0b-7f14-445d-a8ad-0cfd34844bb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e5eb27de7cc4a0cb52b0bc4af7d9cb1)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:36.057647 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed870c0b-7f14-445d-a8ad-0cfd34844bb9 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:36.095626 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc381124-e78b-4d87-a55d-774fdaff597f admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:36.101297 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfc87c-d584-4973-9fb5-5e474465deba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:36.101961 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfc87c-d584-4973-9fb5-5e474465deba service nova] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:36.102246 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfc87c-d584-4973-9fb5-5e474465deba service nova] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:36.102520 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfc87c-d584-4973-9fb5-5e474465deba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:36.104585 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-1bdfc87c-d584-4973-9fb5-5e474465deba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:36.166429 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfc87c-d584-4973-9fb5-5e474465deba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:36.168112 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfc87c-d584-4973-9fb5-5e474465deba service nova] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:36.178022 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1276/2529] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:04:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:04:36.191849 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ed870c0b-7f14-445d-a8ad-0cfd34844bb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e5eb27de7cc4a0cb52b0bc4af7d9cb1', 'request_id': 'req-ed870c0b-7f14-445d-a8ad-0cfd34844bb9'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:36.198107 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ed870c0b-7f14-445d-a8ad-0cfd34844bb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e5eb27de7cc4a0cb52b0bc4af7d9cb1', 'request_id': 'req-ed870c0b-7f14-445d-a8ad-0cfd34844bb9'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:36.203473 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ed870c0b-7f14-445d-a8ad-0cfd34844bb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e5eb27de7cc4a0cb52b0bc4af7d9cb1', 'request_id': 'req-ed870c0b-7f14-445d-a8ad-0cfd34844bb9'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:36.276133 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ed870c0b-7f14-445d-a8ad-0cfd34844bb9 admin admin] The token cache is being invalidate because project 2e5eb27de7cc4a0cb52b0bc4af7d9cb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:04:36.276325 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ed870c0b-7f14-445d-a8ad-0cfd34844bb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:36.276949 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ed870c0b-7f14-445d-a8ad-0cfd34844bb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:36.278539 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1254/2530] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:04:35 2022] DELETE /identity/v3/projects/2e5eb27de7cc4a0cb52b0bc4af7d9cb1 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:04:36.284857 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9948b3-599a-4997-afa9-76bfb21a6b3d None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:36.285386 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9948b3-599a-4997-afa9-76bfb21a6b3d None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:36.285497 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9948b3-599a-4997-afa9-76bfb21a6b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:36.303962 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-7b9948b3-599a-4997-afa9-76bfb21a6b3d None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:04:36.305227 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-7b9948b3-599a-4997-afa9-76bfb21a6b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:36.364952 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1277/2531] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:04:36.372496 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f13f59-306a-4c47-b538-9556f8ffaa00 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:36.372788 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f13f59-306a-4c47-b538-9556f8ffaa00 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:36.373083 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f13f59-306a-4c47-b538-9556f8ffaa00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:36.390702 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-10f13f59-306a-4c47-b538-9556f8ffaa00 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:04:36.391874 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-10f13f59-306a-4c47-b538-9556f8ffaa00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:36.399606 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1255/2532] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:04:36.403621 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9948b3-599a-4997-afa9-76bfb21a6b3d None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:36.413611 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9948b3-599a-4997-afa9-76bfb21a6b3d None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:36.418201 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9a56f-a941-4ce1-b95c-3a595b195aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:36.418834 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9a56f-a941-4ce1-b95c-3a595b195aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:36.419116 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9a56f-a941-4ce1-b95c-3a595b195aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:36.419394 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9a56f-a941-4ce1-b95c-3a595b195aa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:36.420118 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9a56f-a941-4ce1-b95c-3a595b195aa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:04:36.420424 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9a56f-a941-4ce1-b95c-3a595b195aa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:36.422577 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9a56f-a941-4ce1-b95c-3a595b195aa1 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:36.433626 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1278/2533] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 15:04:36.437598 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f13f59-306a-4c47-b538-9556f8ffaa00 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:36.446445 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f13f59-306a-4c47-b538-9556f8ffaa00 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:36.451024 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9abaae-ffd8-4004-a40b-5971635b5dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:36.451657 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9abaae-ffd8-4004-a40b-5971635b5dbb admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:36.451935 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9abaae-ffd8-4004-a40b-5971635b5dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:36.452232 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9abaae-ffd8-4004-a40b-5971635b5dbb admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:36.453701 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9abaae-ffd8-4004-a40b-5971635b5dbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:36.456858 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9abaae-ffd8-4004-a40b-5971635b5dbb admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:36.573424 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1256/2534] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:04:36 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:04:36.574507 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9a56f-a941-4ce1-b95c-3a595b195aa1 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:36.584841 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9a56f-a941-4ce1-b95c-3a595b195aa1 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:36.638846 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c1684-63cf-4768-99cc-76786baf6da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:36.639509 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c1684-63cf-4768-99cc-76786baf6da7 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:36.640283 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c1684-63cf-4768-99cc-76786baf6da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:36.640568 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c1684-63cf-4768-99cc-76786baf6da7 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:36.641328 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c1684-63cf-4768-99cc-76786baf6da7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:36.643229 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c1684-63cf-4768-99cc-76786baf6da7 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:36.751375 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1279/2535] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:04:36 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:04:36.755360 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9abaae-ffd8-4004-a40b-5971635b5dbb admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:36.765882 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9abaae-ffd8-4004-a40b-5971635b5dbb admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:36.770449 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad746c62-038d-42cf-a55a-ca41acb1e116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:36.771094 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad746c62-038d-42cf-a55a-ca41acb1e116 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:36.771377 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad746c62-038d-42cf-a55a-ca41acb1e116 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:36.771653 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad746c62-038d-42cf-a55a-ca41acb1e116 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:36.772382 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad746c62-038d-42cf-a55a-ca41acb1e116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:36.774037 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad746c62-038d-42cf-a55a-ca41acb1e116 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:36.784791 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1257/2536] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:04:36.788485 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c1684-63cf-4768-99cc-76786baf6da7 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:36.798285 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c1684-63cf-4768-99cc-76786baf6da7 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:36.802930 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f6b3a-2f37-4292-b1a4-81c17890f41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:36.803592 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f6b3a-2f37-4292-b1a4-81c17890f41d admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:36.803876 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f6b3a-2f37-4292-b1a4-81c17890f41d admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:36.804151 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f6b3a-2f37-4292-b1a4-81c17890f41d admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:36.804890 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f6b3a-2f37-4292-b1a4-81c17890f41d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:36.806604 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f6b3a-2f37-4292-b1a4-81c17890f41d admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:36.818831 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1280/2537] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:04:36.828575 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad746c62-038d-42cf-a55a-ca41acb1e116 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:36.842010 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad746c62-038d-42cf-a55a-ca41acb1e116 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:36.846752 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a040e-6b66-4938-9924-ff2705f8be20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:36.847633 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a040e-6b66-4938-9924-ff2705f8be20 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:36.847932 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a040e-6b66-4938-9924-ff2705f8be20 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:36.848191 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a040e-6b66-4938-9924-ff2705f8be20 admin admin] PATH_INFO: `/v3/projects/c9a620e7cb7b4104b0ddd9b5ba0489dd/users/67fc1466c99f4c6fa8f6b58d161cadc5/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:36.862642 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a040e-6b66-4938-9924-ff2705f8be20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9a620e7cb7b4104b0ddd9b5ba0489dd, user_id=67fc1466c99f4c6fa8f6b58d161cadc5, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:36.865312 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a040e-6b66-4938-9924-ff2705f8be20 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:36.942286 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1258/2538] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:04:36 2022] PUT /identity/v3/projects/c9a620e7cb7b4104b0ddd9b5ba0489dd/users/67fc1466c99f4c6fa8f6b58d161cadc5/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:04:36.952368 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820c74e-3f2c-4918-8053-58acdb8eab16 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:36.953211 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820c74e-3f2c-4918-8053-58acdb8eab16 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:36.953495 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820c74e-3f2c-4918-8053-58acdb8eab16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:36.979163 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-1820c74e-3f2c-4918-8053-58acdb8eab16 None None] MFA Rules not processed for user `67fc1466c99f4c6fa8f6b58d161cadc5`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:04:36.980349 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-1820c74e-3f2c-4918-8053-58acdb8eab16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:37.040466 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1281/2539] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:04:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:04:37.044821 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a040e-6b66-4938-9924-ff2705f8be20 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:37.104008 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a040e-6b66-4938-9924-ff2705f8be20 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:37.109323 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd6c7b-fc18-4170-b072-2ee97605144f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:37.110203 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd6c7b-fc18-4170-b072-2ee97605144f admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:37.110507 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd6c7b-fc18-4170-b072-2ee97605144f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:37.110782 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd6c7b-fc18-4170-b072-2ee97605144f admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:37.111524 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd6c7b-fc18-4170-b072-2ee97605144f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:37.113483 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd6c7b-fc18-4170-b072-2ee97605144f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:37.217045 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1259/2540] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:04:37 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:04:37.221135 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820c74e-3f2c-4918-8053-58acdb8eab16 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:37.232253 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820c74e-3f2c-4918-8053-58acdb8eab16 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:37.286153 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cf9f5-681c-4af5-8ffb-e99dd5e68197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:37.286801 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cf9f5-681c-4af5-8ffb-e99dd5e68197 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:37.287084 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cf9f5-681c-4af5-8ffb-e99dd5e68197 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:37.287359 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cf9f5-681c-4af5-8ffb-e99dd5e68197 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:37.288054 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515cf9f5-681c-4af5-8ffb-e99dd5e68197 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:37.290038 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515cf9f5-681c-4af5-8ffb-e99dd5e68197 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:37.385499 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1282/2541] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:04:37 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:04:37.389564 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd6c7b-fc18-4170-b072-2ee97605144f admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:37.399554 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd6c7b-fc18-4170-b072-2ee97605144f admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:37.404112 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426dde8-6467-49c2-a671-7f1962f0d6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:37.404757 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426dde8-6467-49c2-a671-7f1962f0d6ba admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:37.405034 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426dde8-6467-49c2-a671-7f1962f0d6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:37.405333 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426dde8-6467-49c2-a671-7f1962f0d6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:37.406055 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426dde8-6467-49c2-a671-7f1962f0d6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:37.407668 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426dde8-6467-49c2-a671-7f1962f0d6ba admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:37.418481 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1260/2542] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:04:37.422706 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cf9f5-681c-4af5-8ffb-e99dd5e68197 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:37.432441 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cf9f5-681c-4af5-8ffb-e99dd5e68197 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:37.437695 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00adee-cb86-4f6e-94e4-b93cf488721e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:37.438337 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00adee-cb86-4f6e-94e4-b93cf488721e admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:37.438621 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00adee-cb86-4f6e-94e4-b93cf488721e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:37.438893 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00adee-cb86-4f6e-94e4-b93cf488721e admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:37.439620 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00adee-cb86-4f6e-94e4-b93cf488721e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:37.441254 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00adee-cb86-4f6e-94e4-b93cf488721e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:37.450808 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1283/2543] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:04:37.454690 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426dde8-6467-49c2-a671-7f1962f0d6ba admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:37.464250 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426dde8-6467-49c2-a671-7f1962f0d6ba admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:37.468821 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44222d8a-4e54-49f6-b779-4b70e852b48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:37.469714 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44222d8a-4e54-49f6-b779-4b70e852b48c admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:37.469999 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44222d8a-4e54-49f6-b779-4b70e852b48c admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:37.470276 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44222d8a-4e54-49f6-b779-4b70e852b48c admin admin] PATH_INFO: `/v3/projects/890fd8f612f84eddae1d8fb064122783/users/19fc6b42783a4075b4767d7b606266ee/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:37.484754 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44222d8a-4e54-49f6-b779-4b70e852b48c admin admin] RBAC: Authorizing `identity:create_grant(project_id=890fd8f612f84eddae1d8fb064122783, user_id=19fc6b42783a4075b4767d7b606266ee, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:37.487406 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44222d8a-4e54-49f6-b779-4b70e852b48c admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:37.563291 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1261/2544] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:04:37 2022] PUT /identity/v3/projects/890fd8f612f84eddae1d8fb064122783/users/19fc6b42783a4075b4767d7b606266ee/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:04:37.574221 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360aabaa-c7b0-432b-a84c-48ffc9db3080 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:37.574509 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360aabaa-c7b0-432b-a84c-48ffc9db3080 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:37.574785 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360aabaa-c7b0-432b-a84c-48ffc9db3080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:37.600977 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-360aabaa-c7b0-432b-a84c-48ffc9db3080 None None] MFA Rules not processed for user `19fc6b42783a4075b4767d7b606266ee`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:04:37.602214 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-360aabaa-c7b0-432b-a84c-48ffc9db3080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:37.663856 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1284/2545] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:04:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:04:37.668298 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44222d8a-4e54-49f6-b779-4b70e852b48c admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:37.726914 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44222d8a-4e54-49f6-b779-4b70e852b48c admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:37.731787 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f2945-2c35-4f44-9cca-53d45b08dd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:37.732430 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f2945-2c35-4f44-9cca-53d45b08dd08 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:37.732710 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f2945-2c35-4f44-9cca-53d45b08dd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:37.732980 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f2945-2c35-4f44-9cca-53d45b08dd08 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:37.734370 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f2945-2c35-4f44-9cca-53d45b08dd08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:37.736234 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f2945-2c35-4f44-9cca-53d45b08dd08 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:37.832599 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1262/2546] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:04:37 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:04:37.836680 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360aabaa-c7b0-432b-a84c-48ffc9db3080 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:37.847990 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360aabaa-c7b0-432b-a84c-48ffc9db3080 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:37.901826 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed980245-f2fe-4b24-ab7e-62e8038e9fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:37.902608 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed980245-f2fe-4b24-ab7e-62e8038e9fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:37.902892 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed980245-f2fe-4b24-ab7e-62e8038e9fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:37.903165 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed980245-f2fe-4b24-ab7e-62e8038e9fe1 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:37.903869 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed980245-f2fe-4b24-ab7e-62e8038e9fe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:37.906312 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed980245-f2fe-4b24-ab7e-62e8038e9fe1 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:38.017632 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1285/2547] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:04:37 2022] POST /identity/v3/users => generated 295 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:04:38.021302 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f2945-2c35-4f44-9cca-53d45b08dd08 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:38.031941 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f2945-2c35-4f44-9cca-53d45b08dd08 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:38.036961 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ab72d-20a8-4463-bcca-aa73b1ae88dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:38.037646 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ab72d-20a8-4463-bcca-aa73b1ae88dd admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:38.037928 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ab72d-20a8-4463-bcca-aa73b1ae88dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:38.038200 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ab72d-20a8-4463-bcca-aa73b1ae88dd admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:38.038934 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ab72d-20a8-4463-bcca-aa73b1ae88dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:38.040562 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ab72d-20a8-4463-bcca-aa73b1ae88dd admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:38.050838 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1263/2548] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:04:38.054902 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed980245-f2fe-4b24-ab7e-62e8038e9fe1 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:38.064568 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed980245-f2fe-4b24-ab7e-62e8038e9fe1 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:38.069200 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e2337-7e55-4985-87b3-9a65b7f97012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:38.070064 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e2337-7e55-4985-87b3-9a65b7f97012 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:38.070345 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e2337-7e55-4985-87b3-9a65b7f97012 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:38.070621 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e2337-7e55-4985-87b3-9a65b7f97012 admin admin] PATH_INFO: `/v3/projects/8a903b583ddb45ae82c1e051dc7df0ce/users/0a78cc39cb7a48d58e49e052abde91ec/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:38.085401 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e2337-7e55-4985-87b3-9a65b7f97012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a903b583ddb45ae82c1e051dc7df0ce, user_id=0a78cc39cb7a48d58e49e052abde91ec, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:38.088105 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e2337-7e55-4985-87b3-9a65b7f97012 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:38.216239 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1286/2549] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:04:38 2022] PUT /identity/v3/projects/8a903b583ddb45ae82c1e051dc7df0ce/users/0a78cc39cb7a48d58e49e052abde91ec/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:04:38.220783 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ab72d-20a8-4463-bcca-aa73b1ae88dd admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:38.230885 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ab72d-20a8-4463-bcca-aa73b1ae88dd admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:38.284437 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7694e-1c9b-4b9b-9ad5-1bfa1d2b6bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:38.285015 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7694e-1c9b-4b9b-9ad5-1bfa1d2b6bbd admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:38.285322 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7694e-1c9b-4b9b-9ad5-1bfa1d2b6bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:38.285594 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7694e-1c9b-4b9b-9ad5-1bfa1d2b6bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:38.286313 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7694e-1c9b-4b9b-9ad5-1bfa1d2b6bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:38.287938 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7694e-1c9b-4b9b-9ad5-1bfa1d2b6bbd admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:38.297240 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1264/2550] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:04:38.301245 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e2337-7e55-4985-87b3-9a65b7f97012 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:38.311481 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e2337-7e55-4985-87b3-9a65b7f97012 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:38.316558 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c71e0-f27d-4872-a1ea-06628f95b138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:38.317454 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c71e0-f27d-4872-a1ea-06628f95b138 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:38.317741 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c71e0-f27d-4872-a1ea-06628f95b138 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:38.318018 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c71e0-f27d-4872-a1ea-06628f95b138 admin admin] PATH_INFO: `/v3/projects/8a903b583ddb45ae82c1e051dc7df0ce/users/0a78cc39cb7a48d58e49e052abde91ec/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:38.319986 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c71e0-f27d-4872-a1ea-06628f95b138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a903b583ddb45ae82c1e051dc7df0ce, user_id=0a78cc39cb7a48d58e49e052abde91ec, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:38.322731 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c71e0-f27d-4872-a1ea-06628f95b138 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:38.333343 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1287/2551] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:04:38 2022] PUT /identity/v3/projects/8a903b583ddb45ae82c1e051dc7df0ce/users/0a78cc39cb7a48d58e49e052abde91ec/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:04:38.342998 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a21727-74ad-47e4-9740-c354a355acd1 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:38.343360 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a21727-74ad-47e4-9740-c354a355acd1 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:38.343644 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a21727-74ad-47e4-9740-c354a355acd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:38.369704 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-d0a21727-74ad-47e4-9740-c354a355acd1 None None] MFA Rules not processed for user `0a78cc39cb7a48d58e49e052abde91ec`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:04:38.370889 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-d0a21727-74ad-47e4-9740-c354a355acd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:38.438832 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1265/2552] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:04:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:04:38.453237 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c71e0-f27d-4872-a1ea-06628f95b138 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:38.455110 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-253c71e0-f27d-4872-a1ea-06628f95b138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:38.511777 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c71e0-f27d-4872-a1ea-06628f95b138 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:38.516173 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2e021-0ca3-42d2-a3bc-8d9b22a64254 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:38.516813 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2e021-0ca3-42d2-a3bc-8d9b22a64254 service cinder] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:38.517127 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2e021-0ca3-42d2-a3bc-8d9b22a64254 service cinder] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:38.517406 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2e021-0ca3-42d2-a3bc-8d9b22a64254 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:38.572374 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2e021-0ca3-42d2-a3bc-8d9b22a64254 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:38.573875 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2e021-0ca3-42d2-a3bc-8d9b22a64254 service cinder] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:38.583136 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1288/2553] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:04:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:04:40.622286 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a21727-74ad-47e4-9740-c354a355acd1 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:40.623665 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-d0a21727-74ad-47e4-9740-c354a355acd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:40.635126 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a21727-74ad-47e4-9740-c354a355acd1 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:40.638606 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6b247-ac30-4fe4-b5c7-65170d1d2527 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:40.639236 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6b247-ac30-4fe4-b5c7-65170d1d2527 service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:40.639515 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6b247-ac30-4fe4-b5c7-65170d1d2527 service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:40.639787 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6b247-ac30-4fe4-b5c7-65170d1d2527 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:40.692993 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6b247-ac30-4fe4-b5c7-65170d1d2527 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:40.694458 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6b247-ac30-4fe4-b5c7-65170d1d2527 service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:40.703338 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1266/2554] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:04:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:04:42.090481 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2e021-0ca3-42d2-a3bc-8d9b22a64254 service cinder] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:42.102204 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2e021-0ca3-42d2-a3bc-8d9b22a64254 service cinder] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:42.108422 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87217ad-3958-420e-aedf-f3e94798f9c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:42.109090 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87217ad-3958-420e-aedf-f3e94798f9c9 service cinder] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:42.109381 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87217ad-3958-420e-aedf-f3e94798f9c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:42.110891 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87217ad-3958-420e-aedf-f3e94798f9c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:42.121131 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87217ad-3958-420e-aedf-f3e94798f9c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:42.123048 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87217ad-3958-420e-aedf-f3e94798f9c9 service cinder] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:42.132880 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1289/2555] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:04:42 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:04:45.562076 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6b247-ac30-4fe4-b5c7-65170d1d2527 service cinder] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:45.563418 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-fdc6b247-ac30-4fe4-b5c7-65170d1d2527 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:45.636070 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6b247-ac30-4fe4-b5c7-65170d1d2527 service cinder] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:45.641890 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130c99d-72f4-4da7-8e33-2364533fc502 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:45.645960 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130c99d-72f4-4da7-8e33-2364533fc502 service nova] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:45.645960 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130c99d-72f4-4da7-8e33-2364533fc502 service nova] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:45.645960 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130c99d-72f4-4da7-8e33-2364533fc502 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:45.645960 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-6130c99d-72f4-4da7-8e33-2364533fc502 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:45.702642 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130c99d-72f4-4da7-8e33-2364533fc502 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:45.704366 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130c99d-72f4-4da7-8e33-2364533fc502 service nova] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:45.713280 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1267/2556] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:04:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:04:46.955162 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87217ad-3958-420e-aedf-f3e94798f9c9 service cinder] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:47.015273 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87217ad-3958-420e-aedf-f3e94798f9c9 service cinder] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:47.019839 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496865f1-98ad-4c7a-bc0f-b861f734f4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:47.020691 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496865f1-98ad-4c7a-bc0f-b861f734f4bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:47.020964 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496865f1-98ad-4c7a-bc0f-b861f734f4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:47.021267 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496865f1-98ad-4c7a-bc0f-b861f734f4bd admin admin] PATH_INFO: `/v3/users/67fc1466c99f4c6fa8f6b58d161cadc5` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:47.022434 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496865f1-98ad-4c7a-bc0f-b861f734f4bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=67fc1466c99f4c6fa8f6b58d161cadc5)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:47.024366 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496865f1-98ad-4c7a-bc0f-b861f734f4bd admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:47.206038 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-496865f1-98ad-4c7a-bc0f-b861f734f4bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67fc1466c99f4c6fa8f6b58d161cadc5'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:47.212558 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-496865f1-98ad-4c7a-bc0f-b861f734f4bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67fc1466c99f4c6fa8f6b58d161cadc5'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:47.213238 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-496865f1-98ad-4c7a-bc0f-b861f734f4bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67fc1466c99f4c6fa8f6b58d161cadc5'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:47.213842 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-496865f1-98ad-4c7a-bc0f-b861f734f4bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67fc1466c99f4c6fa8f6b58d161cadc5'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:47.304758 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-496865f1-98ad-4c7a-bc0f-b861f734f4bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67fc1466c99f4c6fa8f6b58d161cadc5'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:47.322204 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1290/2557] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:04:46 2022] DELETE /identity/v3/users/67fc1466c99f4c6fa8f6b58d161cadc5 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:04:47.326863 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181dc2b-0d67-43ad-a208-ebe293679ffb None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:47.327332 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181dc2b-0d67-43ad-a208-ebe293679ffb None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:47.327436 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181dc2b-0d67-43ad-a208-ebe293679ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:47.344640 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-e181dc2b-0d67-43ad-a208-ebe293679ffb None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:04:47.345850 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-e181dc2b-0d67-43ad-a208-ebe293679ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:47.400951 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1268/2558] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:04:47.410925 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496865f1-98ad-4c7a-bc0f-b861f734f4bd admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:47.412461 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-496865f1-98ad-4c7a-bc0f-b861f734f4bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:47.467617 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496865f1-98ad-4c7a-bc0f-b861f734f4bd admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:47.471219 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279387d6-fa9a-43fe-b550-dacd45edb9ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:47.472387 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279387d6-fa9a-43fe-b550-dacd45edb9ac service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:47.472673 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279387d6-fa9a-43fe-b550-dacd45edb9ac service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:47.472948 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279387d6-fa9a-43fe-b550-dacd45edb9ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:47.482083 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279387d6-fa9a-43fe-b550-dacd45edb9ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:47.483513 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279387d6-fa9a-43fe-b550-dacd45edb9ac service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:47.493662 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1291/2559] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:04:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:04:47.906704 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181dc2b-0d67-43ad-a208-ebe293679ffb None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:47.908348 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-e181dc2b-0d67-43ad-a208-ebe293679ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:47.921618 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181dc2b-0d67-43ad-a208-ebe293679ffb None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:47.927430 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba84337-b395-4e39-bd19-ce1cd05e8361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:47.934710 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba84337-b395-4e39-bd19-ce1cd05e8361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:47.939287 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba84337-b395-4e39-bd19-ce1cd05e8361 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:47.939287 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba84337-b395-4e39-bd19-ce1cd05e8361 admin admin] PATH_INFO: `/v3/projects/c9a620e7cb7b4104b0ddd9b5ba0489dd` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:47.939287 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba84337-b395-4e39-bd19-ce1cd05e8361 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9a620e7cb7b4104b0ddd9b5ba0489dd)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:47.939287 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba84337-b395-4e39-bd19-ce1cd05e8361 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:48.043862 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-2ba84337-b395-4e39-bd19-ce1cd05e8361 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9a620e7cb7b4104b0ddd9b5ba0489dd', 'request_id': 'req-2ba84337-b395-4e39-bd19-ce1cd05e8361'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:48.049836 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-2ba84337-b395-4e39-bd19-ce1cd05e8361 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9a620e7cb7b4104b0ddd9b5ba0489dd', 'request_id': 'req-2ba84337-b395-4e39-bd19-ce1cd05e8361'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:48.055096 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-2ba84337-b395-4e39-bd19-ce1cd05e8361 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9a620e7cb7b4104b0ddd9b5ba0489dd', 'request_id': 'req-2ba84337-b395-4e39-bd19-ce1cd05e8361'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:48.155987 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-2ba84337-b395-4e39-bd19-ce1cd05e8361 admin admin] The token cache is being invalidate because project c9a620e7cb7b4104b0ddd9b5ba0489dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:04:48.156278 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-2ba84337-b395-4e39-bd19-ce1cd05e8361 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:48.156946 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-2ba84337-b395-4e39-bd19-ce1cd05e8361 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:48.158602 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1269/2560] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:04:47 2022] DELETE /identity/v3/projects/c9a620e7cb7b4104b0ddd9b5ba0489dd => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:04:48.162724 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279387d6-fa9a-43fe-b550-dacd45edb9ac service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:48.172348 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279387d6-fa9a-43fe-b550-dacd45edb9ac service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:48.226291 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0de44-51ec-4459-b52b-fe6137bfb012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:48.227147 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0de44-51ec-4459-b52b-fe6137bfb012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:48.227431 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0de44-51ec-4459-b52b-fe6137bfb012 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:48.227709 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0de44-51ec-4459-b52b-fe6137bfb012 admin admin] PATH_INFO: `/v3/users/19fc6b42783a4075b4767d7b606266ee` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:48.229167 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff0de44-51ec-4459-b52b-fe6137bfb012 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19fc6b42783a4075b4767d7b606266ee)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:48.231091 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff0de44-51ec-4459-b52b-fe6137bfb012 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:48.394087 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-1ff0de44-51ec-4459-b52b-fe6137bfb012 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19fc6b42783a4075b4767d7b606266ee'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:48.400758 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-1ff0de44-51ec-4459-b52b-fe6137bfb012 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19fc6b42783a4075b4767d7b606266ee'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:48.401487 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-1ff0de44-51ec-4459-b52b-fe6137bfb012 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19fc6b42783a4075b4767d7b606266ee'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:48.402113 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-1ff0de44-51ec-4459-b52b-fe6137bfb012 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19fc6b42783a4075b4767d7b606266ee'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:48.471061 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-1ff0de44-51ec-4459-b52b-fe6137bfb012 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19fc6b42783a4075b4767d7b606266ee'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:48.491021 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1292/2561] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:04:48 2022] DELETE /identity/v3/users/19fc6b42783a4075b4767d7b606266ee => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:04:48.926340 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba84337-b395-4e39-bd19-ce1cd05e8361 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:48.927833 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-2ba84337-b395-4e39-bd19-ce1cd05e8361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:48.940552 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba84337-b395-4e39-bd19-ce1cd05e8361 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:48.994017 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59d6b0-80bf-471e-8d8e-df6c1d721e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:48.994907 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59d6b0-80bf-471e-8d8e-df6c1d721e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:48.995191 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59d6b0-80bf-471e-8d8e-df6c1d721e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:48.995472 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59d6b0-80bf-471e-8d8e-df6c1d721e34 admin admin] PATH_INFO: `/v3/projects/890fd8f612f84eddae1d8fb064122783` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:48.996650 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e59d6b0-80bf-471e-8d8e-df6c1d721e34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=890fd8f612f84eddae1d8fb064122783)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:48.998630 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e59d6b0-80bf-471e-8d8e-df6c1d721e34 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:49.125316 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4e59d6b0-80bf-471e-8d8e-df6c1d721e34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '890fd8f612f84eddae1d8fb064122783', 'request_id': 'req-4e59d6b0-80bf-471e-8d8e-df6c1d721e34'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:49.131510 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4e59d6b0-80bf-471e-8d8e-df6c1d721e34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '890fd8f612f84eddae1d8fb064122783', 'request_id': 'req-4e59d6b0-80bf-471e-8d8e-df6c1d721e34'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:49.136929 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4e59d6b0-80bf-471e-8d8e-df6c1d721e34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '890fd8f612f84eddae1d8fb064122783', 'request_id': 'req-4e59d6b0-80bf-471e-8d8e-df6c1d721e34'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:49.221457 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4e59d6b0-80bf-471e-8d8e-df6c1d721e34 admin admin] The token cache is being invalidate because project 890fd8f612f84eddae1d8fb064122783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:04:49.222422 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4e59d6b0-80bf-471e-8d8e-df6c1d721e34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:49.223027 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4e59d6b0-80bf-471e-8d8e-df6c1d721e34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:49.224686 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1270/2562] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:04:48 2022] DELETE /identity/v3/projects/890fd8f612f84eddae1d8fb064122783 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:04:49.230388 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0de44-51ec-4459-b52b-fe6137bfb012 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:49.231791 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-1ff0de44-51ec-4459-b52b-fe6137bfb012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:49.244264 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0de44-51ec-4459-b52b-fe6137bfb012 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:49.298433 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d11d22-0a56-49dc-9be4-901f5f73c8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:49.299288 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d11d22-0a56-49dc-9be4-901f5f73c8e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:49.299574 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d11d22-0a56-49dc-9be4-901f5f73c8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:49.299886 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d11d22-0a56-49dc-9be4-901f5f73c8e6 admin admin] PATH_INFO: `/v3/users/0a78cc39cb7a48d58e49e052abde91ec` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:49.301113 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d11d22-0a56-49dc-9be4-901f5f73c8e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a78cc39cb7a48d58e49e052abde91ec)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:49.303007 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d11d22-0a56-49dc-9be4-901f5f73c8e6 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:49.469416 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-68d11d22-0a56-49dc-9be4-901f5f73c8e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a78cc39cb7a48d58e49e052abde91ec'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:49.476611 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-68d11d22-0a56-49dc-9be4-901f5f73c8e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a78cc39cb7a48d58e49e052abde91ec'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:49.477366 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-68d11d22-0a56-49dc-9be4-901f5f73c8e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a78cc39cb7a48d58e49e052abde91ec'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:49.477979 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-68d11d22-0a56-49dc-9be4-901f5f73c8e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a78cc39cb7a48d58e49e052abde91ec'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:49.547497 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-68d11d22-0a56-49dc-9be4-901f5f73c8e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a78cc39cb7a48d58e49e052abde91ec'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:49.564889 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1293/2563] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:04:49 2022] DELETE /identity/v3/users/0a78cc39cb7a48d58e49e052abde91ec => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:04:49.948754 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59d6b0-80bf-471e-8d8e-df6c1d721e34 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:49.950200 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-4e59d6b0-80bf-471e-8d8e-df6c1d721e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:49.962852 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59d6b0-80bf-471e-8d8e-df6c1d721e34 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:50.017714 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c71673-e99c-4c92-b8c8-7133b16c7f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:50.018514 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c71673-e99c-4c92-b8c8-7133b16c7f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:50.019313 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c71673-e99c-4c92-b8c8-7133b16c7f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:50.019588 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c71673-e99c-4c92-b8c8-7133b16c7f2f admin admin] PATH_INFO: `/v3/projects/8a903b583ddb45ae82c1e051dc7df0ce` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:50.020772 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c71673-e99c-4c92-b8c8-7133b16c7f2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a903b583ddb45ae82c1e051dc7df0ce)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:50.022702 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c71673-e99c-4c92-b8c8-7133b16c7f2f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:50.234333 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-51c71673-e99c-4c92-b8c8-7133b16c7f2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a903b583ddb45ae82c1e051dc7df0ce', 'request_id': 'req-51c71673-e99c-4c92-b8c8-7133b16c7f2f'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:50.240348 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-51c71673-e99c-4c92-b8c8-7133b16c7f2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a903b583ddb45ae82c1e051dc7df0ce', 'request_id': 'req-51c71673-e99c-4c92-b8c8-7133b16c7f2f'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:50.245668 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-51c71673-e99c-4c92-b8c8-7133b16c7f2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a903b583ddb45ae82c1e051dc7df0ce', 'request_id': 'req-51c71673-e99c-4c92-b8c8-7133b16c7f2f'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:50.336090 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-51c71673-e99c-4c92-b8c8-7133b16c7f2f admin admin] The token cache is being invalidate because project 8a903b583ddb45ae82c1e051dc7df0ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:04:50.336377 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-51c71673-e99c-4c92-b8c8-7133b16c7f2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:50.336996 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-51c71673-e99c-4c92-b8c8-7133b16c7f2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:50.339882 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1271/2564] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:04:49 2022] DELETE /identity/v3/projects/8a903b583ddb45ae82c1e051dc7df0ce => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:04:50.344131 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6db707-4803-479b-b4f5-7fa9f9f9f717 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:50.344602 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6db707-4803-479b-b4f5-7fa9f9f9f717 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:50.344693 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6db707-4803-479b-b4f5-7fa9f9f9f717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:50.362036 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-db6db707-4803-479b-b4f5-7fa9f9f9f717 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:04:50.363283 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-db6db707-4803-479b-b4f5-7fa9f9f9f717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:50.419431 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1294/2565] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:04:50.427118 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3f351-3a97-4ac0-bcd7-775c1f237d5d None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:50.427423 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3f351-3a97-4ac0-bcd7-775c1f237d5d None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:50.427703 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3f351-3a97-4ac0-bcd7-775c1f237d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:50.446249 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-33a3f351-3a97-4ac0-bcd7-775c1f237d5d None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:04:50.447445 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-33a3f351-3a97-4ac0-bcd7-775c1f237d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:50.455321 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1272/2566] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:04:50.459896 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6db707-4803-479b-b4f5-7fa9f9f9f717 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:50.469264 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6db707-4803-479b-b4f5-7fa9f9f9f717 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:50.473993 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c2b6e-db74-4fb5-b574-31c5d68a554d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:50.474649 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c2b6e-db74-4fb5-b574-31c5d68a554d admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:50.474933 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c2b6e-db74-4fb5-b574-31c5d68a554d admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:50.475383 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c2b6e-db74-4fb5-b574-31c5d68a554d admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:50.476187 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c2b6e-db74-4fb5-b574-31c5d68a554d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:04:50.476500 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c2b6e-db74-4fb5-b574-31c5d68a554d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:50.478225 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c2b6e-db74-4fb5-b574-31c5d68a554d admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:50.491195 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1295/2567] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:04:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 15:04:50.495555 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3f351-3a97-4ac0-bcd7-775c1f237d5d None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:50.505212 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3f351-3a97-4ac0-bcd7-775c1f237d5d None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:50.509942 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec680bd-c0e1-40c9-94ce-d479457e1953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:50.510596 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec680bd-c0e1-40c9-94ce-d479457e1953 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:50.510876 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec680bd-c0e1-40c9-94ce-d479457e1953 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:50.511151 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec680bd-c0e1-40c9-94ce-d479457e1953 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:50.511850 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec680bd-c0e1-40c9-94ce-d479457e1953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:50.513802 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec680bd-c0e1-40c9-94ce-d479457e1953 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:50.635101 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1273/2568] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:04:50 2022] POST /identity/v3/projects => generated 371 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:04:50.639347 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c2b6e-db74-4fb5-b574-31c5d68a554d admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:50.649599 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c2b6e-db74-4fb5-b574-31c5d68a554d admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:50.704435 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c8876-59d7-43f2-b102-69bdefaa82ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:50.705108 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c8876-59d7-43f2-b102-69bdefaa82ba admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:50.705394 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c8876-59d7-43f2-b102-69bdefaa82ba admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:50.705668 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c8876-59d7-43f2-b102-69bdefaa82ba admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:50.706369 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c8876-59d7-43f2-b102-69bdefaa82ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:50.708265 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c8876-59d7-43f2-b102-69bdefaa82ba admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:50.825873 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1296/2569] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:04:50 2022] POST /identity/v3/users => generated 286 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:04:50.831409 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec680bd-c0e1-40c9-94ce-d479457e1953 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:50.845839 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec680bd-c0e1-40c9-94ce-d479457e1953 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:50.851902 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ef548-4b20-4949-8d1a-10d45a536730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:50.855270 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ef548-4b20-4949-8d1a-10d45a536730 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:50.855270 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ef548-4b20-4949-8d1a-10d45a536730 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:50.855270 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ef548-4b20-4949-8d1a-10d45a536730 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:50.855270 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ef548-4b20-4949-8d1a-10d45a536730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:50.856151 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ef548-4b20-4949-8d1a-10d45a536730 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:50.871316 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1274/2570] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:04:50.877003 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c8876-59d7-43f2-b102-69bdefaa82ba admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:50.894451 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c8876-59d7-43f2-b102-69bdefaa82ba admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:50.894451 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739f0b8-3fd0-4735-9d6f-efffc5bc4917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:50.894969 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739f0b8-3fd0-4735-9d6f-efffc5bc4917 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:50.895254 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739f0b8-3fd0-4735-9d6f-efffc5bc4917 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:50.895534 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739f0b8-3fd0-4735-9d6f-efffc5bc4917 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:50.896270 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739f0b8-3fd0-4735-9d6f-efffc5bc4917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:50.897979 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739f0b8-3fd0-4735-9d6f-efffc5bc4917 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:50.907826 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1297/2571] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:04:50.911835 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ef548-4b20-4949-8d1a-10d45a536730 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:50.921537 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ef548-4b20-4949-8d1a-10d45a536730 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:50.926670 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586aecc3-bef3-4253-bec1-6887bd421846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:50.927540 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586aecc3-bef3-4253-bec1-6887bd421846 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:50.927825 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586aecc3-bef3-4253-bec1-6887bd421846 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:50.928101 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586aecc3-bef3-4253-bec1-6887bd421846 admin admin] PATH_INFO: `/v3/projects/0c48e496a63e4d67b6c59e1c9c27297b/users/7cdbaf30d32b46aa92061d2c0c2074de/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:50.942059 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586aecc3-bef3-4253-bec1-6887bd421846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c48e496a63e4d67b6c59e1c9c27297b, user_id=7cdbaf30d32b46aa92061d2c0c2074de, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:50.946224 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586aecc3-bef3-4253-bec1-6887bd421846 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:51.026965 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1275/2572] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:04:50 2022] PUT /identity/v3/projects/0c48e496a63e4d67b6c59e1c9c27297b/users/7cdbaf30d32b46aa92061d2c0c2074de/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:04:51.087672 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f1b2e-a0b9-4e6a-ab6e-b21cc907af28 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:51.087958 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f1b2e-a0b9-4e6a-ab6e-b21cc907af28 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:51.088234 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f1b2e-a0b9-4e6a-ab6e-b21cc907af28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:51.117205 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-1d6f1b2e-a0b9-4e6a-ab6e-b21cc907af28 None None] MFA Rules not processed for user `7cdbaf30d32b46aa92061d2c0c2074de`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:04:51.118471 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-1d6f1b2e-a0b9-4e6a-ab6e-b21cc907af28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:51.195156 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1298/2573] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:04:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:04:51.204643 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586aecc3-bef3-4253-bec1-6887bd421846 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:51.206389 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-586aecc3-bef3-4253-bec1-6887bd421846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:51.262979 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586aecc3-bef3-4253-bec1-6887bd421846 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:51.266735 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c0178-42c0-44e5-a945-5c2ece3dff26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:51.267371 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c0178-42c0-44e5-a945-5c2ece3dff26 service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:51.267650 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c0178-42c0-44e5-a945-5c2ece3dff26 service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:51.267924 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c0178-42c0-44e5-a945-5c2ece3dff26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:51.276011 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c0178-42c0-44e5-a945-5c2ece3dff26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:51.277488 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c0178-42c0-44e5-a945-5c2ece3dff26 service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:51.286680 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1276/2574] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:04:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 15:04:51.311413 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f1b2e-a0b9-4e6a-ab6e-b21cc907af28 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:51.379496 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f1b2e-a0b9-4e6a-ab6e-b21cc907af28 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:51.384449 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d4675-0c57-4ddd-b198-f485a5398780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:51.385351 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d4675-0c57-4ddd-b198-f485a5398780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:51.385630 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d4675-0c57-4ddd-b198-f485a5398780 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:51.385898 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d4675-0c57-4ddd-b198-f485a5398780 admin admin] PATH_INFO: `/v3/users/7cdbaf30d32b46aa92061d2c0c2074de` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:51.387087 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d4675-0c57-4ddd-b198-f485a5398780 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cdbaf30d32b46aa92061d2c0c2074de)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:51.389018 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d4675-0c57-4ddd-b198-f485a5398780 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:51.617912 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-c19d4675-0c57-4ddd-b198-f485a5398780 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cdbaf30d32b46aa92061d2c0c2074de'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:51.624685 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-c19d4675-0c57-4ddd-b198-f485a5398780 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cdbaf30d32b46aa92061d2c0c2074de'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:51.625432 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-c19d4675-0c57-4ddd-b198-f485a5398780 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cdbaf30d32b46aa92061d2c0c2074de'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:51.626119 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-c19d4675-0c57-4ddd-b198-f485a5398780 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cdbaf30d32b46aa92061d2c0c2074de'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:51.695485 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-c19d4675-0c57-4ddd-b198-f485a5398780 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cdbaf30d32b46aa92061d2c0c2074de'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:51.712593 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1299/2575] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:04:51 2022] DELETE /identity/v3/users/7cdbaf30d32b46aa92061d2c0c2074de => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:04:51.717149 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c78cf-a923-418d-980c-60e65970edf2 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:51.717446 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c78cf-a923-418d-980c-60e65970edf2 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:51.717724 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c78cf-a923-418d-980c-60e65970edf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:51.735469 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-8e0c78cf-a923-418d-980c-60e65970edf2 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:04:51.736637 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-8e0c78cf-a923-418d-980c-60e65970edf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:51.798823 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1277/2576] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:04:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:04:51.808300 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d4675-0c57-4ddd-b198-f485a5398780 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:51.809754 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-c19d4675-0c57-4ddd-b198-f485a5398780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:51.864497 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d4675-0c57-4ddd-b198-f485a5398780 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:51.867989 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95a508-b9ea-4283-ab51-1f1af7338280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:51.868615 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95a508-b9ea-4283-ab51-1f1af7338280 service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:51.868897 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95a508-b9ea-4283-ab51-1f1af7338280 service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:51.869205 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95a508-b9ea-4283-ab51-1f1af7338280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:51.878390 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95a508-b9ea-4283-ab51-1f1af7338280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:51.879826 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95a508-b9ea-4283-ab51-1f1af7338280 service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:51.888972 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1300/2577] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:04:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:04:52.331480 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c78cf-a923-418d-980c-60e65970edf2 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:04:52.332882 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-8e0c78cf-a923-418d-980c-60e65970edf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:04:52.344906 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c78cf-a923-418d-980c-60e65970edf2 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:04:52.349517 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009e7d5-04f5-4d48-b4ab-9ed5a7d52a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:04:52.350382 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009e7d5-04f5-4d48-b4ab-9ed5a7d52a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:04:52.350680 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009e7d5-04f5-4d48-b4ab-9ed5a7d52a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:04:52.351394 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009e7d5-04f5-4d48-b4ab-9ed5a7d52a48 admin admin] PATH_INFO: `/v3/projects/0c48e496a63e4d67b6c59e1c9c27297b` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:04:52.352373 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009e7d5-04f5-4d48-b4ab-9ed5a7d52a48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c48e496a63e4d67b6c59e1c9c27297b)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:04:52.354567 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009e7d5-04f5-4d48-b4ab-9ed5a7d52a48 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:04:52.450920 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-2009e7d5-04f5-4d48-b4ab-9ed5a7d52a48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c48e496a63e4d67b6c59e1c9c27297b', 'request_id': 'req-2009e7d5-04f5-4d48-b4ab-9ed5a7d52a48'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:52.457101 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-2009e7d5-04f5-4d48-b4ab-9ed5a7d52a48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c48e496a63e4d67b6c59e1c9c27297b', 'request_id': 'req-2009e7d5-04f5-4d48-b4ab-9ed5a7d52a48'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:52.462343 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-2009e7d5-04f5-4d48-b4ab-9ed5a7d52a48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c48e496a63e4d67b6c59e1c9c27297b', 'request_id': 'req-2009e7d5-04f5-4d48-b4ab-9ed5a7d52a48'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:52.536498 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-2009e7d5-04f5-4d48-b4ab-9ed5a7d52a48 admin admin] The token cache is being invalidate because project 0c48e496a63e4d67b6c59e1c9c27297b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:04:52.536795 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-2009e7d5-04f5-4d48-b4ab-9ed5a7d52a48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:52.537446 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-2009e7d5-04f5-4d48-b4ab-9ed5a7d52a48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:04:52.539066 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1278/2578] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:04:52 2022] DELETE /identity/v3/projects/0c48e496a63e4d67b6c59e1c9c27297b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:05:06.706614 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95a508-b9ea-4283-ab51-1f1af7338280 service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:05:06.711081 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-eb95a508-b9ea-4283-ab51-1f1af7338280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:05:06.823975 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95a508-b9ea-4283-ab51-1f1af7338280 service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:05:06.901665 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49625e-8a7b-46b3-9ab9-d709f9a8791b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:05:06.907036 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49625e-8a7b-46b3-9ab9-d709f9a8791b service nova] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:06.907036 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49625e-8a7b-46b3-9ab9-d709f9a8791b service nova] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:06.907036 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49625e-8a7b-46b3-9ab9-d709f9a8791b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:06.907036 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-0a49625e-8a7b-46b3-9ab9-d709f9a8791b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:05:06.918613 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49625e-8a7b-46b3-9ab9-d709f9a8791b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:05:06.919970 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49625e-8a7b-46b3-9ab9-d709f9a8791b service nova] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:05:06.932641 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1301/2579] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:05:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:05:07.318525 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009e7d5-04f5-4d48-b4ab-9ed5a7d52a48 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:05:07.320455 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-2009e7d5-04f5-4d48-b4ab-9ed5a7d52a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:05:07.381347 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009e7d5-04f5-4d48-b4ab-9ed5a7d52a48 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:05:07.390788 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee155a-1fec-40f1-aa00-123583cbd27d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:05:07.392414 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee155a-1fec-40f1-aa00-123583cbd27d service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:07.393466 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee155a-1fec-40f1-aa00-123583cbd27d service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:07.395198 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee155a-1fec-40f1-aa00-123583cbd27d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:07.398210 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-75ee155a-1fec-40f1-aa00-123583cbd27d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:05:07.410669 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee155a-1fec-40f1-aa00-123583cbd27d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:05:07.414548 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee155a-1fec-40f1-aa00-123583cbd27d service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:05:07.425984 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1279/2580] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:05:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:05:07.982579 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49625e-8a7b-46b3-9ab9-d709f9a8791b service nova] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:05:07.984099 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-0a49625e-8a7b-46b3-9ab9-d709f9a8791b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:05:07.998129 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49625e-8a7b-46b3-9ab9-d709f9a8791b service nova] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:05:08.004250 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81610c4-a721-4ceb-9bcc-190c49d55e8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:05:08.004887 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81610c4-a721-4ceb-9bcc-190c49d55e8d service nova] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:08.005203 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81610c4-a721-4ceb-9bcc-190c49d55e8d service nova] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:08.005483 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81610c4-a721-4ceb-9bcc-190c49d55e8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:08.009177 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-e81610c4-a721-4ceb-9bcc-190c49d55e8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:05:08.028628 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81610c4-a721-4ceb-9bcc-190c49d55e8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:05:08.030006 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81610c4-a721-4ceb-9bcc-190c49d55e8d service nova] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:05:08.043049 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1302/2581] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:05:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:05:17.968965 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da6d57-d821-4d2a-abae-f19ac60ecdda None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:17.969483 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da6d57-d821-4d2a-abae-f19ac60ecdda None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:17.969587 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da6d57-d821-4d2a-abae-f19ac60ecdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:17.987446 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-90da6d57-d821-4d2a-abae-f19ac60ecdda None None] MFA Rules not processed for user `29314b0be6534c79b36f31402d51d17b`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:05:17.990377 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-90da6d57-d821-4d2a-abae-f19ac60ecdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:05:18.044895 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1280/2582] 10.222.0.30 () {58 vars in 967 bytes} [Wed Jan 5 15:05:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:05:18.196666 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81610c4-a721-4ceb-9bcc-190c49d55e8d service nova] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:05:18.198077 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-e81610c4-a721-4ceb-9bcc-190c49d55e8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:05:18.263750 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81610c4-a721-4ceb-9bcc-190c49d55e8d service nova] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:05:18.268712 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1507d92-e34e-4e5a-aff5-157bdc37dfad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ea13fd3e704b16aad5a38606ddc049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:05:18.269375 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1507d92-e34e-4e5a-aff5-157bdc37dfad service swift] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:18.269660 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1507d92-e34e-4e5a-aff5-157bdc37dfad service swift] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:18.269947 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1507d92-e34e-4e5a-aff5-157bdc37dfad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:18.277913 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1507d92-e34e-4e5a-aff5-157bdc37dfad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:05:18.279487 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1507d92-e34e-4e5a-aff5-157bdc37dfad service swift] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:05:18.287309 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1303/2583] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jan 5 15:05:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 15:05:25.810956 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc77e4-ef7e-4493-ad90-f94287b041b2 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:25.811465 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc77e4-ef7e-4493-ad90-f94287b041b2 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:25.811555 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc77e4-ef7e-4493-ad90-f94287b041b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:25.829949 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-95dc77e4-ef7e-4493-ad90-f94287b041b2 None None] MFA Rules not processed for user `29314b0be6534c79b36f31402d51d17b`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:05:25.831140 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-95dc77e4-ef7e-4493-ad90-f94287b041b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:05:25.838717 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1281/2584] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Jan 5 15:05:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:05:25.851316 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1507d92-e34e-4e5a-aff5-157bdc37dfad service swift] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:05:25.862792 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1507d92-e34e-4e5a-aff5-157bdc37dfad service swift] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:05:25.874212 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2474b6-8c2f-4938-bf3e-0a36b396cfbb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ea13fd3e704b16aad5a38606ddc049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:05:25.875292 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2474b6-8c2f-4938-bf3e-0a36b396cfbb service swift] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:25.875887 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2474b6-8c2f-4938-bf3e-0a36b396cfbb service swift] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:25.876361 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2474b6-8c2f-4938-bf3e-0a36b396cfbb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:25.887478 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2474b6-8c2f-4938-bf3e-0a36b396cfbb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:05:25.889277 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2474b6-8c2f-4938-bf3e-0a36b396cfbb service swift] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:05:25.900906 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1304/2585] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jan 5 15:05:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 15:05:27.783764 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc77e4-ef7e-4493-ad90-f94287b041b2 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:05:27.785777 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-95dc77e4-ef7e-4493-ad90-f94287b041b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:05:27.900677 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc77e4-ef7e-4493-ad90-f94287b041b2 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:05:27.905595 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea731b-4002-4f4a-8ac1-356bbf635d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:05:27.906793 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea731b-4002-4f4a-8ac1-356bbf635d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:27.907303 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea731b-4002-4f4a-8ac1-356bbf635d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:27.907827 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea731b-4002-4f4a-8ac1-356bbf635d0f admin admin] PATH_INFO: `/v3/users/036ba058101541b891732f6d9591c876` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:27.909373 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea731b-4002-4f4a-8ac1-356bbf635d0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=036ba058101541b891732f6d9591c876)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:05:27.911677 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea731b-4002-4f4a-8ac1-356bbf635d0f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:05:28.129590 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-75ea731b-4002-4f4a-8ac1-356bbf635d0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '036ba058101541b891732f6d9591c876'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:05:28.139013 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-75ea731b-4002-4f4a-8ac1-356bbf635d0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '036ba058101541b891732f6d9591c876'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:05:28.140069 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-75ea731b-4002-4f4a-8ac1-356bbf635d0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '036ba058101541b891732f6d9591c876'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:05:28.277123 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-75ea731b-4002-4f4a-8ac1-356bbf635d0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '036ba058101541b891732f6d9591c876'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:05:28.283734 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2474b6-8c2f-4938-bf3e-0a36b396cfbb service swift] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:05:28.286029 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-aa2474b6-8c2f-4938-bf3e-0a36b396cfbb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:05:28.295023 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-75ea731b-4002-4f4a-8ac1-356bbf635d0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '036ba058101541b891732f6d9591c876'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:05:28.306171 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1282/2586] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:05:27 2022] DELETE /identity/v3/users/036ba058101541b891732f6d9591c876 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:05:28.307228 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2474b6-8c2f-4938-bf3e-0a36b396cfbb service swift] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:05:28.457658 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746928a-3085-4085-99f2-a3f2fed6ab87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:05:28.458664 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746928a-3085-4085-99f2-a3f2fed6ab87 service nova] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:28.459114 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746928a-3085-4085-99f2-a3f2fed6ab87 service nova] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:28.459554 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746928a-3085-4085-99f2-a3f2fed6ab87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:28.462363 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-a746928a-3085-4085-99f2-a3f2fed6ab87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:05:28.488319 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746928a-3085-4085-99f2-a3f2fed6ab87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:05:28.490499 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746928a-3085-4085-99f2-a3f2fed6ab87 service nova] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:05:28.502921 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1305/2587] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:05:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 15:05:28.780995 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea731b-4002-4f4a-8ac1-356bbf635d0f admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:05:28.782246 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-75ea731b-4002-4f4a-8ac1-356bbf635d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:05:28.897445 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea731b-4002-4f4a-8ac1-356bbf635d0f admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:05:28.907020 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83a176-a2ea-48b9-bf11-53f9f69b460e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:05:28.908026 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83a176-a2ea-48b9-bf11-53f9f69b460e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:28.908376 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83a176-a2ea-48b9-bf11-53f9f69b460e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:28.908748 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83a176-a2ea-48b9-bf11-53f9f69b460e admin admin] PATH_INFO: `/v3/projects/b874b608d2c848a88541148e56d2114d` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:28.910056 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83a176-a2ea-48b9-bf11-53f9f69b460e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b874b608d2c848a88541148e56d2114d)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:05:28.912078 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83a176-a2ea-48b9-bf11-53f9f69b460e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:05:29.034742 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-8c83a176-a2ea-48b9-bf11-53f9f69b460e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b874b608d2c848a88541148e56d2114d', 'request_id': 'req-8c83a176-a2ea-48b9-bf11-53f9f69b460e'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:05:29.043971 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-8c83a176-a2ea-48b9-bf11-53f9f69b460e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b874b608d2c848a88541148e56d2114d', 'request_id': 'req-8c83a176-a2ea-48b9-bf11-53f9f69b460e'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:05:29.049688 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-8c83a176-a2ea-48b9-bf11-53f9f69b460e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b874b608d2c848a88541148e56d2114d', 'request_id': 'req-8c83a176-a2ea-48b9-bf11-53f9f69b460e'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:05:29.232855 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-8c83a176-a2ea-48b9-bf11-53f9f69b460e admin admin] The token cache is being invalidate because project b874b608d2c848a88541148e56d2114d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:05:29.233561 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-8c83a176-a2ea-48b9-bf11-53f9f69b460e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:05:29.234416 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-8c83a176-a2ea-48b9-bf11-53f9f69b460e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:05:29.236253 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1283/2588] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:05:28 2022] DELETE /identity/v3/projects/b874b608d2c848a88541148e56d2114d => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:05:29.248863 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746928a-3085-4085-99f2-a3f2fed6ab87 service nova] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:05:29.266162 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746928a-3085-4085-99f2-a3f2fed6ab87 service nova] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:05:29.332189 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7797f-e7af-4c03-971f-4986e917b44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:05:29.332963 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7797f-e7af-4c03-971f-4986e917b44b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:29.333303 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7797f-e7af-4c03-971f-4986e917b44b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:29.333581 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7797f-e7af-4c03-971f-4986e917b44b admin admin] PATH_INFO: `/v3/users/ad7e6e6259d54c8cb3d5ea6a14401cb2` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:29.334774 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7797f-e7af-4c03-971f-4986e917b44b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad7e6e6259d54c8cb3d5ea6a14401cb2)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:05:29.336724 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7797f-e7af-4c03-971f-4986e917b44b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:05:29.896924 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-52d7797f-e7af-4c03-971f-4986e917b44b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad7e6e6259d54c8cb3d5ea6a14401cb2'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:05:29.904084 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-52d7797f-e7af-4c03-971f-4986e917b44b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad7e6e6259d54c8cb3d5ea6a14401cb2'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:05:29.904746 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-52d7797f-e7af-4c03-971f-4986e917b44b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad7e6e6259d54c8cb3d5ea6a14401cb2'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:05:29.905366 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-52d7797f-e7af-4c03-971f-4986e917b44b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad7e6e6259d54c8cb3d5ea6a14401cb2'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:05:29.987020 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-52d7797f-e7af-4c03-971f-4986e917b44b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad7e6e6259d54c8cb3d5ea6a14401cb2'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:05:30.010079 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1306/2589] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:05:29 2022] DELETE /identity/v3/users/ad7e6e6259d54c8cb3d5ea6a14401cb2 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:05:30.325103 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83a176-a2ea-48b9-bf11-53f9f69b460e admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:05:30.333886 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-8c83a176-a2ea-48b9-bf11-53f9f69b460e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:05:30.375438 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83a176-a2ea-48b9-bf11-53f9f69b460e admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:05:30.465597 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e6a07-b946-49e0-a316-35190647cd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:05:30.467194 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e6a07-b946-49e0-a316-35190647cd90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:30.467646 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e6a07-b946-49e0-a316-35190647cd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:30.468050 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e6a07-b946-49e0-a316-35190647cd90 admin admin] PATH_INFO: `/v3/projects/c9dbadb18d1c4e888fda9d242ffdaf05` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:30.470037 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e6a07-b946-49e0-a316-35190647cd90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9dbadb18d1c4e888fda9d242ffdaf05)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:05:30.474195 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e6a07-b946-49e0-a316-35190647cd90 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:05:30.607746 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-529e6a07-b946-49e0-a316-35190647cd90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9dbadb18d1c4e888fda9d242ffdaf05', 'request_id': 'req-529e6a07-b946-49e0-a316-35190647cd90'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:05:30.615087 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-529e6a07-b946-49e0-a316-35190647cd90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9dbadb18d1c4e888fda9d242ffdaf05', 'request_id': 'req-529e6a07-b946-49e0-a316-35190647cd90'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:05:30.623031 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-529e6a07-b946-49e0-a316-35190647cd90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9dbadb18d1c4e888fda9d242ffdaf05', 'request_id': 'req-529e6a07-b946-49e0-a316-35190647cd90'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:05:30.695379 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-529e6a07-b946-49e0-a316-35190647cd90 admin admin] The token cache is being invalidate because project c9dbadb18d1c4e888fda9d242ffdaf05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:05:30.695821 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-529e6a07-b946-49e0-a316-35190647cd90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:05:30.696554 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-529e6a07-b946-49e0-a316-35190647cd90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:05:30.698515 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1284/2590] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:05:30 2022] DELETE /identity/v3/projects/c9dbadb18d1c4e888fda9d242ffdaf05 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:05:41.030822 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7797f-e7af-4c03-971f-4986e917b44b admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:05:41.032236 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-52d7797f-e7af-4c03-971f-4986e917b44b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:05:41.089083 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7797f-e7af-4c03-971f-4986e917b44b admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:05:41.135490 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab51028-b05f-4b67-b938-bf0c435171a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:05:41.136133 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab51028-b05f-4b67-b938-bf0c435171a9 service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:41.136444 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab51028-b05f-4b67-b938-bf0c435171a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:41.136725 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab51028-b05f-4b67-b938-bf0c435171a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:41.138518 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-0ab51028-b05f-4b67-b938-bf0c435171a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:05:41.208089 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab51028-b05f-4b67-b938-bf0c435171a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:05:41.208089 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab51028-b05f-4b67-b938-bf0c435171a9 service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:05:41.210477 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1307/2591] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:05:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:05:44.752734 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e6a07-b946-49e0-a316-35190647cd90 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:05:44.755439 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-529e6a07-b946-49e0-a316-35190647cd90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:05:44.771014 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e6a07-b946-49e0-a316-35190647cd90 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:05:44.775267 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65961e06-3f7f-4953-bb88-d89f8764cdc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:05:44.776122 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65961e06-3f7f-4953-bb88-d89f8764cdc1 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:44.776594 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65961e06-3f7f-4953-bb88-d89f8764cdc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:44.777019 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65961e06-3f7f-4953-bb88-d89f8764cdc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:44.779505 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-65961e06-3f7f-4953-bb88-d89f8764cdc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:05:44.789894 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65961e06-3f7f-4953-bb88-d89f8764cdc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:05:44.791581 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65961e06-3f7f-4953-bb88-d89f8764cdc1 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:05:44.801200 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1285/2592] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:05:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:05:45.455825 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab51028-b05f-4b67-b938-bf0c435171a9 service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:05:45.457590 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-0ab51028-b05f-4b67-b938-bf0c435171a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:05:45.469905 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab51028-b05f-4b67-b938-bf0c435171a9 service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:05:45.475066 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92718a-e49b-4e45-a360-a29d13554ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:05:45.475949 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92718a-e49b-4e45-a360-a29d13554ff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:45.476419 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92718a-e49b-4e45-a360-a29d13554ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:45.477443 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92718a-e49b-4e45-a360-a29d13554ff5 admin admin] PATH_INFO: `/v3/users/2de1d8ec06134669a4db8ca248feceae` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:45.479410 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92718a-e49b-4e45-a360-a29d13554ff5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2de1d8ec06134669a4db8ca248feceae)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:05:45.481433 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92718a-e49b-4e45-a360-a29d13554ff5 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:05:45.515233 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5209a3e-cf0f-494b-8edc-700511372a92 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:45.515817 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5209a3e-cf0f-494b-8edc-700511372a92 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:45.516121 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5209a3e-cf0f-494b-8edc-700511372a92 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:45.517957 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1286/2593] 10.222.0.30 () {54 vars in 960 bytes} [Wed Jan 5 15:05:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 15:05:45.522493 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b9504-7b48-4162-9337-0c07e584bdb4 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:45.522788 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b9504-7b48-4162-9337-0c07e584bdb4 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:45.523072 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b9504-7b48-4162-9337-0c07e584bdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:45.559644 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-5f0b9504-7b48-4162-9337-0c07e584bdb4 None None] MFA Rules not processed for user `8847b97a7089420a8b8b817f3059c660`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:05:45.560805 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-5f0b9504-7b48-4162-9337-0c07e584bdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:05:45.622077 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1287/2594] 10.222.0.30 () {58 vars in 1057 bytes} [Wed Jan 5 15:05:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:05:45.629653 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b9504-7b48-4162-9337-0c07e584bdb4 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:05:45.639243 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b9504-7b48-4162-9337-0c07e584bdb4 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:05:45.644322 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ab924-9934-4c83-9bed-4f1d2bb9fc92 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8847b97a7089420a8b8b817f3059c660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:05:45.644929 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ab924-9934-4c83-9bed-4f1d2bb9fc92 service placement] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:45.645251 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ab924-9934-4c83-9bed-4f1d2bb9fc92 service placement] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:45.645534 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ab924-9934-4c83-9bed-4f1d2bb9fc92 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:45.647234 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-031ab924-9934-4c83-9bed-4f1d2bb9fc92 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:05:45.658712 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ab924-9934-4c83-9bed-4f1d2bb9fc92 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:05:45.660274 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ab924-9934-4c83-9bed-4f1d2bb9fc92 service placement] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:05:45.670254 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1288/2595] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:05:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 15:05:45.720454 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-1c92718a-e49b-4e45-a360-a29d13554ff5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2de1d8ec06134669a4db8ca248feceae'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:05:45.728169 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-1c92718a-e49b-4e45-a360-a29d13554ff5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2de1d8ec06134669a4db8ca248feceae'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:05:45.728837 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-1c92718a-e49b-4e45-a360-a29d13554ff5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2de1d8ec06134669a4db8ca248feceae'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:05:45.729465 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-1c92718a-e49b-4e45-a360-a29d13554ff5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2de1d8ec06134669a4db8ca248feceae'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:05:45.838226 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-1c92718a-e49b-4e45-a360-a29d13554ff5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2de1d8ec06134669a4db8ca248feceae'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:05:45.855396 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1308/2596] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:05:45 2022] DELETE /identity/v3/users/2de1d8ec06134669a4db8ca248feceae => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:05:46.123420 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ab924-9934-4c83-9bed-4f1d2bb9fc92 service placement] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:05:46.140112 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ab924-9934-4c83-9bed-4f1d2bb9fc92 service placement] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:05:46.193181 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36793405-f089-497a-9426-b3213170f547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:05:46.194051 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36793405-f089-497a-9426-b3213170f547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:46.194333 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36793405-f089-497a-9426-b3213170f547 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:46.194608 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36793405-f089-497a-9426-b3213170f547 admin admin] PATH_INFO: `/v3/projects/715006ffd8ba4e5b963511ec759ae152` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:46.196357 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36793405-f089-497a-9426-b3213170f547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=715006ffd8ba4e5b963511ec759ae152)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:05:46.198335 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36793405-f089-497a-9426-b3213170f547 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:05:46.307310 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-36793405-f089-497a-9426-b3213170f547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '715006ffd8ba4e5b963511ec759ae152', 'request_id': 'req-36793405-f089-497a-9426-b3213170f547'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:05:46.313848 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-36793405-f089-497a-9426-b3213170f547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '715006ffd8ba4e5b963511ec759ae152', 'request_id': 'req-36793405-f089-497a-9426-b3213170f547'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:05:46.319509 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-36793405-f089-497a-9426-b3213170f547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '715006ffd8ba4e5b963511ec759ae152', 'request_id': 'req-36793405-f089-497a-9426-b3213170f547'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:05:46.420875 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-36793405-f089-497a-9426-b3213170f547 admin admin] The token cache is being invalidate because project 715006ffd8ba4e5b963511ec759ae152 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:05:46.421239 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-36793405-f089-497a-9426-b3213170f547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:05:46.421863 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-36793405-f089-497a-9426-b3213170f547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:05:46.423493 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1289/2597] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:05:46 2022] DELETE /identity/v3/projects/715006ffd8ba4e5b963511ec759ae152 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:05:46.429240 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef908a6-b449-4327-afca-668d4a335959 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:46.430534 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef908a6-b449-4327-afca-668d4a335959 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:46.430534 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef908a6-b449-4327-afca-668d4a335959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:46.449879 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-8ef908a6-b449-4327-afca-668d4a335959 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:05:46.451086 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-8ef908a6-b449-4327-afca-668d4a335959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:05:46.512601 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1309/2598] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:05:46.518150 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809107b5-4089-4899-8961-1edb493573ae None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:46.518443 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809107b5-4089-4899-8961-1edb493573ae None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:46.518727 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809107b5-4089-4899-8961-1edb493573ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:46.537797 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-809107b5-4089-4899-8961-1edb493573ae None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:05:46.539510 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-809107b5-4089-4899-8961-1edb493573ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:05:46.548591 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1290/2599] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:05:46.553574 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef908a6-b449-4327-afca-668d4a335959 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:05:46.564033 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef908a6-b449-4327-afca-668d4a335959 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:05:46.569875 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf6702-1cc2-4e1b-a1c1-84be6d9f488a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:05:46.570552 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf6702-1cc2-4e1b-a1c1-84be6d9f488a admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:46.570839 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf6702-1cc2-4e1b-a1c1-84be6d9f488a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:46.571118 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf6702-1cc2-4e1b-a1c1-84be6d9f488a admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:46.571857 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf6702-1cc2-4e1b-a1c1-84be6d9f488a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:05:46.572759 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf6702-1cc2-4e1b-a1c1-84be6d9f488a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:05:46.574434 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf6702-1cc2-4e1b-a1c1-84be6d9f488a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:05:46.586229 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1310/2600] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 15:05:46.590520 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809107b5-4089-4899-8961-1edb493573ae None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:05:46.599575 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809107b5-4089-4899-8961-1edb493573ae None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:05:46.605342 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f0334-44c3-4ac3-a24e-20b8356f7449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:05:46.606043 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f0334-44c3-4ac3-a24e-20b8356f7449 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:46.606330 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f0334-44c3-4ac3-a24e-20b8356f7449 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:46.606603 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f0334-44c3-4ac3-a24e-20b8356f7449 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:46.607338 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f0334-44c3-4ac3-a24e-20b8356f7449 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:05:46.609297 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f0334-44c3-4ac3-a24e-20b8356f7449 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:05:46.702050 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1291/2601] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:05:46 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:05:46.706034 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf6702-1cc2-4e1b-a1c1-84be6d9f488a admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:05:46.716447 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf6702-1cc2-4e1b-a1c1-84be6d9f488a admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:05:46.770056 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb0463-5237-41d8-bc76-65423a66340b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:05:46.770707 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb0463-5237-41d8-bc76-65423a66340b admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:46.770991 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb0463-5237-41d8-bc76-65423a66340b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:46.771268 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb0463-5237-41d8-bc76-65423a66340b admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:46.771971 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb0463-5237-41d8-bc76-65423a66340b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:05:46.774461 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb0463-5237-41d8-bc76-65423a66340b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:05:46.883814 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1311/2602] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:05:46 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:05:46.888075 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f0334-44c3-4ac3-a24e-20b8356f7449 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:05:46.898204 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f0334-44c3-4ac3-a24e-20b8356f7449 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:05:46.903302 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9429e-ed70-4759-ab1c-1d8afae85d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:05:46.903949 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9429e-ed70-4759-ab1c-1d8afae85d69 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:46.904233 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9429e-ed70-4759-ab1c-1d8afae85d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:46.904507 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9429e-ed70-4759-ab1c-1d8afae85d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:46.905370 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9429e-ed70-4759-ab1c-1d8afae85d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:05:46.906955 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9429e-ed70-4759-ab1c-1d8afae85d69 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:05:46.918405 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1292/2603] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:05:46.922483 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb0463-5237-41d8-bc76-65423a66340b admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:05:46.932515 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb0463-5237-41d8-bc76-65423a66340b admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:05:46.937265 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3229a7-3117-492c-9dc9-3a5f7bababb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:05:46.937962 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3229a7-3117-492c-9dc9-3a5f7bababb8 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:46.938249 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3229a7-3117-492c-9dc9-3a5f7bababb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:46.938526 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3229a7-3117-492c-9dc9-3a5f7bababb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:46.939261 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3229a7-3117-492c-9dc9-3a5f7bababb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:05:46.940862 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3229a7-3117-492c-9dc9-3a5f7bababb8 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:05:46.950623 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1312/2604] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:05:46.954533 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9429e-ed70-4759-ab1c-1d8afae85d69 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:05:46.964739 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9429e-ed70-4759-ab1c-1d8afae85d69 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:05:46.969572 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fac539-ec65-4fe8-a23e-0ef80675f060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:05:46.970441 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fac539-ec65-4fe8-a23e-0ef80675f060 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:46.970722 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fac539-ec65-4fe8-a23e-0ef80675f060 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:46.970997 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fac539-ec65-4fe8-a23e-0ef80675f060 admin admin] PATH_INFO: `/v3/projects/97821d0c0c79446abba323f103c8244a/users/e1578e40c006442ca632381e242d35bf/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:46.986700 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fac539-ec65-4fe8-a23e-0ef80675f060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97821d0c0c79446abba323f103c8244a, user_id=e1578e40c006442ca632381e242d35bf, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:05:46.989356 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fac539-ec65-4fe8-a23e-0ef80675f060 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:05:47.098474 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1293/2605] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:05:46 2022] PUT /identity/v3/projects/97821d0c0c79446abba323f103c8244a/users/e1578e40c006442ca632381e242d35bf/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:05:47.103971 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390be93-986f-4f7b-b8dc-a3b7a7a46173 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:47.104264 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390be93-986f-4f7b-b8dc-a3b7a7a46173 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:47.104544 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390be93-986f-4f7b-b8dc-a3b7a7a46173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:47.121913 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-7390be93-986f-4f7b-b8dc-a3b7a7a46173 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:05:47.123231 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-7390be93-986f-4f7b-b8dc-a3b7a7a46173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:05:47.181737 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1313/2606] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:05:47.192058 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fac539-ec65-4fe8-a23e-0ef80675f060 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:05:47.193912 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-28fac539-ec65-4fe8-a23e-0ef80675f060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:05:47.251586 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fac539-ec65-4fe8-a23e-0ef80675f060 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:05:47.255646 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d6af6-8aa1-40aa-98a7-effcd7be6cb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:05:47.256296 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d6af6-8aa1-40aa-98a7-effcd7be6cb3 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:47.256629 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d6af6-8aa1-40aa-98a7-effcd7be6cb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:47.256903 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d6af6-8aa1-40aa-98a7-effcd7be6cb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:47.268763 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305d6af6-8aa1-40aa-98a7-effcd7be6cb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:05:47.270608 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305d6af6-8aa1-40aa-98a7-effcd7be6cb3 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:05:47.281151 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1294/2607] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:05:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 15:05:48.027008 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4fbf9-59af-46e4-bc07-2ca288f801fa None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:48.027504 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4fbf9-59af-46e4-bc07-2ca288f801fa None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:48.027753 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4fbf9-59af-46e4-bc07-2ca288f801fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:48.045958 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-f2e4fbf9-59af-46e4-bc07-2ca288f801fa None None] MFA Rules not processed for user `29314b0be6534c79b36f31402d51d17b`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:05:48.047168 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-f2e4fbf9-59af-46e4-bc07-2ca288f801fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:05:48.103257 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1314/2608] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Jan 5 15:05:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:05:48.115319 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d6af6-8aa1-40aa-98a7-effcd7be6cb3 service neutron] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:05:48.116808 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-305d6af6-8aa1-40aa-98a7-effcd7be6cb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:05:48.184490 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d6af6-8aa1-40aa-98a7-effcd7be6cb3 service neutron] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:05:48.190090 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ff731-1c31-4177-ad5c-0a39d89b32a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ea13fd3e704b16aad5a38606ddc049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:05:48.190930 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ff731-1c31-4177-ad5c-0a39d89b32a6 service swift] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:48.191284 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ff731-1c31-4177-ad5c-0a39d89b32a6 service swift] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:48.191565 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ff731-1c31-4177-ad5c-0a39d89b32a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:48.201034 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ff731-1c31-4177-ad5c-0a39d89b32a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:05:48.202673 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ff731-1c31-4177-ad5c-0a39d89b32a6 service swift] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:05:48.211359 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1295/2609] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jan 5 15:05:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 15:05:48.555935 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003f497-711f-4c09-9d73-cfde8c3688d4 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:48.556278 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003f497-711f-4c09-9d73-cfde8c3688d4 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:48.556864 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003f497-711f-4c09-9d73-cfde8c3688d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:48.604926 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-4003f497-711f-4c09-9d73-cfde8c3688d4 None None] MFA Rules not processed for user `e1578e40c006442ca632381e242d35bf`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:05:48.606560 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-4003f497-711f-4c09-9d73-cfde8c3688d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:05:48.763780 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1315/2610] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:05:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:05:48.775276 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87284b64-ef29-4ae6-a279-91e53bb51159 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:48.775568 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87284b64-ef29-4ae6-a279-91e53bb51159 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:48.775859 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87284b64-ef29-4ae6-a279-91e53bb51159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:48.803901 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-87284b64-ef29-4ae6-a279-91e53bb51159 None None] MFA Rules not processed for user `e1578e40c006442ca632381e242d35bf`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:05:48.806045 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-87284b64-ef29-4ae6-a279-91e53bb51159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:05:48.813812 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1296/2611] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:05:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:05:48.825042 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003f497-711f-4c09-9d73-cfde8c3688d4 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:05:48.826623 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-4003f497-711f-4c09-9d73-cfde8c3688d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:05:48.921378 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003f497-711f-4c09-9d73-cfde8c3688d4 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:05:48.927758 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a75413-2f7a-46d6-8564-1e77b0c61789 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:05:48.928630 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a75413-2f7a-46d6-8564-1e77b0c61789 service nova] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:48.929016 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a75413-2f7a-46d6-8564-1e77b0c61789 service nova] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:48.929594 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a75413-2f7a-46d6-8564-1e77b0c61789 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:48.957290 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a75413-2f7a-46d6-8564-1e77b0c61789 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:05:48.959306 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a75413-2f7a-46d6-8564-1e77b0c61789 service nova] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:05:48.972305 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1316/2612] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:05:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:05:49.213988 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87284b64-ef29-4ae6-a279-91e53bb51159 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:05:49.224003 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87284b64-ef29-4ae6-a279-91e53bb51159 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:05:49.228703 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcb936-2189-42d1-92e1-f719c3cb0072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:05:49.229728 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcb936-2189-42d1-92e1-f719c3cb0072 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:05:49.230274 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcb936-2189-42d1-92e1-f719c3cb0072 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:05:49.230840 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcb936-2189-42d1-92e1-f719c3cb0072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:05:49.233356 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-87bcb936-2189-42d1-92e1-f719c3cb0072 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:05:49.244791 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcb936-2189-42d1-92e1-f719c3cb0072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:05:49.246412 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcb936-2189-42d1-92e1-f719c3cb0072 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:05:49.254575 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1297/2613] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:05:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:06:04.006555 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f70944-e6c6-43e4-98fc-fee2d3a67706 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:04.007073 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f70944-e6c6-43e4-98fc-fee2d3a67706 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:04.007172 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f70944-e6c6-43e4-98fc-fee2d3a67706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:04.024551 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-c5f70944-e6c6-43e4-98fc-fee2d3a67706 None None] MFA Rules not processed for user `29314b0be6534c79b36f31402d51d17b`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:06:04.025787 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-c5f70944-e6c6-43e4-98fc-fee2d3a67706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:06:04.032778 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1317/2614] 10.222.0.30 () {58 vars in 967 bytes} [Wed Jan 5 15:06:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:06:04.046186 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcb936-2189-42d1-92e1-f719c3cb0072 service neutron] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:04.058821 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcb936-2189-42d1-92e1-f719c3cb0072 service neutron] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:04.063788 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95047c4c-53a8-4975-8510-577fb8eb9b7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ea13fd3e704b16aad5a38606ddc049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:04.064435 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95047c4c-53a8-4975-8510-577fb8eb9b7e service swift] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:04.064716 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95047c4c-53a8-4975-8510-577fb8eb9b7e service swift] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:04.064991 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95047c4c-53a8-4975-8510-577fb8eb9b7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:04.072987 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95047c4c-53a8-4975-8510-577fb8eb9b7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:04.074573 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95047c4c-53a8-4975-8510-577fb8eb9b7e service swift] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:04.082396 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1298/2615] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jan 5 15:06:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 05 15:06:20.400487 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7756ddb-eda8-4763-b281-1201bdf2d55d None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:20.401039 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7756ddb-eda8-4763-b281-1201bdf2d55d None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:20.401039 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7756ddb-eda8-4763-b281-1201bdf2d55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:20.420073 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-b7756ddb-eda8-4763-b281-1201bdf2d55d None None] MFA Rules not processed for user `e1578e40c006442ca632381e242d35bf`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:06:20.421854 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-b7756ddb-eda8-4763-b281-1201bdf2d55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:06:20.428983 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1318/2616] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:06:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:06:22.552408 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b428f49-8454-421b-9c31-f971648bbef2 None None] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:22.553014 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b428f49-8454-421b-9c31-f971648bbef2 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:22.553014 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b428f49-8454-421b-9c31-f971648bbef2 None None] PATH_INFO: `/` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:22.555011 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1299/2617] 10.222.0.30 () {54 vars in 921 bytes} [Wed Jan 5 15:06:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 05 15:06:22.561001 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e701b38-0381-4607-961f-3cce2a47f567 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:22.561473 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e701b38-0381-4607-961f-3cce2a47f567 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:22.561670 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e701b38-0381-4607-961f-3cce2a47f567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:22.581927 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-2e701b38-0381-4607-961f-3cce2a47f567 None None] MFA Rules not processed for user `a6234d716a014808a8a4eb22b903bbc9`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:06:22.583149 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-2e701b38-0381-4607-961f-3cce2a47f567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:06:22.590497 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1319/2618] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Jan 5 15:06:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:06:22.603567 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b428f49-8454-421b-9c31-f971648bbef2 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:22.606243 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-8b428f49-8454-421b-9c31-f971648bbef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:06:22.620309 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b428f49-8454-421b-9c31-f971648bbef2 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:22.624046 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7cfa0-4dbc-4e0b-81b7-a2f57296fc06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:22.624759 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7cfa0-4dbc-4e0b-81b7-a2f57296fc06 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:22.625149 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7cfa0-4dbc-4e0b-81b7-a2f57296fc06 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:22.625498 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7cfa0-4dbc-4e0b-81b7-a2f57296fc06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:22.632676 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7cfa0-4dbc-4e0b-81b7-a2f57296fc06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:22.634159 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7cfa0-4dbc-4e0b-81b7-a2f57296fc06 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:22.641749 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1300/2619] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:06:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 15:06:38.190944 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881caf3-55ea-4e53-99ec-531c43a01d2a None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:38.191469 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881caf3-55ea-4e53-99ec-531c43a01d2a None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:38.191469 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881caf3-55ea-4e53-99ec-531c43a01d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:38.209815 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-5881caf3-55ea-4e53-99ec-531c43a01d2a None None] MFA Rules not processed for user `e1578e40c006442ca632381e242d35bf`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:06:38.211038 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-5881caf3-55ea-4e53-99ec-531c43a01d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:06:38.218417 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1320/2620] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:06:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:06:48.811275 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7cfa0-4dbc-4e0b-81b7-a2f57296fc06 service neutron] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:48.821230 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7cfa0-4dbc-4e0b-81b7-a2f57296fc06 service neutron] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:48.825351 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb37a6-012d-40fe-9b4e-48338eeb9d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:48.826078 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb37a6-012d-40fe-9b4e-48338eeb9d8b service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:48.826555 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb37a6-012d-40fe-9b4e-48338eeb9d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:48.826769 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb37a6-012d-40fe-9b4e-48338eeb9d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:48.828650 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-2abb37a6-012d-40fe-9b4e-48338eeb9d8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:06:48.840890 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb37a6-012d-40fe-9b4e-48338eeb9d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:48.842512 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb37a6-012d-40fe-9b4e-48338eeb9d8b service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:48.852737 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1301/2621] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:06:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:06:52.746597 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881caf3-55ea-4e53-99ec-531c43a01d2a None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:52.748662 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-5881caf3-55ea-4e53-99ec-531c43a01d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:06:52.764983 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881caf3-55ea-4e53-99ec-531c43a01d2a None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:52.769500 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253effb-a041-46e8-9a52-7cf8a8871405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:52.770399 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253effb-a041-46e8-9a52-7cf8a8871405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:52.770665 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253effb-a041-46e8-9a52-7cf8a8871405 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:52.770938 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253effb-a041-46e8-9a52-7cf8a8871405 admin admin] PATH_INFO: `/v3/users/d43400b4646449ce94967ec5bab4eca1` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:52.772128 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253effb-a041-46e8-9a52-7cf8a8871405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d43400b4646449ce94967ec5bab4eca1)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:52.774080 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253effb-a041-46e8-9a52-7cf8a8871405 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:53.068103 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-4253effb-a041-46e8-9a52-7cf8a8871405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd43400b4646449ce94967ec5bab4eca1'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:06:53.074729 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-4253effb-a041-46e8-9a52-7cf8a8871405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd43400b4646449ce94967ec5bab4eca1'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:06:53.075398 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-4253effb-a041-46e8-9a52-7cf8a8871405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd43400b4646449ce94967ec5bab4eca1'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:06:53.076011 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-4253effb-a041-46e8-9a52-7cf8a8871405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd43400b4646449ce94967ec5bab4eca1'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:06:53.225330 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-4253effb-a041-46e8-9a52-7cf8a8871405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd43400b4646449ce94967ec5bab4eca1'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:06:53.244298 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1321/2622] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:06:52 2022] DELETE /identity/v3/users/d43400b4646449ce94967ec5bab4eca1 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:06:53.495349 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb37a6-012d-40fe-9b4e-48338eeb9d8b service neutron] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:53.505375 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb37a6-012d-40fe-9b4e-48338eeb9d8b service neutron] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:53.563009 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df517e-57fc-4d05-9769-26b6b11ae82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:53.563932 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df517e-57fc-4d05-9769-26b6b11ae82b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:53.564346 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df517e-57fc-4d05-9769-26b6b11ae82b admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:53.564483 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df517e-57fc-4d05-9769-26b6b11ae82b admin admin] PATH_INFO: `/v3/projects/f4a45a70c5d046238abaad07fbe529e9` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:53.565736 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df517e-57fc-4d05-9769-26b6b11ae82b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4a45a70c5d046238abaad07fbe529e9)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:53.567725 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df517e-57fc-4d05-9769-26b6b11ae82b admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:53.701506 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-71df517e-57fc-4d05-9769-26b6b11ae82b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4a45a70c5d046238abaad07fbe529e9', 'request_id': 'req-71df517e-57fc-4d05-9769-26b6b11ae82b'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:06:53.707415 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-71df517e-57fc-4d05-9769-26b6b11ae82b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4a45a70c5d046238abaad07fbe529e9', 'request_id': 'req-71df517e-57fc-4d05-9769-26b6b11ae82b'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:06:53.712571 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-71df517e-57fc-4d05-9769-26b6b11ae82b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4a45a70c5d046238abaad07fbe529e9', 'request_id': 'req-71df517e-57fc-4d05-9769-26b6b11ae82b'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:06:53.802123 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-71df517e-57fc-4d05-9769-26b6b11ae82b admin admin] The token cache is being invalidate because project f4a45a70c5d046238abaad07fbe529e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:06:53.802380 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-71df517e-57fc-4d05-9769-26b6b11ae82b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:06:53.803046 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-71df517e-57fc-4d05-9769-26b6b11ae82b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:06:53.804595 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1302/2623] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:06:53 2022] DELETE /identity/v3/projects/f4a45a70c5d046238abaad07fbe529e9 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:06:53.810436 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f332e67-6010-45fd-81ff-445e0aba89aa None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:53.810910 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f332e67-6010-45fd-81ff-445e0aba89aa None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:53.811014 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f332e67-6010-45fd-81ff-445e0aba89aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:53.828902 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-0f332e67-6010-45fd-81ff-445e0aba89aa None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:06:53.830141 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-0f332e67-6010-45fd-81ff-445e0aba89aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:06:53.888725 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1322/2624] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:06:53.896764 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2427e3-1b64-4d08-ba45-c90e9b6bafa8 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:53.897055 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2427e3-1b64-4d08-ba45-c90e9b6bafa8 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:53.897370 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2427e3-1b64-4d08-ba45-c90e9b6bafa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:53.915821 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-0b2427e3-1b64-4d08-ba45-c90e9b6bafa8 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:06:53.916990 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-0b2427e3-1b64-4d08-ba45-c90e9b6bafa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:06:53.924786 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1303/2625] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:06:53.928892 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f332e67-6010-45fd-81ff-445e0aba89aa None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:53.938402 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f332e67-6010-45fd-81ff-445e0aba89aa None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:53.943023 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c26e2-b2a2-4332-bff1-ca31829425ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:53.943745 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c26e2-b2a2-4332-bff1-ca31829425ae admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:53.943991 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c26e2-b2a2-4332-bff1-ca31829425ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:53.944265 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c26e2-b2a2-4332-bff1-ca31829425ae admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:53.944985 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c26e2-b2a2-4332-bff1-ca31829425ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:06:53.945318 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c26e2-b2a2-4332-bff1-ca31829425ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:53.946893 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c26e2-b2a2-4332-bff1-ca31829425ae admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:53.958756 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1323/2626] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 15:06:53.962734 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2427e3-1b64-4d08-ba45-c90e9b6bafa8 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:53.972308 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2427e3-1b64-4d08-ba45-c90e9b6bafa8 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:53.977281 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f055ec-bb8d-4fb7-90de-b49cfcda79e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:53.977923 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f055ec-bb8d-4fb7-90de-b49cfcda79e0 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:53.978208 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f055ec-bb8d-4fb7-90de-b49cfcda79e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:53.978482 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f055ec-bb8d-4fb7-90de-b49cfcda79e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:53.979173 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f055ec-bb8d-4fb7-90de-b49cfcda79e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:53.981136 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f055ec-bb8d-4fb7-90de-b49cfcda79e0 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:54.130949 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1304/2627] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:06:53 2022] POST /identity/v3/projects => generated 363 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:06:54.135741 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c26e2-b2a2-4332-bff1-ca31829425ae admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:54.146494 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c26e2-b2a2-4332-bff1-ca31829425ae admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:54.207882 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56495e-5df7-49db-93d9-2d60caf6dcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:54.208701 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56495e-5df7-49db-93d9-2d60caf6dcd6 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:54.209111 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56495e-5df7-49db-93d9-2d60caf6dcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:54.209333 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56495e-5df7-49db-93d9-2d60caf6dcd6 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:54.210057 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56495e-5df7-49db-93d9-2d60caf6dcd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:54.211998 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56495e-5df7-49db-93d9-2d60caf6dcd6 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:54.320465 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1324/2628] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:06:54 2022] POST /identity/v3/users => generated 282 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:06:54.325407 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f055ec-bb8d-4fb7-90de-b49cfcda79e0 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:54.335615 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f055ec-bb8d-4fb7-90de-b49cfcda79e0 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:54.340279 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978f02b-89ad-4407-bdaa-ba8ec0e9e693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:54.340925 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978f02b-89ad-4407-bdaa-ba8ec0e9e693 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:54.341388 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978f02b-89ad-4407-bdaa-ba8ec0e9e693 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:54.341775 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978f02b-89ad-4407-bdaa-ba8ec0e9e693 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:54.342567 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5978f02b-89ad-4407-bdaa-ba8ec0e9e693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:54.344145 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5978f02b-89ad-4407-bdaa-ba8ec0e9e693 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:54.354627 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1305/2629] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:06:54.358519 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56495e-5df7-49db-93d9-2d60caf6dcd6 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:54.369291 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56495e-5df7-49db-93d9-2d60caf6dcd6 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:54.374890 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25922d03-0a36-4a15-9a07-387659ac95c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:54.375548 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25922d03-0a36-4a15-9a07-387659ac95c2 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:54.375905 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25922d03-0a36-4a15-9a07-387659ac95c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:54.376186 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25922d03-0a36-4a15-9a07-387659ac95c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:54.377034 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25922d03-0a36-4a15-9a07-387659ac95c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:54.378758 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25922d03-0a36-4a15-9a07-387659ac95c2 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:54.393221 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1325/2630] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:06:54.394281 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978f02b-89ad-4407-bdaa-ba8ec0e9e693 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:54.404251 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978f02b-89ad-4407-bdaa-ba8ec0e9e693 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:54.409079 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2b7a5-e259-4243-a1f6-fbe35b57d213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:54.415202 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2b7a5-e259-4243-a1f6-fbe35b57d213 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:54.415202 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2b7a5-e259-4243-a1f6-fbe35b57d213 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:54.415202 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2b7a5-e259-4243-a1f6-fbe35b57d213 admin admin] PATH_INFO: `/v3/projects/b7afcb105a3c45368612aa019f475269/users/c53b17e37a794aceaa97334ddf7123c0/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:54.425017 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2b7a5-e259-4243-a1f6-fbe35b57d213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7afcb105a3c45368612aa019f475269, user_id=c53b17e37a794aceaa97334ddf7123c0, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:54.427666 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2b7a5-e259-4243-a1f6-fbe35b57d213 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:54.523315 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1306/2631] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:06:54 2022] PUT /identity/v3/projects/b7afcb105a3c45368612aa019f475269/users/c53b17e37a794aceaa97334ddf7123c0/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:06:54.534206 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f940b-3155-4fdb-9009-a9eaddd06f51 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:54.534487 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f940b-3155-4fdb-9009-a9eaddd06f51 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:54.534765 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f940b-3155-4fdb-9009-a9eaddd06f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:54.562046 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-246f940b-3155-4fdb-9009-a9eaddd06f51 None None] MFA Rules not processed for user `c53b17e37a794aceaa97334ddf7123c0`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:06:54.563226 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-246f940b-3155-4fdb-9009-a9eaddd06f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:06:54.625511 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1326/2632] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:06:54 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:06:54.630059 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2b7a5-e259-4243-a1f6-fbe35b57d213 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:54.688457 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2b7a5-e259-4243-a1f6-fbe35b57d213 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:54.693053 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891e780-6fc3-4e3e-ac64-36f7cefbb24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:54.695128 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891e780-6fc3-4e3e-ac64-36f7cefbb24b admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:54.695128 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891e780-6fc3-4e3e-ac64-36f7cefbb24b admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:54.695128 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891e780-6fc3-4e3e-ac64-36f7cefbb24b admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:54.695128 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891e780-6fc3-4e3e-ac64-36f7cefbb24b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:54.696807 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891e780-6fc3-4e3e-ac64-36f7cefbb24b admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:54.807282 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1307/2633] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:06:54 2022] POST /identity/v3/projects => generated 363 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:06:54.811825 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f940b-3155-4fdb-9009-a9eaddd06f51 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:54.822758 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f940b-3155-4fdb-9009-a9eaddd06f51 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:54.877473 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f718d70-8a10-44a1-97a0-cd6f7051e2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:54.878124 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f718d70-8a10-44a1-97a0-cd6f7051e2e8 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:54.878428 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f718d70-8a10-44a1-97a0-cd6f7051e2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:54.878703 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f718d70-8a10-44a1-97a0-cd6f7051e2e8 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:54.879399 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f718d70-8a10-44a1-97a0-cd6f7051e2e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:54.881320 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f718d70-8a10-44a1-97a0-cd6f7051e2e8 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:54.959683 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1327/2634] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:06:54 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:06:54.963620 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891e780-6fc3-4e3e-ac64-36f7cefbb24b admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:54.974262 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891e780-6fc3-4e3e-ac64-36f7cefbb24b admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:54.979242 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d624b4a-c3f1-44ee-976b-c0420e78886e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:54.980814 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d624b4a-c3f1-44ee-976b-c0420e78886e admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:54.980814 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d624b4a-c3f1-44ee-976b-c0420e78886e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:54.981081 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d624b4a-c3f1-44ee-976b-c0420e78886e admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:54.981825 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d624b4a-c3f1-44ee-976b-c0420e78886e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:54.983404 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d624b4a-c3f1-44ee-976b-c0420e78886e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:54.993529 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1308/2635] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:06:54.997503 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f718d70-8a10-44a1-97a0-cd6f7051e2e8 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:55.007232 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f718d70-8a10-44a1-97a0-cd6f7051e2e8 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:55.012002 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c21eb-f265-4db2-8973-85cc969da0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:55.012859 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c21eb-f265-4db2-8973-85cc969da0dd admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:55.013180 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c21eb-f265-4db2-8973-85cc969da0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:55.013455 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c21eb-f265-4db2-8973-85cc969da0dd admin admin] PATH_INFO: `/v3/projects/5255b64f59854e82b61fc15ab0951ce9/users/1977e9d5eb604a1aa3942c9ea1bc7de3/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:55.028293 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c21eb-f265-4db2-8973-85cc969da0dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5255b64f59854e82b61fc15ab0951ce9, user_id=1977e9d5eb604a1aa3942c9ea1bc7de3, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:55.031013 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c21eb-f265-4db2-8973-85cc969da0dd admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:55.115486 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1328/2636] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:06:54 2022] PUT /identity/v3/projects/5255b64f59854e82b61fc15ab0951ce9/users/1977e9d5eb604a1aa3942c9ea1bc7de3/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:06:55.119484 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d624b4a-c3f1-44ee-976b-c0420e78886e admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:55.129688 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d624b4a-c3f1-44ee-976b-c0420e78886e admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:55.183361 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18deba-29ce-4cbd-a967-49f6c92a8198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:55.184021 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18deba-29ce-4cbd-a967-49f6c92a8198 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:55.184303 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18deba-29ce-4cbd-a967-49f6c92a8198 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:55.184580 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18deba-29ce-4cbd-a967-49f6c92a8198 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:55.185408 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18deba-29ce-4cbd-a967-49f6c92a8198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:55.187005 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18deba-29ce-4cbd-a967-49f6c92a8198 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:55.196377 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1309/2637] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:06:55.200633 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c21eb-f265-4db2-8973-85cc969da0dd admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:55.210814 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c21eb-f265-4db2-8973-85cc969da0dd admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:55.215918 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609800a-2069-4956-b3d3-ca2e69105d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:55.216780 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609800a-2069-4956-b3d3-ca2e69105d83 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:55.217080 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609800a-2069-4956-b3d3-ca2e69105d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:55.217368 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609800a-2069-4956-b3d3-ca2e69105d83 admin admin] PATH_INFO: `/v3/projects/5255b64f59854e82b61fc15ab0951ce9/users/1977e9d5eb604a1aa3942c9ea1bc7de3/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:55.219314 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609800a-2069-4956-b3d3-ca2e69105d83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5255b64f59854e82b61fc15ab0951ce9, user_id=1977e9d5eb604a1aa3942c9ea1bc7de3, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:55.221993 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609800a-2069-4956-b3d3-ca2e69105d83 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:55.232821 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1329/2638] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:06:55 2022] PUT /identity/v3/projects/5255b64f59854e82b61fc15ab0951ce9/users/1977e9d5eb604a1aa3942c9ea1bc7de3/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:06:55.242380 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a85ea7-2e8d-4759-893a-0d7a1bc89af6 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:55.242672 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a85ea7-2e8d-4759-893a-0d7a1bc89af6 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:55.242953 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a85ea7-2e8d-4759-893a-0d7a1bc89af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:55.268282 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-38a85ea7-2e8d-4759-893a-0d7a1bc89af6 None None] MFA Rules not processed for user `1977e9d5eb604a1aa3942c9ea1bc7de3`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:06:55.269582 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-38a85ea7-2e8d-4759-893a-0d7a1bc89af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:06:55.334692 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1310/2639] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:06:55 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:06:55.345392 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609800a-2069-4956-b3d3-ca2e69105d83 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:55.347125 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-e609800a-2069-4956-b3d3-ca2e69105d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:06:55.403664 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609800a-2069-4956-b3d3-ca2e69105d83 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:55.407229 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ddd7a-a5f2-4675-ae94-cda67bff91ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:55.407861 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ddd7a-a5f2-4675-ae94-cda67bff91ee service cinder] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:55.408141 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ddd7a-a5f2-4675-ae94-cda67bff91ee service cinder] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:55.408413 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ddd7a-a5f2-4675-ae94-cda67bff91ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:55.418520 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ddd7a-a5f2-4675-ae94-cda67bff91ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:55.419986 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ddd7a-a5f2-4675-ae94-cda67bff91ee service cinder] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:55.430223 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1330/2640] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:06:55 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:06:55.820402 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a85ea7-2e8d-4759-893a-0d7a1bc89af6 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:55.879352 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a85ea7-2e8d-4759-893a-0d7a1bc89af6 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:55.883793 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b12fe-18f8-4f41-865d-5b168bfd9f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:55.884648 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b12fe-18f8-4f41-865d-5b168bfd9f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:55.884925 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b12fe-18f8-4f41-865d-5b168bfd9f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:55.885232 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b12fe-18f8-4f41-865d-5b168bfd9f4d admin admin] PATH_INFO: `/v3/users/c53b17e37a794aceaa97334ddf7123c0` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:55.886394 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b12fe-18f8-4f41-865d-5b168bfd9f4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c53b17e37a794aceaa97334ddf7123c0)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:55.888824 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b12fe-18f8-4f41-865d-5b168bfd9f4d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:56.098877 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-dc2b12fe-18f8-4f41-865d-5b168bfd9f4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c53b17e37a794aceaa97334ddf7123c0'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:06:56.106127 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-dc2b12fe-18f8-4f41-865d-5b168bfd9f4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c53b17e37a794aceaa97334ddf7123c0'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:06:56.106779 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-dc2b12fe-18f8-4f41-865d-5b168bfd9f4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c53b17e37a794aceaa97334ddf7123c0'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:06:56.225053 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-dc2b12fe-18f8-4f41-865d-5b168bfd9f4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c53b17e37a794aceaa97334ddf7123c0'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:06:56.237139 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-dc2b12fe-18f8-4f41-865d-5b168bfd9f4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c53b17e37a794aceaa97334ddf7123c0'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:06:56.242928 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1311/2641] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:06:55 2022] DELETE /identity/v3/users/c53b17e37a794aceaa97334ddf7123c0 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:06:56.247487 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b36a03-8253-4dac-b8b8-e9f4a1868725 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:56.247963 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b36a03-8253-4dac-b8b8-e9f4a1868725 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:56.248083 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b36a03-8253-4dac-b8b8-e9f4a1868725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:56.266231 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-41b36a03-8253-4dac-b8b8-e9f4a1868725 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:06:56.267405 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-41b36a03-8253-4dac-b8b8-e9f4a1868725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:06:56.325203 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1331/2642] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:06:56.334734 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b12fe-18f8-4f41-865d-5b168bfd9f4d admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:56.336178 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-dc2b12fe-18f8-4f41-865d-5b168bfd9f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:06:56.391203 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b12fe-18f8-4f41-865d-5b168bfd9f4d admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:56.394768 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb86b0-64bc-4744-bfa3-3c949522ac07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:56.395416 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb86b0-64bc-4744-bfa3-3c949522ac07 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:56.395683 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb86b0-64bc-4744-bfa3-3c949522ac07 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:56.395959 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb86b0-64bc-4744-bfa3-3c949522ac07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:56.405338 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb86b0-64bc-4744-bfa3-3c949522ac07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:56.406759 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb86b0-64bc-4744-bfa3-3c949522ac07 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:56.415852 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1312/2643] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:06:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:06:56.803718 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b36a03-8253-4dac-b8b8-e9f4a1868725 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:56.805338 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-41b36a03-8253-4dac-b8b8-e9f4a1868725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:06:56.818608 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b36a03-8253-4dac-b8b8-e9f4a1868725 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:56.823668 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f438801-afa0-40c7-a0d2-382fe90b2e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:56.825916 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f438801-afa0-40c7-a0d2-382fe90b2e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:56.825916 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f438801-afa0-40c7-a0d2-382fe90b2e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:56.825916 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f438801-afa0-40c7-a0d2-382fe90b2e7c admin admin] PATH_INFO: `/v3/projects/b7afcb105a3c45368612aa019f475269` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:56.826534 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f438801-afa0-40c7-a0d2-382fe90b2e7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7afcb105a3c45368612aa019f475269)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:56.828305 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f438801-afa0-40c7-a0d2-382fe90b2e7c admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:56.943113 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-8f438801-afa0-40c7-a0d2-382fe90b2e7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7afcb105a3c45368612aa019f475269', 'request_id': 'req-8f438801-afa0-40c7-a0d2-382fe90b2e7c'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:06:56.949255 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-8f438801-afa0-40c7-a0d2-382fe90b2e7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7afcb105a3c45368612aa019f475269', 'request_id': 'req-8f438801-afa0-40c7-a0d2-382fe90b2e7c'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:06:57.030375 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-8f438801-afa0-40c7-a0d2-382fe90b2e7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7afcb105a3c45368612aa019f475269', 'request_id': 'req-8f438801-afa0-40c7-a0d2-382fe90b2e7c'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:06:57.040821 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-8f438801-afa0-40c7-a0d2-382fe90b2e7c admin admin] The token cache is being invalidate because project b7afcb105a3c45368612aa019f475269 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:06:57.041141 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-8f438801-afa0-40c7-a0d2-382fe90b2e7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:06:57.041771 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-8f438801-afa0-40c7-a0d2-382fe90b2e7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:06:57.043804 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1332/2644] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:06:56 2022] DELETE /identity/v3/projects/b7afcb105a3c45368612aa019f475269 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:06:57.047750 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb86b0-64bc-4744-bfa3-3c949522ac07 service neutron] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:57.057378 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb86b0-64bc-4744-bfa3-3c949522ac07 service neutron] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:57.117879 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9973a-7202-4b78-b920-dd4a219f8094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:57.118722 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9973a-7202-4b78-b920-dd4a219f8094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:57.119007 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9973a-7202-4b78-b920-dd4a219f8094 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:57.119284 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9973a-7202-4b78-b920-dd4a219f8094 admin admin] PATH_INFO: `/v3/users/1977e9d5eb604a1aa3942c9ea1bc7de3` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:57.120463 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9973a-7202-4b78-b920-dd4a219f8094 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1977e9d5eb604a1aa3942c9ea1bc7de3)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:57.122995 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9973a-7202-4b78-b920-dd4a219f8094 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:57.335008 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-b4b9973a-7202-4b78-b920-dd4a219f8094 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1977e9d5eb604a1aa3942c9ea1bc7de3'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:06:57.343164 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-b4b9973a-7202-4b78-b920-dd4a219f8094 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1977e9d5eb604a1aa3942c9ea1bc7de3'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:06:57.343840 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-b4b9973a-7202-4b78-b920-dd4a219f8094 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1977e9d5eb604a1aa3942c9ea1bc7de3'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:06:57.385409 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-b4b9973a-7202-4b78-b920-dd4a219f8094 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1977e9d5eb604a1aa3942c9ea1bc7de3'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:06:57.398404 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-b4b9973a-7202-4b78-b920-dd4a219f8094 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1977e9d5eb604a1aa3942c9ea1bc7de3'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:06:57.405000 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1313/2645] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:06:57 2022] DELETE /identity/v3/users/1977e9d5eb604a1aa3942c9ea1bc7de3 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:06:57.862462 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f438801-afa0-40c7-a0d2-382fe90b2e7c admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:57.862462 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-8f438801-afa0-40c7-a0d2-382fe90b2e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:06:57.875132 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f438801-afa0-40c7-a0d2-382fe90b2e7c admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:57.931843 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef3ace-bc0f-406b-896b-538828c6b594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:57.932699 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef3ace-bc0f-406b-896b-538828c6b594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:57.932976 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef3ace-bc0f-406b-896b-538828c6b594 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:57.933778 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef3ace-bc0f-406b-896b-538828c6b594 admin admin] PATH_INFO: `/v3/projects/5255b64f59854e82b61fc15ab0951ce9` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:57.935093 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef3ace-bc0f-406b-896b-538828c6b594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5255b64f59854e82b61fc15ab0951ce9)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:57.937168 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef3ace-bc0f-406b-896b-538828c6b594 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:58.052719 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-0aef3ace-bc0f-406b-896b-538828c6b594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5255b64f59854e82b61fc15ab0951ce9', 'request_id': 'req-0aef3ace-bc0f-406b-896b-538828c6b594'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:06:58.059474 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-0aef3ace-bc0f-406b-896b-538828c6b594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5255b64f59854e82b61fc15ab0951ce9', 'request_id': 'req-0aef3ace-bc0f-406b-896b-538828c6b594'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:06:58.139400 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-0aef3ace-bc0f-406b-896b-538828c6b594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5255b64f59854e82b61fc15ab0951ce9', 'request_id': 'req-0aef3ace-bc0f-406b-896b-538828c6b594'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:06:58.150330 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-0aef3ace-bc0f-406b-896b-538828c6b594 admin admin] The token cache is being invalidate because project 5255b64f59854e82b61fc15ab0951ce9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:06:58.150611 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-0aef3ace-bc0f-406b-896b-538828c6b594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:06:58.151257 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-0aef3ace-bc0f-406b-896b-538828c6b594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:06:58.153299 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1333/2646] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:06:57 2022] DELETE /identity/v3/projects/5255b64f59854e82b61fc15ab0951ce9 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:06:58.158758 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3186a-17aa-4348-add9-9b2e0fe2cf65 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:58.159259 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3186a-17aa-4348-add9-9b2e0fe2cf65 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:58.159367 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3186a-17aa-4348-add9-9b2e0fe2cf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:58.178657 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-21b3186a-17aa-4348-add9-9b2e0fe2cf65 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:06:58.179848 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-21b3186a-17aa-4348-add9-9b2e0fe2cf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:06:58.364836 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1314/2647] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:06:58.373460 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eececee-ffa6-47f7-859b-40c45061a6a9 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:58.373749 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eececee-ffa6-47f7-859b-40c45061a6a9 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:58.374023 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eececee-ffa6-47f7-859b-40c45061a6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:58.391690 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-3eececee-ffa6-47f7-859b-40c45061a6a9 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:06:58.392802 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-3eececee-ffa6-47f7-859b-40c45061a6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:06:58.400454 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1334/2648] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:06:58.404476 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3186a-17aa-4348-add9-9b2e0fe2cf65 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:58.413616 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3186a-17aa-4348-add9-9b2e0fe2cf65 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:58.418679 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6057836-18a1-457e-bae6-d9980ad2717e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:58.419313 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6057836-18a1-457e-bae6-d9980ad2717e admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:58.419591 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6057836-18a1-457e-bae6-d9980ad2717e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:58.419862 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6057836-18a1-457e-bae6-d9980ad2717e admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:58.420581 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6057836-18a1-457e-bae6-d9980ad2717e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:06:58.420880 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6057836-18a1-457e-bae6-d9980ad2717e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:58.422512 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6057836-18a1-457e-bae6-d9980ad2717e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:58.434273 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1315/2649] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 15:06:58.438283 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eececee-ffa6-47f7-859b-40c45061a6a9 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:58.447246 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eececee-ffa6-47f7-859b-40c45061a6a9 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:58.451956 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279352c-97a6-443d-8e0f-b206bf1821e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:58.452585 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279352c-97a6-443d-8e0f-b206bf1821e9 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:58.452865 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279352c-97a6-443d-8e0f-b206bf1821e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:58.453193 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279352c-97a6-443d-8e0f-b206bf1821e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:58.453895 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a279352c-97a6-443d-8e0f-b206bf1821e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:58.455778 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a279352c-97a6-443d-8e0f-b206bf1821e9 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:58.528856 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1335/2650] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:06:58 2022] POST /identity/v3/projects => generated 367 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:06:58.532942 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6057836-18a1-457e-bae6-d9980ad2717e admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:58.543305 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6057836-18a1-457e-bae6-d9980ad2717e admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:58.595562 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a3e03-2df1-4425-8cb4-30499d05ea4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:58.596358 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a3e03-2df1-4425-8cb4-30499d05ea4f admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:58.596517 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a3e03-2df1-4425-8cb4-30499d05ea4f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:58.596782 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a3e03-2df1-4425-8cb4-30499d05ea4f admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:58.597515 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a3e03-2df1-4425-8cb4-30499d05ea4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:58.599398 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a3e03-2df1-4425-8cb4-30499d05ea4f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:58.690297 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1316/2651] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:06:58 2022] POST /identity/v3/users => generated 284 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:06:58.695393 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279352c-97a6-443d-8e0f-b206bf1821e9 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:58.707573 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279352c-97a6-443d-8e0f-b206bf1821e9 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:58.712433 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fba85-8678-415f-99cb-9107d5efc7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:58.713107 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fba85-8678-415f-99cb-9107d5efc7ee admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:58.713399 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fba85-8678-415f-99cb-9107d5efc7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:58.713676 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fba85-8678-415f-99cb-9107d5efc7ee admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:58.714430 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95fba85-8678-415f-99cb-9107d5efc7ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:58.716524 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95fba85-8678-415f-99cb-9107d5efc7ee admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:58.727388 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1336/2652] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:06:58.732065 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a3e03-2df1-4425-8cb4-30499d05ea4f admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:58.742056 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a3e03-2df1-4425-8cb4-30499d05ea4f admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:58.746723 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4dd48-7cb3-4a28-a270-c41347481bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:58.747419 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4dd48-7cb3-4a28-a270-c41347481bac admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:58.747704 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4dd48-7cb3-4a28-a270-c41347481bac admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:58.747981 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4dd48-7cb3-4a28-a270-c41347481bac admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:58.748716 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4dd48-7cb3-4a28-a270-c41347481bac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:58.750361 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4dd48-7cb3-4a28-a270-c41347481bac admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:58.759904 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1317/2653] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:06:58.763834 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fba85-8678-415f-99cb-9107d5efc7ee admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:58.773469 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fba85-8678-415f-99cb-9107d5efc7ee admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:58.778571 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae52ad2-0797-4e61-90ac-ad3bd23969cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:58.779431 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae52ad2-0797-4e61-90ac-ad3bd23969cd admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:58.779716 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae52ad2-0797-4e61-90ac-ad3bd23969cd admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:58.779992 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae52ad2-0797-4e61-90ac-ad3bd23969cd admin admin] PATH_INFO: `/v3/projects/6405756f0cd640b89365e5cf31682ecb/users/5d3d13bf843d49a0a6c20fc9ca8d52a5/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:58.794439 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae52ad2-0797-4e61-90ac-ad3bd23969cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6405756f0cd640b89365e5cf31682ecb, user_id=5d3d13bf843d49a0a6c20fc9ca8d52a5, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:58.797046 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae52ad2-0797-4e61-90ac-ad3bd23969cd admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:58.879973 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1337/2654] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:06:58 2022] PUT /identity/v3/projects/6405756f0cd640b89365e5cf31682ecb/users/5d3d13bf843d49a0a6c20fc9ca8d52a5/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:06:58.891316 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6955f34-ac29-4bef-8d87-b40135cfa220 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:58.891617 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6955f34-ac29-4bef-8d87-b40135cfa220 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:58.891896 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6955f34-ac29-4bef-8d87-b40135cfa220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:58.917572 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-b6955f34-ac29-4bef-8d87-b40135cfa220 None None] MFA Rules not processed for user `5d3d13bf843d49a0a6c20fc9ca8d52a5`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:06:58.919399 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-b6955f34-ac29-4bef-8d87-b40135cfa220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:06:58.978968 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1318/2655] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:06:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:06:58.983926 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae52ad2-0797-4e61-90ac-ad3bd23969cd admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:59.050116 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae52ad2-0797-4e61-90ac-ad3bd23969cd admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:59.054993 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c408b6-6b2a-48e3-8264-91b9eae947d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:59.055642 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c408b6-6b2a-48e3-8264-91b9eae947d6 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:59.055921 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c408b6-6b2a-48e3-8264-91b9eae947d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:59.056192 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c408b6-6b2a-48e3-8264-91b9eae947d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:59.056885 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c408b6-6b2a-48e3-8264-91b9eae947d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:59.058853 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c408b6-6b2a-48e3-8264-91b9eae947d6 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:59.186343 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1338/2656] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:06:58 2022] POST /identity/v3/projects => generated 367 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:06:59.190306 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6955f34-ac29-4bef-8d87-b40135cfa220 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:59.201109 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6955f34-ac29-4bef-8d87-b40135cfa220 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:59.253147 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbddbbb0-ddd8-4ffe-a6dc-38541870dd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:59.253749 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbddbbb0-ddd8-4ffe-a6dc-38541870dd85 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:59.254033 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbddbbb0-ddd8-4ffe-a6dc-38541870dd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:59.254311 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbddbbb0-ddd8-4ffe-a6dc-38541870dd85 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:59.255011 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbddbbb0-ddd8-4ffe-a6dc-38541870dd85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:59.256997 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbddbbb0-ddd8-4ffe-a6dc-38541870dd85 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:59.382319 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1319/2657] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:06:59 2022] POST /identity/v3/users => generated 290 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:06:59.386261 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c408b6-6b2a-48e3-8264-91b9eae947d6 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:59.398483 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c408b6-6b2a-48e3-8264-91b9eae947d6 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:59.401479 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e2c9b-3b0d-4439-ab5a-a834301c7fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:59.402798 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e2c9b-3b0d-4439-ab5a-a834301c7fcb admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:59.403078 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e2c9b-3b0d-4439-ab5a-a834301c7fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:59.403351 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e2c9b-3b0d-4439-ab5a-a834301c7fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:59.404079 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e2c9b-3b0d-4439-ab5a-a834301c7fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:59.405720 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e2c9b-3b0d-4439-ab5a-a834301c7fcb admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:59.415811 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1339/2658] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:06:59.419752 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbddbbb0-ddd8-4ffe-a6dc-38541870dd85 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:59.429271 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbddbbb0-ddd8-4ffe-a6dc-38541870dd85 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:59.434220 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb791bb-eb55-4271-b91b-8bf4ace22437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:59.435078 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb791bb-eb55-4271-b91b-8bf4ace22437 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:59.435352 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb791bb-eb55-4271-b91b-8bf4ace22437 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:59.435621 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb791bb-eb55-4271-b91b-8bf4ace22437 admin admin] PATH_INFO: `/v3/projects/10d17e1bcd3b44078e43d754ce6d44dd/users/497e5d23a8ac44d18725b8c315717bff/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:59.450063 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb791bb-eb55-4271-b91b-8bf4ace22437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d17e1bcd3b44078e43d754ce6d44dd, user_id=497e5d23a8ac44d18725b8c315717bff, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:59.452671 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb791bb-eb55-4271-b91b-8bf4ace22437 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:59.539307 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1320/2659] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:06:59 2022] PUT /identity/v3/projects/10d17e1bcd3b44078e43d754ce6d44dd/users/497e5d23a8ac44d18725b8c315717bff/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:06:59.543265 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e2c9b-3b0d-4439-ab5a-a834301c7fcb admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:59.553099 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e2c9b-3b0d-4439-ab5a-a834301c7fcb admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:59.608297 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ef110-3c45-4584-a03c-e0ac9225c9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:59.608951 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ef110-3c45-4584-a03c-e0ac9225c9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:59.609269 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ef110-3c45-4584-a03c-e0ac9225c9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:59.609556 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ef110-3c45-4584-a03c-e0ac9225c9a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:59.610278 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ef110-3c45-4584-a03c-e0ac9225c9a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:59.611871 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ef110-3c45-4584-a03c-e0ac9225c9a7 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:59.621894 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1340/2660] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:06:59.625886 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb791bb-eb55-4271-b91b-8bf4ace22437 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:59.635689 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb791bb-eb55-4271-b91b-8bf4ace22437 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:59.640917 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38322e-3f6c-48d3-908b-7820127a2413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:59.641816 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38322e-3f6c-48d3-908b-7820127a2413 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:59.642098 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38322e-3f6c-48d3-908b-7820127a2413 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:59.642370 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38322e-3f6c-48d3-908b-7820127a2413 admin admin] PATH_INFO: `/v3/projects/10d17e1bcd3b44078e43d754ce6d44dd/users/497e5d23a8ac44d18725b8c315717bff/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:59.644378 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38322e-3f6c-48d3-908b-7820127a2413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d17e1bcd3b44078e43d754ce6d44dd, user_id=497e5d23a8ac44d18725b8c315717bff, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:59.647037 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38322e-3f6c-48d3-908b-7820127a2413 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:59.657394 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1321/2661] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:06:59 2022] PUT /identity/v3/projects/10d17e1bcd3b44078e43d754ce6d44dd/users/497e5d23a8ac44d18725b8c315717bff/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:06:59.667337 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fb282-6d0b-4a3e-bdc3-753ac8dd1cd0 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:59.667628 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fb282-6d0b-4a3e-bdc3-753ac8dd1cd0 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:59.667906 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fb282-6d0b-4a3e-bdc3-753ac8dd1cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:59.693720 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-901fb282-6d0b-4a3e-bdc3-753ac8dd1cd0 None None] MFA Rules not processed for user `497e5d23a8ac44d18725b8c315717bff`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:06:59.694914 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-901fb282-6d0b-4a3e-bdc3-753ac8dd1cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:06:59.761327 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1341/2662] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:06:59 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:06:59.771776 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38322e-3f6c-48d3-908b-7820127a2413 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:59.773521 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-6f38322e-3f6c-48d3-908b-7820127a2413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:06:59.828284 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38322e-3f6c-48d3-908b-7820127a2413 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:06:59.831976 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b1bc2-bd3f-40c3-8586-89d6b83bebf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:06:59.845187 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b1bc2-bd3f-40c3-8586-89d6b83bebf2 service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:06:59.845187 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b1bc2-bd3f-40c3-8586-89d6b83bebf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:06:59.845187 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b1bc2-bd3f-40c3-8586-89d6b83bebf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:06:59.845187 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b1bc2-bd3f-40c3-8586-89d6b83bebf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:06:59.845187 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b1bc2-bd3f-40c3-8586-89d6b83bebf2 service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:06:59.853331 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1322/2663] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:06:59 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:06:59.994468 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fb282-6d0b-4a3e-bdc3-753ac8dd1cd0 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:06:59.996585 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-901fb282-6d0b-4a3e-bdc3-753ac8dd1cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:00.008522 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fb282-6d0b-4a3e-bdc3-753ac8dd1cd0 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:00.012239 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e041a70-3caf-4428-96ce-3aa41ee39646 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:00.012849 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e041a70-3caf-4428-96ce-3aa41ee39646 service cinder] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:00.013159 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e041a70-3caf-4428-96ce-3aa41ee39646 service cinder] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:00.013439 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e041a70-3caf-4428-96ce-3aa41ee39646 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:00.068432 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e041a70-3caf-4428-96ce-3aa41ee39646 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:00.069913 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e041a70-3caf-4428-96ce-3aa41ee39646 service cinder] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:00.078838 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1342/2664] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:06:59 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:07:03.549056 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdf9f2-7846-421e-b768-c86e76b65068 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:03.553139 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdf9f2-7846-421e-b768-c86e76b65068 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:03.553139 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdf9f2-7846-421e-b768-c86e76b65068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:03.567565 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-06bdf9f2-7846-421e-b768-c86e76b65068 None None] MFA Rules not processed for user `e1578e40c006442ca632381e242d35bf`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:07:03.568757 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-06bdf9f2-7846-421e-b768-c86e76b65068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:03.620590 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1323/2665] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:07:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:07:04.887299 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e041a70-3caf-4428-96ce-3aa41ee39646 service cinder] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:04.948003 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e041a70-3caf-4428-96ce-3aa41ee39646 service cinder] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:04.953280 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf1027-e537-4997-8ad6-ef8f08fe5653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:04.954139 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf1027-e537-4997-8ad6-ef8f08fe5653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:04.954416 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf1027-e537-4997-8ad6-ef8f08fe5653 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:04.954685 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf1027-e537-4997-8ad6-ef8f08fe5653 admin admin] PATH_INFO: `/v3/users/5d3d13bf843d49a0a6c20fc9ca8d52a5` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:04.955860 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf1027-e537-4997-8ad6-ef8f08fe5653 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d3d13bf843d49a0a6c20fc9ca8d52a5)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:04.957886 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf1027-e537-4997-8ad6-ef8f08fe5653 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:05.130225 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-2fbf1027-e537-4997-8ad6-ef8f08fe5653 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d3d13bf843d49a0a6c20fc9ca8d52a5'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:05.137175 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-2fbf1027-e537-4997-8ad6-ef8f08fe5653 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d3d13bf843d49a0a6c20fc9ca8d52a5'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:05.137846 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-2fbf1027-e537-4997-8ad6-ef8f08fe5653 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d3d13bf843d49a0a6c20fc9ca8d52a5'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:05.138456 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-2fbf1027-e537-4997-8ad6-ef8f08fe5653 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d3d13bf843d49a0a6c20fc9ca8d52a5'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:05.236466 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-2fbf1027-e537-4997-8ad6-ef8f08fe5653 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d3d13bf843d49a0a6c20fc9ca8d52a5'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:05.254756 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1343/2666] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:07:04 2022] DELETE /identity/v3/users/5d3d13bf843d49a0a6c20fc9ca8d52a5 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:07:05.259359 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3fc87-eba1-4ce0-a9b0-09c349b496cc None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:05.262277 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3fc87-eba1-4ce0-a9b0-09c349b496cc None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:05.262277 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3fc87-eba1-4ce0-a9b0-09c349b496cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:05.277133 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-f9d3fc87-eba1-4ce0-a9b0-09c349b496cc None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:07:05.278323 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-f9d3fc87-eba1-4ce0-a9b0-09c349b496cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:05.337443 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1324/2667] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:07:05.347138 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf1027-e537-4997-8ad6-ef8f08fe5653 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:05.349333 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-2fbf1027-e537-4997-8ad6-ef8f08fe5653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:05.409962 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf1027-e537-4997-8ad6-ef8f08fe5653 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:05.413630 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9d999-1b47-4afd-b0e1-9a722950e92a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:05.414351 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9d999-1b47-4afd-b0e1-9a722950e92a service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:05.414710 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9d999-1b47-4afd-b0e1-9a722950e92a service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:05.415158 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9d999-1b47-4afd-b0e1-9a722950e92a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:05.425285 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9d999-1b47-4afd-b0e1-9a722950e92a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:05.426746 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9d999-1b47-4afd-b0e1-9a722950e92a service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:05.436439 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1344/2668] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:07:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:07:05.849217 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3fc87-eba1-4ce0-a9b0-09c349b496cc None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:05.851278 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-f9d3fc87-eba1-4ce0-a9b0-09c349b496cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:05.862959 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3fc87-eba1-4ce0-a9b0-09c349b496cc None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:05.867565 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65799077-c44d-425a-a048-ae5fe2707e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:05.868419 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65799077-c44d-425a-a048-ae5fe2707e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:05.868696 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65799077-c44d-425a-a048-ae5fe2707e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:05.868968 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65799077-c44d-425a-a048-ae5fe2707e08 admin admin] PATH_INFO: `/v3/projects/6405756f0cd640b89365e5cf31682ecb` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:05.870221 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65799077-c44d-425a-a048-ae5fe2707e08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6405756f0cd640b89365e5cf31682ecb)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:05.872208 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65799077-c44d-425a-a048-ae5fe2707e08 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:05.973107 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-65799077-c44d-425a-a048-ae5fe2707e08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6405756f0cd640b89365e5cf31682ecb', 'request_id': 'req-65799077-c44d-425a-a048-ae5fe2707e08'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:05.979235 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-65799077-c44d-425a-a048-ae5fe2707e08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6405756f0cd640b89365e5cf31682ecb', 'request_id': 'req-65799077-c44d-425a-a048-ae5fe2707e08'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:05.984460 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-65799077-c44d-425a-a048-ae5fe2707e08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6405756f0cd640b89365e5cf31682ecb', 'request_id': 'req-65799077-c44d-425a-a048-ae5fe2707e08'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:06.046830 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-65799077-c44d-425a-a048-ae5fe2707e08 admin admin] The token cache is being invalidate because project 6405756f0cd640b89365e5cf31682ecb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:07:06.047117 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-65799077-c44d-425a-a048-ae5fe2707e08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:06.047745 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-65799077-c44d-425a-a048-ae5fe2707e08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:06.049292 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1325/2669] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:07:05 2022] DELETE /identity/v3/projects/6405756f0cd640b89365e5cf31682ecb => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:07:06.053286 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9d999-1b47-4afd-b0e1-9a722950e92a service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:06.062814 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9d999-1b47-4afd-b0e1-9a722950e92a service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:06.117566 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fe0ef-4172-471f-887c-6611d6b278c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:06.118435 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fe0ef-4172-471f-887c-6611d6b278c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:06.118719 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fe0ef-4172-471f-887c-6611d6b278c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:06.118996 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fe0ef-4172-471f-887c-6611d6b278c2 admin admin] PATH_INFO: `/v3/users/497e5d23a8ac44d18725b8c315717bff` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:06.120182 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87fe0ef-4172-471f-887c-6611d6b278c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=497e5d23a8ac44d18725b8c315717bff)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:06.122161 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87fe0ef-4172-471f-887c-6611d6b278c2 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:06.455297 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-d87fe0ef-4172-471f-887c-6611d6b278c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '497e5d23a8ac44d18725b8c315717bff'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:06.462544 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-d87fe0ef-4172-471f-887c-6611d6b278c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '497e5d23a8ac44d18725b8c315717bff'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:06.463319 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-d87fe0ef-4172-471f-887c-6611d6b278c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '497e5d23a8ac44d18725b8c315717bff'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:06.464038 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-d87fe0ef-4172-471f-887c-6611d6b278c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '497e5d23a8ac44d18725b8c315717bff'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:06.545223 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-d87fe0ef-4172-471f-887c-6611d6b278c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '497e5d23a8ac44d18725b8c315717bff'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:06.563311 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1345/2670] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:07:06 2022] DELETE /identity/v3/users/497e5d23a8ac44d18725b8c315717bff => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:07:07.006954 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65799077-c44d-425a-a048-ae5fe2707e08 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:07.008446 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-65799077-c44d-425a-a048-ae5fe2707e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:07.021325 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65799077-c44d-425a-a048-ae5fe2707e08 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:07.075811 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16b004-1c9b-4ac8-a8c7-475fddbb64a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:07.093496 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16b004-1c9b-4ac8-a8c7-475fddbb64a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:07.093496 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16b004-1c9b-4ac8-a8c7-475fddbb64a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:07.093496 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16b004-1c9b-4ac8-a8c7-475fddbb64a1 admin admin] PATH_INFO: `/v3/projects/10d17e1bcd3b44078e43d754ce6d44dd` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:07.093496 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16b004-1c9b-4ac8-a8c7-475fddbb64a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10d17e1bcd3b44078e43d754ce6d44dd)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:07.093496 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16b004-1c9b-4ac8-a8c7-475fddbb64a1 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:07.263361 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ac16b004-1c9b-4ac8-a8c7-475fddbb64a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10d17e1bcd3b44078e43d754ce6d44dd', 'request_id': 'req-ac16b004-1c9b-4ac8-a8c7-475fddbb64a1'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:07.272589 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ac16b004-1c9b-4ac8-a8c7-475fddbb64a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10d17e1bcd3b44078e43d754ce6d44dd', 'request_id': 'req-ac16b004-1c9b-4ac8-a8c7-475fddbb64a1'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:07.286013 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ac16b004-1c9b-4ac8-a8c7-475fddbb64a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10d17e1bcd3b44078e43d754ce6d44dd', 'request_id': 'req-ac16b004-1c9b-4ac8-a8c7-475fddbb64a1'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:07.384778 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ac16b004-1c9b-4ac8-a8c7-475fddbb64a1 admin admin] The token cache is being invalidate because project 10d17e1bcd3b44078e43d754ce6d44dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:07:07.385086 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ac16b004-1c9b-4ac8-a8c7-475fddbb64a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:07.385721 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ac16b004-1c9b-4ac8-a8c7-475fddbb64a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:07.387923 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1326/2671] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:07:07 2022] DELETE /identity/v3/projects/10d17e1bcd3b44078e43d754ce6d44dd => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:07:07.394130 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb86e7-bc2a-43c4-aa10-aabfe10eed35 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:07.394635 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb86e7-bc2a-43c4-aa10-aabfe10eed35 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:07.394750 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb86e7-bc2a-43c4-aa10-aabfe10eed35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:07.412777 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-d8fb86e7-bc2a-43c4-aa10-aabfe10eed35 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:07:07.414436 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-d8fb86e7-bc2a-43c4-aa10-aabfe10eed35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:07.478430 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1346/2672] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:07:07.487911 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc087fd0-e727-4ba0-aa8b-e4450c99731f None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:07.487911 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc087fd0-e727-4ba0-aa8b-e4450c99731f None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:07.488238 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc087fd0-e727-4ba0-aa8b-e4450c99731f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:07.517330 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-dc087fd0-e727-4ba0-aa8b-e4450c99731f None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:07:07.518299 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-dc087fd0-e727-4ba0-aa8b-e4450c99731f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:07.531019 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1327/2673] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:07:07.533933 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb86e7-bc2a-43c4-aa10-aabfe10eed35 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:07.548521 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb86e7-bc2a-43c4-aa10-aabfe10eed35 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:07.558457 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e3ebb-c7b0-4587-9966-b644fd765054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:07.559407 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e3ebb-c7b0-4587-9966-b644fd765054 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:07.559407 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e3ebb-c7b0-4587-9966-b644fd765054 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:07.560201 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e3ebb-c7b0-4587-9966-b644fd765054 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:07.560950 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e3ebb-c7b0-4587-9966-b644fd765054 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:07:07.561314 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e3ebb-c7b0-4587-9966-b644fd765054 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:07.562928 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e3ebb-c7b0-4587-9966-b644fd765054 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:07.581815 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1347/2674] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 15:07:07.583268 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc087fd0-e727-4ba0-aa8b-e4450c99731f None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:07.594769 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc087fd0-e727-4ba0-aa8b-e4450c99731f None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:07.599643 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b8ebb-bc02-46e6-9f6b-220af6ba0379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:07.600290 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b8ebb-bc02-46e6-9f6b-220af6ba0379 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:07.600610 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b8ebb-bc02-46e6-9f6b-220af6ba0379 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:07.600887 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b8ebb-bc02-46e6-9f6b-220af6ba0379 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:07.601613 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b8ebb-bc02-46e6-9f6b-220af6ba0379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:07.606506 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b8ebb-bc02-46e6-9f6b-220af6ba0379 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:07.733508 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1328/2675] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:07:07 2022] POST /identity/v3/projects => generated 393 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:07:07.737735 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e3ebb-c7b0-4587-9966-b644fd765054 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:07.748106 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e3ebb-c7b0-4587-9966-b644fd765054 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:07.803629 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8893360-b5ca-4c4c-8059-74f31f039548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:07.804216 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8893360-b5ca-4c4c-8059-74f31f039548 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:07.804503 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8893360-b5ca-4c4c-8059-74f31f039548 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:07.804778 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8893360-b5ca-4c4c-8059-74f31f039548 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:07.805547 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8893360-b5ca-4c4c-8059-74f31f039548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:07.807690 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8893360-b5ca-4c4c-8059-74f31f039548 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:07.915083 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1348/2676] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:07:07 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:07:07.919931 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b8ebb-bc02-46e6-9f6b-220af6ba0379 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:07.931867 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b8ebb-bc02-46e6-9f6b-220af6ba0379 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:07.937376 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd748c4b-0a48-4b88-ad66-89357ffa1cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:07.939651 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd748c4b-0a48-4b88-ad66-89357ffa1cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:07.939651 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd748c4b-0a48-4b88-ad66-89357ffa1cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:07.939651 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd748c4b-0a48-4b88-ad66-89357ffa1cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:07.939651 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd748c4b-0a48-4b88-ad66-89357ffa1cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:07.940991 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd748c4b-0a48-4b88-ad66-89357ffa1cb2 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:07.953982 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1329/2677] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:07:07.958380 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8893360-b5ca-4c4c-8059-74f31f039548 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:07.968656 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8893360-b5ca-4c4c-8059-74f31f039548 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:07.973551 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e446e66-7e81-40ff-9993-723ec0c6cdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:07.974203 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e446e66-7e81-40ff-9993-723ec0c6cdf0 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:07.974483 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e446e66-7e81-40ff-9993-723ec0c6cdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:07.974757 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e446e66-7e81-40ff-9993-723ec0c6cdf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:07.975494 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e446e66-7e81-40ff-9993-723ec0c6cdf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:07.977370 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e446e66-7e81-40ff-9993-723ec0c6cdf0 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:07.987717 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1349/2678] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:07:07.992265 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd748c4b-0a48-4b88-ad66-89357ffa1cb2 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:08.005889 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd748c4b-0a48-4b88-ad66-89357ffa1cb2 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:08.010502 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c090c-71a1-44bb-9d29-29dd7417c9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:08.011380 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c090c-71a1-44bb-9d29-29dd7417c9a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:08.012232 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c090c-71a1-44bb-9d29-29dd7417c9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:08.012656 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c090c-71a1-44bb-9d29-29dd7417c9a8 admin admin] PATH_INFO: `/v3/projects/149e87c167754232a0b52d8f8fb076c4/users/d2292a50b63c4bbaa58269ee5938451a/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:08.029004 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c090c-71a1-44bb-9d29-29dd7417c9a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=149e87c167754232a0b52d8f8fb076c4, user_id=d2292a50b63c4bbaa58269ee5938451a, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:08.031660 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c090c-71a1-44bb-9d29-29dd7417c9a8 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:08.105938 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1330/2679] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:07:07 2022] PUT /identity/v3/projects/149e87c167754232a0b52d8f8fb076c4/users/d2292a50b63c4bbaa58269ee5938451a/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:07:08.117512 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef6071-d4ae-4045-81f9-e1a9d893ad70 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:08.117804 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef6071-d4ae-4045-81f9-e1a9d893ad70 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:08.118083 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef6071-d4ae-4045-81f9-e1a9d893ad70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:08.145450 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-ebef6071-d4ae-4045-81f9-e1a9d893ad70 None None] MFA Rules not processed for user `d2292a50b63c4bbaa58269ee5938451a`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:07:08.160057 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-ebef6071-d4ae-4045-81f9-e1a9d893ad70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:08.208563 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1350/2680] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:07:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:07:08.213050 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c090c-71a1-44bb-9d29-29dd7417c9a8 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:08.272376 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c090c-71a1-44bb-9d29-29dd7417c9a8 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:08.277264 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd43971-d476-465c-8e3c-e68d18fa7acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:08.277942 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd43971-d476-465c-8e3c-e68d18fa7acf admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:08.278227 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd43971-d476-465c-8e3c-e68d18fa7acf admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:08.278510 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd43971-d476-465c-8e3c-e68d18fa7acf admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:08.279461 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd43971-d476-465c-8e3c-e68d18fa7acf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:08.283086 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd43971-d476-465c-8e3c-e68d18fa7acf admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:08.398900 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1331/2681] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:07:08 2022] POST /identity/v3/projects => generated 393 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:07:08.403544 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef6071-d4ae-4045-81f9-e1a9d893ad70 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:08.414821 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef6071-d4ae-4045-81f9-e1a9d893ad70 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:08.472937 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87321189-b125-485f-a4b5-ac90a8712064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:08.473690 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87321189-b125-485f-a4b5-ac90a8712064 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:08.474147 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87321189-b125-485f-a4b5-ac90a8712064 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:08.474436 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87321189-b125-485f-a4b5-ac90a8712064 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:08.475147 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87321189-b125-485f-a4b5-ac90a8712064 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:08.477354 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87321189-b125-485f-a4b5-ac90a8712064 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:08.583515 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1351/2682] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:07:08 2022] POST /identity/v3/users => generated 303 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:07:08.587486 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd43971-d476-465c-8e3c-e68d18fa7acf admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:08.598204 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd43971-d476-465c-8e3c-e68d18fa7acf admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:08.603142 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f96753-37c8-4cdf-b99b-f4da31f591e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:08.603815 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f96753-37c8-4cdf-b99b-f4da31f591e1 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:08.604081 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f96753-37c8-4cdf-b99b-f4da31f591e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:08.604365 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f96753-37c8-4cdf-b99b-f4da31f591e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:08.605130 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f96753-37c8-4cdf-b99b-f4da31f591e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:08.607347 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f96753-37c8-4cdf-b99b-f4da31f591e1 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:08.617767 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1332/2683] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:07:08.621930 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87321189-b125-485f-a4b5-ac90a8712064 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:08.633877 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87321189-b125-485f-a4b5-ac90a8712064 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:08.638930 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9f16d-cc0e-4638-884a-64d2fd61b972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:08.639891 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9f16d-cc0e-4638-884a-64d2fd61b972 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:08.640187 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9f16d-cc0e-4638-884a-64d2fd61b972 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:08.640476 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9f16d-cc0e-4638-884a-64d2fd61b972 admin admin] PATH_INFO: `/v3/projects/76b8833dfe1f4e8b8c1cb35cb035d4e9/users/8b29508991804967a37e54b0c9ae3d76/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:08.655681 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9f16d-cc0e-4638-884a-64d2fd61b972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b8833dfe1f4e8b8c1cb35cb035d4e9, user_id=8b29508991804967a37e54b0c9ae3d76, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:08.658434 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9f16d-cc0e-4638-884a-64d2fd61b972 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:08.739734 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1352/2684] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:07:08 2022] PUT /identity/v3/projects/76b8833dfe1f4e8b8c1cb35cb035d4e9/users/8b29508991804967a37e54b0c9ae3d76/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:07:08.744229 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f96753-37c8-4cdf-b99b-f4da31f591e1 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:08.754157 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f96753-37c8-4cdf-b99b-f4da31f591e1 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:08.808323 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771ffbe-1bd2-4ed7-9b0a-052d99c31c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:08.809002 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771ffbe-1bd2-4ed7-9b0a-052d99c31c99 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:08.809320 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771ffbe-1bd2-4ed7-9b0a-052d99c31c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:08.809597 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771ffbe-1bd2-4ed7-9b0a-052d99c31c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:08.810330 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771ffbe-1bd2-4ed7-9b0a-052d99c31c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:08.811915 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771ffbe-1bd2-4ed7-9b0a-052d99c31c99 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:08.821722 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1333/2685] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:07:08.826401 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9f16d-cc0e-4638-884a-64d2fd61b972 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:08.837013 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9f16d-cc0e-4638-884a-64d2fd61b972 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:08.842507 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969a2f7-ee30-4e7c-b2a5-5b2e632a6414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:08.843386 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969a2f7-ee30-4e7c-b2a5-5b2e632a6414 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:08.843673 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969a2f7-ee30-4e7c-b2a5-5b2e632a6414 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:08.844050 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969a2f7-ee30-4e7c-b2a5-5b2e632a6414 admin admin] PATH_INFO: `/v3/projects/76b8833dfe1f4e8b8c1cb35cb035d4e9/users/8b29508991804967a37e54b0c9ae3d76/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:08.845963 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969a2f7-ee30-4e7c-b2a5-5b2e632a6414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b8833dfe1f4e8b8c1cb35cb035d4e9, user_id=8b29508991804967a37e54b0c9ae3d76, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:08.848594 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969a2f7-ee30-4e7c-b2a5-5b2e632a6414 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:08.860552 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1353/2686] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:07:08 2022] PUT /identity/v3/projects/76b8833dfe1f4e8b8c1cb35cb035d4e9/users/8b29508991804967a37e54b0c9ae3d76/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:07:08.870962 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766b9a6-621e-4d53-b8c5-cb6636818ade None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:08.871253 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766b9a6-621e-4d53-b8c5-cb6636818ade None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:08.871529 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766b9a6-621e-4d53-b8c5-cb6636818ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:08.897898 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-2766b9a6-621e-4d53-b8c5-cb6636818ade None None] MFA Rules not processed for user `8b29508991804967a37e54b0c9ae3d76`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:07:08.899267 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-2766b9a6-621e-4d53-b8c5-cb6636818ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:08.968412 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1334/2687] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:07:08 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:07:08.974363 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969a2f7-ee30-4e7c-b2a5-5b2e632a6414 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:08.978324 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-0969a2f7-ee30-4e7c-b2a5-5b2e632a6414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:09.032541 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969a2f7-ee30-4e7c-b2a5-5b2e632a6414 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:09.036752 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11e2bf-5eb4-4489-85e6-e26f3470663c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:09.037424 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11e2bf-5eb4-4489-85e6-e26f3470663c service cinder] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:09.037706 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11e2bf-5eb4-4489-85e6-e26f3470663c service cinder] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:09.037979 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11e2bf-5eb4-4489-85e6-e26f3470663c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:09.047521 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e11e2bf-5eb4-4489-85e6-e26f3470663c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:09.048948 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e11e2bf-5eb4-4489-85e6-e26f3470663c service cinder] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:09.058168 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1354/2688] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:07:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:07:09.099593 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766b9a6-621e-4d53-b8c5-cb6636818ade None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:09.104628 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-2766b9a6-621e-4d53-b8c5-cb6636818ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:09.114122 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766b9a6-621e-4d53-b8c5-cb6636818ade None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:09.118022 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f62dd-73ad-4e05-9630-32c70068774c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:09.118750 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f62dd-73ad-4e05-9630-32c70068774c service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:09.119158 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f62dd-73ad-4e05-9630-32c70068774c service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:09.119503 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f62dd-73ad-4e05-9630-32c70068774c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:09.177151 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f62dd-73ad-4e05-9630-32c70068774c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:09.178598 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f62dd-73ad-4e05-9630-32c70068774c service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:09.187640 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1335/2689] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:07:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:07:13.708338 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11e2bf-5eb4-4489-85e6-e26f3470663c service cinder] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:13.769924 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11e2bf-5eb4-4489-85e6-e26f3470663c service cinder] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:13.774353 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf975e-8d38-457a-b10e-38cd24d22fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:13.775213 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf975e-8d38-457a-b10e-38cd24d22fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:13.775492 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf975e-8d38-457a-b10e-38cd24d22fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:13.775764 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf975e-8d38-457a-b10e-38cd24d22fd7 admin admin] PATH_INFO: `/v3/users/d2292a50b63c4bbaa58269ee5938451a` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:13.777463 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf975e-8d38-457a-b10e-38cd24d22fd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2292a50b63c4bbaa58269ee5938451a)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:13.779421 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf975e-8d38-457a-b10e-38cd24d22fd7 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:13.960970 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-33bf975e-8d38-457a-b10e-38cd24d22fd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2292a50b63c4bbaa58269ee5938451a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:13.968132 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-33bf975e-8d38-457a-b10e-38cd24d22fd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2292a50b63c4bbaa58269ee5938451a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:13.968784 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-33bf975e-8d38-457a-b10e-38cd24d22fd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2292a50b63c4bbaa58269ee5938451a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:13.969479 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-33bf975e-8d38-457a-b10e-38cd24d22fd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2292a50b63c4bbaa58269ee5938451a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:14.041624 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-33bf975e-8d38-457a-b10e-38cd24d22fd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2292a50b63c4bbaa58269ee5938451a'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:14.058984 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1355/2690] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:07:13 2022] DELETE /identity/v3/users/d2292a50b63c4bbaa58269ee5938451a => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:07:14.063573 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382554e0-7238-4131-a83c-415ced91772c None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:14.064035 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382554e0-7238-4131-a83c-415ced91772c None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:14.064133 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382554e0-7238-4131-a83c-415ced91772c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:14.081817 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-382554e0-7238-4131-a83c-415ced91772c None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:07:14.083018 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-382554e0-7238-4131-a83c-415ced91772c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:14.141488 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1336/2691] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:07:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:07:14.151130 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf975e-8d38-457a-b10e-38cd24d22fd7 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:14.153182 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-33bf975e-8d38-457a-b10e-38cd24d22fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:14.207099 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf975e-8d38-457a-b10e-38cd24d22fd7 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:14.211043 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f25047-afc4-4f54-a62e-b0b73fdd7f0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:14.211657 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f25047-afc4-4f54-a62e-b0b73fdd7f0c service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:14.211904 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f25047-afc4-4f54-a62e-b0b73fdd7f0c service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:14.212176 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f25047-afc4-4f54-a62e-b0b73fdd7f0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:14.221830 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f25047-afc4-4f54-a62e-b0b73fdd7f0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:14.223253 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f25047-afc4-4f54-a62e-b0b73fdd7f0c service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:14.232667 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1356/2692] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:07:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:07:14.643829 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382554e0-7238-4131-a83c-415ced91772c None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:14.646431 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-382554e0-7238-4131-a83c-415ced91772c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:14.657610 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382554e0-7238-4131-a83c-415ced91772c None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:14.662212 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb51ec-b8d1-4ca7-8fe7-6750e01ca343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:14.663066 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb51ec-b8d1-4ca7-8fe7-6750e01ca343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:14.663355 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb51ec-b8d1-4ca7-8fe7-6750e01ca343 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:14.663631 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb51ec-b8d1-4ca7-8fe7-6750e01ca343 admin admin] PATH_INFO: `/v3/projects/149e87c167754232a0b52d8f8fb076c4` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:14.664836 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb51ec-b8d1-4ca7-8fe7-6750e01ca343 admin admin] RBAC: Authorizing `identity:delete_project(project_id=149e87c167754232a0b52d8f8fb076c4)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:14.666785 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb51ec-b8d1-4ca7-8fe7-6750e01ca343 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:14.745606 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e4fb51ec-b8d1-4ca7-8fe7-6750e01ca343 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '149e87c167754232a0b52d8f8fb076c4', 'request_id': 'req-e4fb51ec-b8d1-4ca7-8fe7-6750e01ca343'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:14.751685 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e4fb51ec-b8d1-4ca7-8fe7-6750e01ca343 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '149e87c167754232a0b52d8f8fb076c4', 'request_id': 'req-e4fb51ec-b8d1-4ca7-8fe7-6750e01ca343'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:14.756918 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e4fb51ec-b8d1-4ca7-8fe7-6750e01ca343 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '149e87c167754232a0b52d8f8fb076c4', 'request_id': 'req-e4fb51ec-b8d1-4ca7-8fe7-6750e01ca343'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:14.813366 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e4fb51ec-b8d1-4ca7-8fe7-6750e01ca343 admin admin] The token cache is being invalidate because project 149e87c167754232a0b52d8f8fb076c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:07:14.813654 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e4fb51ec-b8d1-4ca7-8fe7-6750e01ca343 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:14.814447 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-e4fb51ec-b8d1-4ca7-8fe7-6750e01ca343 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:14.820690 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1337/2693] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:07:14 2022] DELETE /identity/v3/projects/149e87c167754232a0b52d8f8fb076c4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:07:14.821498 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f25047-afc4-4f54-a62e-b0b73fdd7f0c service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:14.831564 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f25047-afc4-4f54-a62e-b0b73fdd7f0c service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:14.896186 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29005f-42e0-4f25-9135-3bb9bf143631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:14.897403 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29005f-42e0-4f25-9135-3bb9bf143631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:14.898311 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29005f-42e0-4f25-9135-3bb9bf143631 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:14.898697 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29005f-42e0-4f25-9135-3bb9bf143631 admin admin] PATH_INFO: `/v3/users/8b29508991804967a37e54b0c9ae3d76` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:14.900037 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29005f-42e0-4f25-9135-3bb9bf143631 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b29508991804967a37e54b0c9ae3d76)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:14.903122 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29005f-42e0-4f25-9135-3bb9bf143631 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:15.088018 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-cb29005f-42e0-4f25-9135-3bb9bf143631 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b29508991804967a37e54b0c9ae3d76'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:15.095454 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-cb29005f-42e0-4f25-9135-3bb9bf143631 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b29508991804967a37e54b0c9ae3d76'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:15.096117 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-cb29005f-42e0-4f25-9135-3bb9bf143631 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b29508991804967a37e54b0c9ae3d76'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:15.096740 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-cb29005f-42e0-4f25-9135-3bb9bf143631 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b29508991804967a37e54b0c9ae3d76'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:15.211097 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-cb29005f-42e0-4f25-9135-3bb9bf143631 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b29508991804967a37e54b0c9ae3d76'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:15.228369 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1357/2694] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:07:14 2022] DELETE /identity/v3/users/8b29508991804967a37e54b0c9ae3d76 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:07:15.643554 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb51ec-b8d1-4ca7-8fe7-6750e01ca343 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:15.645118 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-e4fb51ec-b8d1-4ca7-8fe7-6750e01ca343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:15.658064 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb51ec-b8d1-4ca7-8fe7-6750e01ca343 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:15.713626 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f0be0-049f-4aac-9404-4fa334b2ccec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:15.714481 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f0be0-049f-4aac-9404-4fa334b2ccec admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:15.714782 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f0be0-049f-4aac-9404-4fa334b2ccec admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:15.715054 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f0be0-049f-4aac-9404-4fa334b2ccec admin admin] PATH_INFO: `/v3/projects/76b8833dfe1f4e8b8c1cb35cb035d4e9` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:15.716227 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f0be0-049f-4aac-9404-4fa334b2ccec admin admin] RBAC: Authorizing `identity:delete_project(project_id=76b8833dfe1f4e8b8c1cb35cb035d4e9)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:15.718140 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f0be0-049f-4aac-9404-4fa334b2ccec admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:15.818204 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-800f0be0-049f-4aac-9404-4fa334b2ccec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76b8833dfe1f4e8b8c1cb35cb035d4e9', 'request_id': 'req-800f0be0-049f-4aac-9404-4fa334b2ccec'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:15.824294 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-800f0be0-049f-4aac-9404-4fa334b2ccec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76b8833dfe1f4e8b8c1cb35cb035d4e9', 'request_id': 'req-800f0be0-049f-4aac-9404-4fa334b2ccec'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:15.829495 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-800f0be0-049f-4aac-9404-4fa334b2ccec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76b8833dfe1f4e8b8c1cb35cb035d4e9', 'request_id': 'req-800f0be0-049f-4aac-9404-4fa334b2ccec'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:15.869316 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-800f0be0-049f-4aac-9404-4fa334b2ccec admin admin] The token cache is being invalidate because project 76b8833dfe1f4e8b8c1cb35cb035d4e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:07:15.869606 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-800f0be0-049f-4aac-9404-4fa334b2ccec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:15.870221 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-800f0be0-049f-4aac-9404-4fa334b2ccec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:15.872354 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1338/2695] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:07:15 2022] DELETE /identity/v3/projects/76b8833dfe1f4e8b8c1cb35cb035d4e9 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:07:15.879768 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e16a97-e812-46e0-9ee3-2e725d1da0bd None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:15.880258 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e16a97-e812-46e0-9ee3-2e725d1da0bd None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:15.880457 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e16a97-e812-46e0-9ee3-2e725d1da0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:15.898339 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-d4e16a97-e812-46e0-9ee3-2e725d1da0bd None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:07:15.899461 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-d4e16a97-e812-46e0-9ee3-2e725d1da0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:15.956912 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1358/2696] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:07:15.966783 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6df762-f099-41d0-9a38-41b8e689ed6d None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:15.967074 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6df762-f099-41d0-9a38-41b8e689ed6d None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:15.967355 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6df762-f099-41d0-9a38-41b8e689ed6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:15.986215 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-7c6df762-f099-41d0-9a38-41b8e689ed6d None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:07:15.987404 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-7c6df762-f099-41d0-9a38-41b8e689ed6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:15.995288 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1339/2697] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:07:15.999467 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e16a97-e812-46e0-9ee3-2e725d1da0bd None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:16.010022 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e16a97-e812-46e0-9ee3-2e725d1da0bd None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:16.014962 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6dc7da-466e-4cad-8e28-a0b4c15a3f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:16.015614 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6dc7da-466e-4cad-8e28-a0b4c15a3f2a admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:16.015897 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6dc7da-466e-4cad-8e28-a0b4c15a3f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:16.016175 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6dc7da-466e-4cad-8e28-a0b4c15a3f2a admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:16.016906 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6dc7da-466e-4cad-8e28-a0b4c15a3f2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:07:16.017266 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6dc7da-466e-4cad-8e28-a0b4c15a3f2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:16.018900 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6dc7da-466e-4cad-8e28-a0b4c15a3f2a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:16.030959 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1359/2698] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:07:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 15:07:16.035262 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6df762-f099-41d0-9a38-41b8e689ed6d None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:16.044515 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6df762-f099-41d0-9a38-41b8e689ed6d None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:16.049559 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940bc79-672b-40ae-8eb0-180c27e5582c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:16.050205 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940bc79-672b-40ae-8eb0-180c27e5582c admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:16.050487 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940bc79-672b-40ae-8eb0-180c27e5582c admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:16.050769 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940bc79-672b-40ae-8eb0-180c27e5582c admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:16.051466 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940bc79-672b-40ae-8eb0-180c27e5582c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:16.053417 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940bc79-672b-40ae-8eb0-180c27e5582c admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:16.187029 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1340/2699] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:07:16 2022] POST /identity/v3/projects => generated 369 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:07:16.191050 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6dc7da-466e-4cad-8e28-a0b4c15a3f2a admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:16.201867 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6dc7da-466e-4cad-8e28-a0b4c15a3f2a admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:16.254901 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c469ced-954f-4a91-be5d-80ab3fcfd1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:16.255551 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c469ced-954f-4a91-be5d-80ab3fcfd1f1 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:16.255830 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c469ced-954f-4a91-be5d-80ab3fcfd1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:16.256100 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c469ced-954f-4a91-be5d-80ab3fcfd1f1 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:16.256794 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c469ced-954f-4a91-be5d-80ab3fcfd1f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:16.258721 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c469ced-954f-4a91-be5d-80ab3fcfd1f1 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:16.385361 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1360/2700] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:07:16 2022] POST /identity/v3/users => generated 285 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:07:16.389237 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940bc79-672b-40ae-8eb0-180c27e5582c admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:16.399359 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940bc79-672b-40ae-8eb0-180c27e5582c admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:16.403973 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965398a-8bd4-4b48-96d9-cc2f7dc0debb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:16.404625 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965398a-8bd4-4b48-96d9-cc2f7dc0debb admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:16.404909 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965398a-8bd4-4b48-96d9-cc2f7dc0debb admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:16.405224 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965398a-8bd4-4b48-96d9-cc2f7dc0debb admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:16.405957 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965398a-8bd4-4b48-96d9-cc2f7dc0debb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:16.407591 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965398a-8bd4-4b48-96d9-cc2f7dc0debb admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:16.418236 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1341/2701] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:07:16.421769 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c469ced-954f-4a91-be5d-80ab3fcfd1f1 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:16.431430 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c469ced-954f-4a91-be5d-80ab3fcfd1f1 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:16.436791 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c00c9-f42b-462c-a526-8b7a82b2039a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:16.437518 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c00c9-f42b-462c-a526-8b7a82b2039a admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:16.437756 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c00c9-f42b-462c-a526-8b7a82b2039a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:16.438036 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c00c9-f42b-462c-a526-8b7a82b2039a admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:16.438769 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c00c9-f42b-462c-a526-8b7a82b2039a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:16.440366 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c00c9-f42b-462c-a526-8b7a82b2039a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:16.450414 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1361/2702] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:07:16.454303 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965398a-8bd4-4b48-96d9-cc2f7dc0debb admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:16.463854 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965398a-8bd4-4b48-96d9-cc2f7dc0debb admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:16.468421 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ebadd-b877-461f-95f2-4d888d817774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:16.469310 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ebadd-b877-461f-95f2-4d888d817774 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:16.469590 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ebadd-b877-461f-95f2-4d888d817774 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:16.469862 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ebadd-b877-461f-95f2-4d888d817774 admin admin] PATH_INFO: `/v3/projects/b5df173b97cf45b1a40c96ee2933e86e/users/f8c7974668ad452892ca073205aed2a3/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:16.484567 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ebadd-b877-461f-95f2-4d888d817774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5df173b97cf45b1a40c96ee2933e86e, user_id=f8c7974668ad452892ca073205aed2a3, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:16.487208 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ebadd-b877-461f-95f2-4d888d817774 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:16.545671 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1342/2703] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:07:16 2022] PUT /identity/v3/projects/b5df173b97cf45b1a40c96ee2933e86e/users/f8c7974668ad452892ca073205aed2a3/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:07:16.555814 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b7d1a-6f39-4a4f-8884-8e3844177248 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:16.556110 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b7d1a-6f39-4a4f-8884-8e3844177248 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:16.556400 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b7d1a-6f39-4a4f-8884-8e3844177248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:16.583064 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-408b7d1a-6f39-4a4f-8884-8e3844177248 None None] MFA Rules not processed for user `f8c7974668ad452892ca073205aed2a3`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:07:16.584330 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-408b7d1a-6f39-4a4f-8884-8e3844177248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:16.645890 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1362/2704] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:07:16 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:07:16.658660 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ebadd-b877-461f-95f2-4d888d817774 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:16.660505 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-b15ebadd-b877-461f-95f2-4d888d817774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:16.717869 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ebadd-b877-461f-95f2-4d888d817774 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:16.721661 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32bdc8-7558-43b7-9308-9e69b4b69c23 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935ad716e4624c25bc34308f05eb1526', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:16.722326 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32bdc8-7558-43b7-9308-9e69b4b69c23 service glance] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:16.722608 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32bdc8-7558-43b7-9308-9e69b4b69c23 service glance] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:16.722881 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32bdc8-7558-43b7-9308-9e69b4b69c23 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:16.732494 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32bdc8-7558-43b7-9308-9e69b4b69c23 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:16.733973 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32bdc8-7558-43b7-9308-9e69b4b69c23 service glance] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:16.742929 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1343/2705] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:07:16 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 15:07:46.119770 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b7d1a-6f39-4a4f-8884-8e3844177248 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:46.121172 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-408b7d1a-6f39-4a4f-8884-8e3844177248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:46.190005 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b7d1a-6f39-4a4f-8884-8e3844177248 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:46.195109 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c2edb-a8c3-4d4d-ab87-f03a4e9717b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8847b97a7089420a8b8b817f3059c660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:46.195743 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c2edb-a8c3-4d4d-ab87-f03a4e9717b5 service placement] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:46.196053 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c2edb-a8c3-4d4d-ab87-f03a4e9717b5 service placement] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:46.196355 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c2edb-a8c3-4d4d-ab87-f03a4e9717b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:46.198242 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-4f8c2edb-a8c3-4d4d-ab87-f03a4e9717b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:46.209559 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c2edb-a8c3-4d4d-ab87-f03a4e9717b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:46.211118 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c2edb-a8c3-4d4d-ab87-f03a4e9717b5 service placement] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:46.221116 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1363/2706] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:07:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:07:50.735149 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32bdc8-7558-43b7-9308-9e69b4b69c23 service glance] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:50.796800 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32bdc8-7558-43b7-9308-9e69b4b69c23 service glance] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:50.802015 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ceac2-7053-4489-9f87-14890a1747c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:50.802873 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ceac2-7053-4489-9f87-14890a1747c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:50.803150 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ceac2-7053-4489-9f87-14890a1747c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:50.803423 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ceac2-7053-4489-9f87-14890a1747c7 admin admin] PATH_INFO: `/v3/users/f8c7974668ad452892ca073205aed2a3` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:50.804588 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ceac2-7053-4489-9f87-14890a1747c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8c7974668ad452892ca073205aed2a3)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:50.806572 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ceac2-7053-4489-9f87-14890a1747c7 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:51.070459 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-6c5ceac2-7053-4489-9f87-14890a1747c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8c7974668ad452892ca073205aed2a3'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:51.077018 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-6c5ceac2-7053-4489-9f87-14890a1747c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8c7974668ad452892ca073205aed2a3'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:51.077777 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-6c5ceac2-7053-4489-9f87-14890a1747c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8c7974668ad452892ca073205aed2a3'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:51.164676 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-6c5ceac2-7053-4489-9f87-14890a1747c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8c7974668ad452892ca073205aed2a3'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:51.176936 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-6c5ceac2-7053-4489-9f87-14890a1747c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8c7974668ad452892ca073205aed2a3'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:51.182951 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1344/2707] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:07:50 2022] DELETE /identity/v3/users/f8c7974668ad452892ca073205aed2a3 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:07:51.187659 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c703277-669a-4bf5-bb1e-d0d23725a15a None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:51.188144 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c703277-669a-4bf5-bb1e-d0d23725a15a None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:51.188256 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c703277-669a-4bf5-bb1e-d0d23725a15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:51.205046 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-3c703277-669a-4bf5-bb1e-d0d23725a15a None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:07:51.206314 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-3c703277-669a-4bf5-bb1e-d0d23725a15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:51.264053 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1364/2708] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:07:51.273603 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ceac2-7053-4489-9f87-14890a1747c7 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:51.275023 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-6c5ceac2-7053-4489-9f87-14890a1747c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:51.329948 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ceac2-7053-4489-9f87-14890a1747c7 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:51.333485 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e8db5-a39d-4411-8d58-9d545e288515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:51.334119 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e8db5-a39d-4411-8d58-9d545e288515 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:51.334398 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e8db5-a39d-4411-8d58-9d545e288515 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:51.334667 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e8db5-a39d-4411-8d58-9d545e288515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:51.343443 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e8db5-a39d-4411-8d58-9d545e288515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:51.344890 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e8db5-a39d-4411-8d58-9d545e288515 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:51.354721 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1345/2709] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:07:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:07:51.745411 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c703277-669a-4bf5-bb1e-d0d23725a15a None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:51.746847 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-3c703277-669a-4bf5-bb1e-d0d23725a15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:51.760090 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c703277-669a-4bf5-bb1e-d0d23725a15a None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:51.764662 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24f952-6a50-4c1a-838e-e34a8b82a061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:51.765557 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24f952-6a50-4c1a-838e-e34a8b82a061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:51.765914 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24f952-6a50-4c1a-838e-e34a8b82a061 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:51.766192 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24f952-6a50-4c1a-838e-e34a8b82a061 admin admin] PATH_INFO: `/v3/projects/b5df173b97cf45b1a40c96ee2933e86e` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:51.767391 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24f952-6a50-4c1a-838e-e34a8b82a061 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5df173b97cf45b1a40c96ee2933e86e)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:51.770017 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24f952-6a50-4c1a-838e-e34a8b82a061 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:51.892188 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3a24f952-6a50-4c1a-838e-e34a8b82a061 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5df173b97cf45b1a40c96ee2933e86e', 'request_id': 'req-3a24f952-6a50-4c1a-838e-e34a8b82a061'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:51.898945 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3a24f952-6a50-4c1a-838e-e34a8b82a061 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5df173b97cf45b1a40c96ee2933e86e', 'request_id': 'req-3a24f952-6a50-4c1a-838e-e34a8b82a061'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:51.987560 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3a24f952-6a50-4c1a-838e-e34a8b82a061 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5df173b97cf45b1a40c96ee2933e86e', 'request_id': 'req-3a24f952-6a50-4c1a-838e-e34a8b82a061'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:51.998925 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3a24f952-6a50-4c1a-838e-e34a8b82a061 admin admin] The token cache is being invalidate because project b5df173b97cf45b1a40c96ee2933e86e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:07:51.999236 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3a24f952-6a50-4c1a-838e-e34a8b82a061 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:51.999901 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3a24f952-6a50-4c1a-838e-e34a8b82a061 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:52.001487 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1365/2710] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:07:51 2022] DELETE /identity/v3/projects/b5df173b97cf45b1a40c96ee2933e86e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:07:52.008598 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3480efd-ba38-4427-af06-c0d7a2b65862 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:52.009147 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3480efd-ba38-4427-af06-c0d7a2b65862 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:52.009383 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3480efd-ba38-4427-af06-c0d7a2b65862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:52.031048 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-c3480efd-ba38-4427-af06-c0d7a2b65862 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:07:52.032281 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-c3480efd-ba38-4427-af06-c0d7a2b65862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:52.096141 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1346/2711] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:07:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:07:52.104720 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1067b-c907-442a-88e4-0a8a2afe2f6e None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:52.105014 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1067b-c907-442a-88e4-0a8a2afe2f6e None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:52.105336 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1067b-c907-442a-88e4-0a8a2afe2f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:52.129056 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-3bf1067b-c907-442a-88e4-0a8a2afe2f6e None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:07:52.130320 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-3bf1067b-c907-442a-88e4-0a8a2afe2f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:52.138704 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1366/2712] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:07:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:07:52.143517 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3480efd-ba38-4427-af06-c0d7a2b65862 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:52.153744 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3480efd-ba38-4427-af06-c0d7a2b65862 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:52.158606 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef02b47-54fd-4ec8-8364-490708c48a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:52.159257 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef02b47-54fd-4ec8-8364-490708c48a72 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:52.159543 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef02b47-54fd-4ec8-8364-490708c48a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:52.159850 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef02b47-54fd-4ec8-8364-490708c48a72 admin admin] PATH_INFO: `/v3/domains` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:52.160577 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef02b47-54fd-4ec8-8364-490708c48a72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90997) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:07:52.160893 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef02b47-54fd-4ec8-8364-490708c48a72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:52.162530 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef02b47-54fd-4ec8-8364-490708c48a72 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:52.175672 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1347/2713] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 15:07:52.179993 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1067b-c907-442a-88e4-0a8a2afe2f6e None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:52.189579 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1067b-c907-442a-88e4-0a8a2afe2f6e None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:52.195122 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfb449-e728-4f47-8f9c-b149ff361a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:52.198598 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfb449-e728-4f47-8f9c-b149ff361a63 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:52.198598 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfb449-e728-4f47-8f9c-b149ff361a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:52.198598 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfb449-e728-4f47-8f9c-b149ff361a63 admin admin] PATH_INFO: `/v3/projects` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:52.198598 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dfb449-e728-4f47-8f9c-b149ff361a63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:52.198966 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dfb449-e728-4f47-8f9c-b149ff361a63 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:52.351544 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1367/2714] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:07:52 2022] POST /identity/v3/projects => generated 381 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:07:52.355675 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef02b47-54fd-4ec8-8364-490708c48a72 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:52.365990 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef02b47-54fd-4ec8-8364-490708c48a72 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:52.418126 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67280872-e42f-4d64-a1c1-b1caf40cdd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:52.418698 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67280872-e42f-4d64-a1c1-b1caf40cdd48 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:52.418980 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67280872-e42f-4d64-a1c1-b1caf40cdd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:52.419254 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67280872-e42f-4d64-a1c1-b1caf40cdd48 admin admin] PATH_INFO: `/v3/users` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:52.419945 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67280872-e42f-4d64-a1c1-b1caf40cdd48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:52.421867 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67280872-e42f-4d64-a1c1-b1caf40cdd48 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:52.519106 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1348/2715] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:07:52 2022] POST /identity/v3/users => generated 291 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:07:52.523142 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfb449-e728-4f47-8f9c-b149ff361a63 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:52.533267 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfb449-e728-4f47-8f9c-b149ff361a63 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:52.538502 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21093098-ca55-49a7-8e23-33ebec636769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:52.539150 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21093098-ca55-49a7-8e23-33ebec636769 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:52.539433 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21093098-ca55-49a7-8e23-33ebec636769 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:52.539708 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21093098-ca55-49a7-8e23-33ebec636769 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:52.540442 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21093098-ca55-49a7-8e23-33ebec636769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:52.542077 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21093098-ca55-49a7-8e23-33ebec636769 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:52.554496 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1368/2716] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:07:52.558240 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67280872-e42f-4d64-a1c1-b1caf40cdd48 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:52.567868 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67280872-e42f-4d64-a1c1-b1caf40cdd48 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:52.572398 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51534acf-ce6d-4b48-97cd-cb97463ecbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:52.573043 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51534acf-ce6d-4b48-97cd-cb97463ecbdb admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:52.573362 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51534acf-ce6d-4b48-97cd-cb97463ecbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:52.573640 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51534acf-ce6d-4b48-97cd-cb97463ecbdb admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:52.574366 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51534acf-ce6d-4b48-97cd-cb97463ecbdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:52.575996 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51534acf-ce6d-4b48-97cd-cb97463ecbdb admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:52.585491 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1349/2717] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:07:52.589528 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21093098-ca55-49a7-8e23-33ebec636769 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:52.599864 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21093098-ca55-49a7-8e23-33ebec636769 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:52.604838 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ba7f8-3197-4766-9fa7-e3ca9fe340d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:52.605744 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ba7f8-3197-4766-9fa7-e3ca9fe340d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:52.606024 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ba7f8-3197-4766-9fa7-e3ca9fe340d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:52.606297 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ba7f8-3197-4766-9fa7-e3ca9fe340d1 admin admin] PATH_INFO: `/v3/projects/4ffa8c6fb14941c6ba03ddd2d63c49be/users/7a8386858f994d4f9c29aaf040a539e0/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:52.621185 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ba7f8-3197-4766-9fa7-e3ca9fe340d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ffa8c6fb14941c6ba03ddd2d63c49be, user_id=7a8386858f994d4f9c29aaf040a539e0, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:52.623813 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ba7f8-3197-4766-9fa7-e3ca9fe340d1 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:52.709587 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1369/2718] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:07:52 2022] PUT /identity/v3/projects/4ffa8c6fb14941c6ba03ddd2d63c49be/users/7a8386858f994d4f9c29aaf040a539e0/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:07:52.714666 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f0938-b12e-47ed-b4f0-e58a4d168fcf None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:52.714959 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f0938-b12e-47ed-b4f0-e58a4d168fcf None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:52.715236 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f0938-b12e-47ed-b4f0-e58a4d168fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:52.733205 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-236f0938-b12e-47ed-b4f0-e58a4d168fcf None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:07:52.734389 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-236f0938-b12e-47ed-b4f0-e58a4d168fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:52.789600 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1350/2719] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:07:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:07:52.798988 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ba7f8-3197-4766-9fa7-e3ca9fe340d1 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:52.801371 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-e56ba7f8-3197-4766-9fa7-e3ca9fe340d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:52.855637 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ba7f8-3197-4766-9fa7-e3ca9fe340d1 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:52.859282 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6062b9-240c-4ed4-98f7-14ece98ddead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:52.859936 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6062b9-240c-4ed4-98f7-14ece98ddead service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:52.860218 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6062b9-240c-4ed4-98f7-14ece98ddead service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:52.860496 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6062b9-240c-4ed4-98f7-14ece98ddead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:52.869867 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6062b9-240c-4ed4-98f7-14ece98ddead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:52.871295 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6062b9-240c-4ed4-98f7-14ece98ddead service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:52.880450 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1370/2720] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:07:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:07:54.510325 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c162de-5fc1-4c73-bbc1-cc5ff9895d2e None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:54.510850 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c162de-5fc1-4c73-bbc1-cc5ff9895d2e None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:54.510937 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c162de-5fc1-4c73-bbc1-cc5ff9895d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:54.537237 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-76c162de-5fc1-4c73-bbc1-cc5ff9895d2e None None] MFA Rules not processed for user `7a8386858f994d4f9c29aaf040a539e0`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:07:54.538759 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-76c162de-5fc1-4c73-bbc1-cc5ff9895d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:54.603188 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1351/2721] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:07:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:07:54.612810 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6062b9-240c-4ed4-98f7-14ece98ddead service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:54.614197 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-0a6062b9-240c-4ed4-98f7-14ece98ddead service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:54.668711 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6062b9-240c-4ed4-98f7-14ece98ddead service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:54.672185 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef728d2-c2c9-4c5d-8ed7-91e21e763567 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:54.672810 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef728d2-c2c9-4c5d-8ed7-91e21e763567 service cinder] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:54.673116 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef728d2-c2c9-4c5d-8ed7-91e21e763567 service cinder] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:54.673396 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef728d2-c2c9-4c5d-8ed7-91e21e763567 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:54.681386 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef728d2-c2c9-4c5d-8ed7-91e21e763567 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:54.682807 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef728d2-c2c9-4c5d-8ed7-91e21e763567 service cinder] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:54.691284 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1371/2722] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:07:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:07:56.320188 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0c3d2-ab12-4f2a-9123-565d96651320 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:56.320689 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0c3d2-ab12-4f2a-9123-565d96651320 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:56.320810 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0c3d2-ab12-4f2a-9123-565d96651320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:56.338411 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-10b0c3d2-ab12-4f2a-9123-565d96651320 None None] MFA Rules not processed for user `7a8386858f994d4f9c29aaf040a539e0`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:07:56.339690 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-10b0c3d2-ab12-4f2a-9123-565d96651320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:56.346686 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1352/2723] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:07:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:07:57.940156 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef728d2-c2c9-4c5d-8ed7-91e21e763567 service cinder] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:57.941651 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-7ef728d2-c2c9-4c5d-8ed7-91e21e763567 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:57.956253 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef728d2-c2c9-4c5d-8ed7-91e21e763567 service cinder] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:57.961900 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde6e03-7547-47cd-ac4d-7fdabac67a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:57.962780 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde6e03-7547-47cd-ac4d-7fdabac67a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:57.965194 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde6e03-7547-47cd-ac4d-7fdabac67a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:57.965194 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde6e03-7547-47cd-ac4d-7fdabac67a34 admin admin] PATH_INFO: `/v3/users/e1578e40c006442ca632381e242d35bf` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:57.965194 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde6e03-7547-47cd-ac4d-7fdabac67a34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1578e40c006442ca632381e242d35bf)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:57.966796 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde6e03-7547-47cd-ac4d-7fdabac67a34 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:58.254775 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3fde6e03-7547-47cd-ac4d-7fdabac67a34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1578e40c006442ca632381e242d35bf'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:58.261413 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3fde6e03-7547-47cd-ac4d-7fdabac67a34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1578e40c006442ca632381e242d35bf'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:58.262073 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3fde6e03-7547-47cd-ac4d-7fdabac67a34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1578e40c006442ca632381e242d35bf'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:58.262722 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3fde6e03-7547-47cd-ac4d-7fdabac67a34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1578e40c006442ca632381e242d35bf'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:58.344210 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3fde6e03-7547-47cd-ac4d-7fdabac67a34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1578e40c006442ca632381e242d35bf'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:58.362420 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1372/2724] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:07:57 2022] DELETE /identity/v3/users/e1578e40c006442ca632381e242d35bf => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:07:58.635941 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0c3d2-ab12-4f2a-9123-565d96651320 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:58.646743 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0c3d2-ab12-4f2a-9123-565d96651320 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:58.703228 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72499390-a506-4bd4-8d8e-b4dbf0f095b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:58.704124 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72499390-a506-4bd4-8d8e-b4dbf0f095b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:58.704407 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72499390-a506-4bd4-8d8e-b4dbf0f095b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:58.704683 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72499390-a506-4bd4-8d8e-b4dbf0f095b1 admin admin] PATH_INFO: `/v3/projects/97821d0c0c79446abba323f103c8244a` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:58.705973 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72499390-a506-4bd4-8d8e-b4dbf0f095b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97821d0c0c79446abba323f103c8244a)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:58.707940 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72499390-a506-4bd4-8d8e-b4dbf0f095b1 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:58.828723 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-72499390-a506-4bd4-8d8e-b4dbf0f095b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97821d0c0c79446abba323f103c8244a', 'request_id': 'req-72499390-a506-4bd4-8d8e-b4dbf0f095b1'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:58.835440 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-72499390-a506-4bd4-8d8e-b4dbf0f095b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97821d0c0c79446abba323f103c8244a', 'request_id': 'req-72499390-a506-4bd4-8d8e-b4dbf0f095b1'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:58.840837 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-72499390-a506-4bd4-8d8e-b4dbf0f095b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97821d0c0c79446abba323f103c8244a', 'request_id': 'req-72499390-a506-4bd4-8d8e-b4dbf0f095b1'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:59.012062 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-72499390-a506-4bd4-8d8e-b4dbf0f095b1 admin admin] The token cache is being invalidate because project 97821d0c0c79446abba323f103c8244a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:07:59.012353 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-72499390-a506-4bd4-8d8e-b4dbf0f095b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:59.013532 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-72499390-a506-4bd4-8d8e-b4dbf0f095b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:07:59.015277 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1353/2725] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:07:58 2022] DELETE /identity/v3/projects/97821d0c0c79446abba323f103c8244a => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:07:59.021634 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2768e3-b558-4101-81dd-bbefbd6822d7 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:59.022317 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2768e3-b558-4101-81dd-bbefbd6822d7 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:59.022317 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2768e3-b558-4101-81dd-bbefbd6822d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:59.040104 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-de2768e3-b558-4101-81dd-bbefbd6822d7 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:07:59.041325 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-de2768e3-b558-4101-81dd-bbefbd6822d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:59.109202 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1373/2726] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:07:59.114145 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e4e8b-6e51-4cce-98b0-9ea4bbb3965e None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:59.114897 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e4e8b-6e51-4cce-98b0-9ea4bbb3965e None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:59.115249 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e4e8b-6e51-4cce-98b0-9ea4bbb3965e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:59.133976 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-4a0e4e8b-6e51-4cce-98b0-9ea4bbb3965e None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:07:59.135268 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-4a0e4e8b-6e51-4cce-98b0-9ea4bbb3965e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:59.143803 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1354/2727] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:07:59.148033 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2768e3-b558-4101-81dd-bbefbd6822d7 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:59.162078 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2768e3-b558-4101-81dd-bbefbd6822d7 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:59.163570 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37085a1-db40-4090-a17a-43a1a318753d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:59.164297 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37085a1-db40-4090-a17a-43a1a318753d admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:59.164579 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37085a1-db40-4090-a17a-43a1a318753d admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:59.164857 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37085a1-db40-4090-a17a-43a1a318753d admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:59.165625 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37085a1-db40-4090-a17a-43a1a318753d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:07:59.165941 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37085a1-db40-4090-a17a-43a1a318753d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:59.167519 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37085a1-db40-4090-a17a-43a1a318753d admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:59.179198 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1374/2728] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 15:07:59.183441 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e4e8b-6e51-4cce-98b0-9ea4bbb3965e None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:59.192637 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e4e8b-6e51-4cce-98b0-9ea4bbb3965e None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:59.197475 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b91e38-4d70-44e6-8a48-31f3b67a916e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:59.202221 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b91e38-4d70-44e6-8a48-31f3b67a916e admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:59.202221 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b91e38-4d70-44e6-8a48-31f3b67a916e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:59.202221 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b91e38-4d70-44e6-8a48-31f3b67a916e admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:59.202221 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b91e38-4d70-44e6-8a48-31f3b67a916e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:59.202221 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b91e38-4d70-44e6-8a48-31f3b67a916e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:59.300167 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1355/2729] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:07:59 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:07:59.303986 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37085a1-db40-4090-a17a-43a1a318753d admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:59.315597 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37085a1-db40-4090-a17a-43a1a318753d admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:59.374096 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ddd4a-513c-49aa-9846-425d11296f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:59.375357 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ddd4a-513c-49aa-9846-425d11296f8a admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:59.375672 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ddd4a-513c-49aa-9846-425d11296f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:59.375927 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ddd4a-513c-49aa-9846-425d11296f8a admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:59.376656 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ddd4a-513c-49aa-9846-425d11296f8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:59.379185 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ddd4a-513c-49aa-9846-425d11296f8a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:59.527469 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1375/2730] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:07:59 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:07:59.531560 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b91e38-4d70-44e6-8a48-31f3b67a916e admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:59.541578 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b91e38-4d70-44e6-8a48-31f3b67a916e admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:59.546243 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688d8a2-039e-433a-b5f6-b9985b850bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:59.546893 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688d8a2-039e-433a-b5f6-b9985b850bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:59.547194 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688d8a2-039e-433a-b5f6-b9985b850bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:59.547448 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688d8a2-039e-433a-b5f6-b9985b850bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:59.548181 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688d8a2-039e-433a-b5f6-b9985b850bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:59.549829 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688d8a2-039e-433a-b5f6-b9985b850bf3 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:59.560904 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1356/2731] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:07:59.565373 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ddd4a-513c-49aa-9846-425d11296f8a admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:59.575567 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ddd4a-513c-49aa-9846-425d11296f8a admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:59.580984 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d5706-2baf-434a-b509-11e29719083f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:59.581673 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d5706-2baf-434a-b509-11e29719083f admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:59.582074 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d5706-2baf-434a-b509-11e29719083f admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:59.582354 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d5706-2baf-434a-b509-11e29719083f admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:59.583083 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d5706-2baf-434a-b509-11e29719083f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:59.584665 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d5706-2baf-434a-b509-11e29719083f admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:59.595035 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1376/2732] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:07:59.599366 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688d8a2-039e-433a-b5f6-b9985b850bf3 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:59.610417 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688d8a2-039e-433a-b5f6-b9985b850bf3 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:59.615687 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9e3c7-a99b-4128-9a7b-be620198491c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:59.616592 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9e3c7-a99b-4128-9a7b-be620198491c admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:59.616871 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9e3c7-a99b-4128-9a7b-be620198491c admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:59.617172 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9e3c7-a99b-4128-9a7b-be620198491c admin admin] PATH_INFO: `/v3/projects/47395d81001b472092cd9c5bb2b22cae/users/8132105f0618415f8c0f78d083c1173d/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:59.637175 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9e3c7-a99b-4128-9a7b-be620198491c admin admin] RBAC: Authorizing `identity:create_grant(project_id=47395d81001b472092cd9c5bb2b22cae, user_id=8132105f0618415f8c0f78d083c1173d, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:59.640069 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9e3c7-a99b-4128-9a7b-be620198491c admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:07:59.713674 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1357/2733] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:07:59 2022] PUT /identity/v3/projects/47395d81001b472092cd9c5bb2b22cae/users/8132105f0618415f8c0f78d083c1173d/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:07:59.723455 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf67ddb-4084-4c19-a039-efc5ee4bf886 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:59.724050 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf67ddb-4084-4c19-a039-efc5ee4bf886 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:59.724050 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf67ddb-4084-4c19-a039-efc5ee4bf886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:59.756049 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-bbf67ddb-4084-4c19-a039-efc5ee4bf886 None None] MFA Rules not processed for user `8132105f0618415f8c0f78d083c1173d`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:07:59.757272 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-bbf67ddb-4084-4c19-a039-efc5ee4bf886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:07:59.819907 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1377/2734] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:07:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:07:59.824344 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9e3c7-a99b-4128-9a7b-be620198491c admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:07:59.884022 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9e3c7-a99b-4128-9a7b-be620198491c admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:07:59.888738 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc868d43-142e-490f-a341-559330d06b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:07:59.889426 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc868d43-142e-490f-a341-559330d06b8d admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:07:59.889718 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc868d43-142e-490f-a341-559330d06b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:07:59.889998 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc868d43-142e-490f-a341-559330d06b8d admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:07:59.890686 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc868d43-142e-490f-a341-559330d06b8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:07:59.892570 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc868d43-142e-490f-a341-559330d06b8d admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:00.020628 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1358/2735] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:07:59 2022] POST /identity/v3/projects => generated 377 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:08:00.024421 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf67ddb-4084-4c19-a039-efc5ee4bf886 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:00.035762 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf67ddb-4084-4c19-a039-efc5ee4bf886 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:00.091340 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf243b0-bcb5-4bc4-97fb-8e9dd7484901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:00.092416 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf243b0-bcb5-4bc4-97fb-8e9dd7484901 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:00.092928 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf243b0-bcb5-4bc4-97fb-8e9dd7484901 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:00.093386 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf243b0-bcb5-4bc4-97fb-8e9dd7484901 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:00.094099 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf243b0-bcb5-4bc4-97fb-8e9dd7484901 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:00.096538 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf243b0-bcb5-4bc4-97fb-8e9dd7484901 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:00.212784 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1378/2736] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:08:00 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:08:00.216876 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc868d43-142e-490f-a341-559330d06b8d admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:00.227863 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc868d43-142e-490f-a341-559330d06b8d admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:00.232775 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3e94a-8df0-4366-9133-64b22d479bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:00.233541 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3e94a-8df0-4366-9133-64b22d479bfc admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:00.233896 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3e94a-8df0-4366-9133-64b22d479bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:00.234246 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3e94a-8df0-4366-9133-64b22d479bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:00.235051 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a3e94a-8df0-4366-9133-64b22d479bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:00.237257 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a3e94a-8df0-4366-9133-64b22d479bfc admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:00.249152 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1359/2737] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:08:00.255703 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf243b0-bcb5-4bc4-97fb-8e9dd7484901 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:00.266013 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf243b0-bcb5-4bc4-97fb-8e9dd7484901 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:00.270744 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60270cd-eaf7-4651-a90e-c45a1c679dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:00.273906 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60270cd-eaf7-4651-a90e-c45a1c679dea admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:00.273906 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60270cd-eaf7-4651-a90e-c45a1c679dea admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:00.273906 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60270cd-eaf7-4651-a90e-c45a1c679dea admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:00.273906 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60270cd-eaf7-4651-a90e-c45a1c679dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:00.274406 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60270cd-eaf7-4651-a90e-c45a1c679dea admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:00.285279 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1379/2738] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:08:00.289498 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3e94a-8df0-4366-9133-64b22d479bfc admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:00.302062 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3e94a-8df0-4366-9133-64b22d479bfc admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:00.307058 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a3b46-e4ba-433d-9036-1b25b8291c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:00.307952 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a3b46-e4ba-433d-9036-1b25b8291c2e admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:00.308237 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a3b46-e4ba-433d-9036-1b25b8291c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:00.308504 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a3b46-e4ba-433d-9036-1b25b8291c2e admin admin] PATH_INFO: `/v3/projects/18c879a000f141f98d8726c2ef7b47da/users/ac9e2aeb3dab48e090318d55f90d0e07/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:00.323584 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a3b46-e4ba-433d-9036-1b25b8291c2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c879a000f141f98d8726c2ef7b47da, user_id=ac9e2aeb3dab48e090318d55f90d0e07, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:00.326454 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a3b46-e4ba-433d-9036-1b25b8291c2e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:00.447746 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1360/2739] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:08:00 2022] PUT /identity/v3/projects/18c879a000f141f98d8726c2ef7b47da/users/ac9e2aeb3dab48e090318d55f90d0e07/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:00.458433 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182acdf-a7a1-4ef2-bb73-45babeb5e571 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:00.458795 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182acdf-a7a1-4ef2-bb73-45babeb5e571 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:00.459163 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182acdf-a7a1-4ef2-bb73-45babeb5e571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:00.486173 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-c182acdf-a7a1-4ef2-bb73-45babeb5e571 None None] MFA Rules not processed for user `ac9e2aeb3dab48e090318d55f90d0e07`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:08:00.487406 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-c182acdf-a7a1-4ef2-bb73-45babeb5e571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:00.551886 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1380/2740] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:08:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:08:00.556421 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a3b46-e4ba-433d-9036-1b25b8291c2e admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:00.617479 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a3b46-e4ba-433d-9036-1b25b8291c2e admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:00.622578 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d593495-b342-4d30-be1c-c3bc19e48c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:00.623228 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d593495-b342-4d30-be1c-c3bc19e48c56 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:00.623509 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d593495-b342-4d30-be1c-c3bc19e48c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:00.623782 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d593495-b342-4d30-be1c-c3bc19e48c56 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:00.624475 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d593495-b342-4d30-be1c-c3bc19e48c56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:00.626594 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d593495-b342-4d30-be1c-c3bc19e48c56 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:00.699599 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1361/2741] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:08:00 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:08:00.704121 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182acdf-a7a1-4ef2-bb73-45babeb5e571 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:00.715631 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182acdf-a7a1-4ef2-bb73-45babeb5e571 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:00.772480 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbd773-9309-430b-a410-905a0c4302fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:00.773241 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbd773-9309-430b-a410-905a0c4302fd admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:00.777955 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbd773-9309-430b-a410-905a0c4302fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:00.777955 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbd773-9309-430b-a410-905a0c4302fd admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:00.777955 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fbd773-9309-430b-a410-905a0c4302fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:00.777955 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fbd773-9309-430b-a410-905a0c4302fd admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:00.877766 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1381/2742] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:08:00 2022] POST /identity/v3/users => generated 296 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:08:00.881393 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d593495-b342-4d30-be1c-c3bc19e48c56 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:00.891679 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d593495-b342-4d30-be1c-c3bc19e48c56 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:00.898659 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67410778-e030-4c03-afd5-5d10d0d46ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:00.899719 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67410778-e030-4c03-afd5-5d10d0d46ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:00.900672 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67410778-e030-4c03-afd5-5d10d0d46ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:00.901161 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67410778-e030-4c03-afd5-5d10d0d46ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:00.902091 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67410778-e030-4c03-afd5-5d10d0d46ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:00.904438 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67410778-e030-4c03-afd5-5d10d0d46ce8 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:00.918150 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1362/2743] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:08:00.922537 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbd773-9309-430b-a410-905a0c4302fd admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:00.932624 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbd773-9309-430b-a410-905a0c4302fd admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:00.938117 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6181f4-46d5-4328-8307-811425d3ee02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:00.939168 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6181f4-46d5-4328-8307-811425d3ee02 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:00.940059 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6181f4-46d5-4328-8307-811425d3ee02 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:00.940360 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6181f4-46d5-4328-8307-811425d3ee02 admin admin] PATH_INFO: `/v3/projects/b2097a653534454a941dde0b526c2407/users/6a93bbb37803494aa611eddd421b6e26/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:00.957886 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6181f4-46d5-4328-8307-811425d3ee02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2097a653534454a941dde0b526c2407, user_id=6a93bbb37803494aa611eddd421b6e26, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:00.960679 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6181f4-46d5-4328-8307-811425d3ee02 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:01.074599 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1382/2744] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:08:00 2022] PUT /identity/v3/projects/b2097a653534454a941dde0b526c2407/users/6a93bbb37803494aa611eddd421b6e26/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:01.075271 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67410778-e030-4c03-afd5-5d10d0d46ce8 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:01.085957 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67410778-e030-4c03-afd5-5d10d0d46ce8 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:01.147821 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a2f67-a5f7-4c0b-80bf-f88d64b01d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:01.151555 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a2f67-a5f7-4c0b-80bf-f88d64b01d37 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:01.151555 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a2f67-a5f7-4c0b-80bf-f88d64b01d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:01.151555 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a2f67-a5f7-4c0b-80bf-f88d64b01d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:01.151555 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a2f67-a5f7-4c0b-80bf-f88d64b01d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:01.151555 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a2f67-a5f7-4c0b-80bf-f88d64b01d37 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:01.165551 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1363/2745] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:08:01.166860 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6181f4-46d5-4328-8307-811425d3ee02 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:01.179672 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6181f4-46d5-4328-8307-811425d3ee02 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:01.184149 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59684d35-c8cb-4b65-b62b-82144d971e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:01.190653 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59684d35-c8cb-4b65-b62b-82144d971e86 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:01.190653 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59684d35-c8cb-4b65-b62b-82144d971e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:01.190653 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59684d35-c8cb-4b65-b62b-82144d971e86 admin admin] PATH_INFO: `/v3/projects/b2097a653534454a941dde0b526c2407/users/6a93bbb37803494aa611eddd421b6e26/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:01.190653 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59684d35-c8cb-4b65-b62b-82144d971e86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2097a653534454a941dde0b526c2407, user_id=6a93bbb37803494aa611eddd421b6e26, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:01.191505 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59684d35-c8cb-4b65-b62b-82144d971e86 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:01.212816 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1383/2746] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:08:01 2022] PUT /identity/v3/projects/b2097a653534454a941dde0b526c2407/users/6a93bbb37803494aa611eddd421b6e26/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:01.214768 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aeed4e-8436-49d4-8da9-2d79472e7077 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:01.215057 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aeed4e-8436-49d4-8da9-2d79472e7077 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:01.215332 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aeed4e-8436-49d4-8da9-2d79472e7077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:01.243807 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-29aeed4e-8436-49d4-8da9-2d79472e7077 None None] MFA Rules not processed for user `6a93bbb37803494aa611eddd421b6e26`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:08:01.245048 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-29aeed4e-8436-49d4-8da9-2d79472e7077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:01.313201 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1364/2747] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:08:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:08:01.323744 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59684d35-c8cb-4b65-b62b-82144d971e86 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:01.325504 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-59684d35-c8cb-4b65-b62b-82144d971e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:01.384927 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59684d35-c8cb-4b65-b62b-82144d971e86 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:01.390196 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e5ce6-d81f-4889-8686-d397e18ad70c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:01.390851 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e5ce6-d81f-4889-8686-d397e18ad70c service cinder] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:01.391135 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e5ce6-d81f-4889-8686-d397e18ad70c service cinder] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:01.391411 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e5ce6-d81f-4889-8686-d397e18ad70c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:01.418158 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e5ce6-d81f-4889-8686-d397e18ad70c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:01.422699 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e5ce6-d81f-4889-8686-d397e18ad70c service cinder] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:01.437161 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1384/2748] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:08:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 15:08:01.536981 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aeed4e-8436-49d4-8da9-2d79472e7077 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:01.539042 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-29aeed4e-8436-49d4-8da9-2d79472e7077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:01.555462 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aeed4e-8436-49d4-8da9-2d79472e7077 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:01.559254 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757522b6-dda3-4d20-90d9-1856684c5731 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:01.559916 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757522b6-dda3-4d20-90d9-1856684c5731 service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:01.560628 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757522b6-dda3-4d20-90d9-1856684c5731 service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:01.560628 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757522b6-dda3-4d20-90d9-1856684c5731 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:01.619656 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757522b6-dda3-4d20-90d9-1856684c5731 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:01.621720 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757522b6-dda3-4d20-90d9-1856684c5731 service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:01.631250 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1365/2749] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:08:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:08:05.853788 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e5ce6-d81f-4889-8686-d397e18ad70c service cinder] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:05.920519 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e5ce6-d81f-4889-8686-d397e18ad70c service cinder] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:05.925077 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d57594-1176-4c34-b8c4-9a25f1214b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:05.926473 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d57594-1176-4c34-b8c4-9a25f1214b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:05.926754 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d57594-1176-4c34-b8c4-9a25f1214b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:05.927031 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d57594-1176-4c34-b8c4-9a25f1214b2b admin admin] PATH_INFO: `/v3/users/8132105f0618415f8c0f78d083c1173d` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:05.928280 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d57594-1176-4c34-b8c4-9a25f1214b2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8132105f0618415f8c0f78d083c1173d)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:05.930229 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d57594-1176-4c34-b8c4-9a25f1214b2b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:06.156876 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-73d57594-1176-4c34-b8c4-9a25f1214b2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8132105f0618415f8c0f78d083c1173d'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:06.164350 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-73d57594-1176-4c34-b8c4-9a25f1214b2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8132105f0618415f8c0f78d083c1173d'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:06.165049 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-73d57594-1176-4c34-b8c4-9a25f1214b2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8132105f0618415f8c0f78d083c1173d'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:06.165755 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-73d57594-1176-4c34-b8c4-9a25f1214b2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8132105f0618415f8c0f78d083c1173d'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:06.338079 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-73d57594-1176-4c34-b8c4-9a25f1214b2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8132105f0618415f8c0f78d083c1173d'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:06.357265 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1385/2750] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:08:05 2022] DELETE /identity/v3/users/8132105f0618415f8c0f78d083c1173d => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:06.361492 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56429f7-1a97-41d1-a648-e5f6aad47992 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:06.361965 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56429f7-1a97-41d1-a648-e5f6aad47992 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:06.362081 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56429f7-1a97-41d1-a648-e5f6aad47992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:06.379006 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-b56429f7-1a97-41d1-a648-e5f6aad47992 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:08:06.380336 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-b56429f7-1a97-41d1-a648-e5f6aad47992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:06.437035 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1366/2751] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:08:06.446514 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d57594-1176-4c34-b8c4-9a25f1214b2b admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:06.447952 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-73d57594-1176-4c34-b8c4-9a25f1214b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:06.504198 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d57594-1176-4c34-b8c4-9a25f1214b2b admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:06.507810 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234bf48-4cd0-4c28-88c4-761a16f07dd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:06.508480 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234bf48-4cd0-4c28-88c4-761a16f07dd2 service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:06.508761 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234bf48-4cd0-4c28-88c4-761a16f07dd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:06.509033 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234bf48-4cd0-4c28-88c4-761a16f07dd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:06.518413 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234bf48-4cd0-4c28-88c4-761a16f07dd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:06.520400 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234bf48-4cd0-4c28-88c4-761a16f07dd2 service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:06.530004 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1386/2752] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:08:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:08:06.888020 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56429f7-1a97-41d1-a648-e5f6aad47992 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:06.889528 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-b56429f7-1a97-41d1-a648-e5f6aad47992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:06.902154 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56429f7-1a97-41d1-a648-e5f6aad47992 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:06.907233 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c2d91-52d0-4a1c-82a2-2f0601f34faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:06.911354 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c2d91-52d0-4a1c-82a2-2f0601f34faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:06.911354 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c2d91-52d0-4a1c-82a2-2f0601f34faf admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:06.911354 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c2d91-52d0-4a1c-82a2-2f0601f34faf admin admin] PATH_INFO: `/v3/projects/47395d81001b472092cd9c5bb2b22cae` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:06.911354 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c2d91-52d0-4a1c-82a2-2f0601f34faf admin admin] RBAC: Authorizing `identity:delete_project(project_id=47395d81001b472092cd9c5bb2b22cae)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:06.911743 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c2d91-52d0-4a1c-82a2-2f0601f34faf admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:07.023855 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-058c2d91-52d0-4a1c-82a2-2f0601f34faf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47395d81001b472092cd9c5bb2b22cae', 'request_id': 'req-058c2d91-52d0-4a1c-82a2-2f0601f34faf'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:07.029981 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-058c2d91-52d0-4a1c-82a2-2f0601f34faf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47395d81001b472092cd9c5bb2b22cae', 'request_id': 'req-058c2d91-52d0-4a1c-82a2-2f0601f34faf'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:07.035559 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-058c2d91-52d0-4a1c-82a2-2f0601f34faf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47395d81001b472092cd9c5bb2b22cae', 'request_id': 'req-058c2d91-52d0-4a1c-82a2-2f0601f34faf'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:07.160570 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-058c2d91-52d0-4a1c-82a2-2f0601f34faf admin admin] The token cache is being invalidate because project 47395d81001b472092cd9c5bb2b22cae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:08:07.164122 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-058c2d91-52d0-4a1c-82a2-2f0601f34faf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:07.164122 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-058c2d91-52d0-4a1c-82a2-2f0601f34faf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:07.164122 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1367/2753] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:08:06 2022] DELETE /identity/v3/projects/47395d81001b472092cd9c5bb2b22cae => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:07.167352 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234bf48-4cd0-4c28-88c4-761a16f07dd2 service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:07.179854 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234bf48-4cd0-4c28-88c4-761a16f07dd2 service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:07.240603 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c66f6-f43c-4771-8894-4c702168c629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:07.241516 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c66f6-f43c-4771-8894-4c702168c629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:07.241803 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c66f6-f43c-4771-8894-4c702168c629 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:07.242087 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c66f6-f43c-4771-8894-4c702168c629 admin admin] PATH_INFO: `/v3/users/ac9e2aeb3dab48e090318d55f90d0e07` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:07.243994 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c66f6-f43c-4771-8894-4c702168c629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac9e2aeb3dab48e090318d55f90d0e07)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:07.246076 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c66f6-f43c-4771-8894-4c702168c629 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:07.344763 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c2d91-52d0-4a1c-82a2-2f0601f34faf admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:07.353802 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-058c2d91-52d0-4a1c-82a2-2f0601f34faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:07.409709 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c2d91-52d0-4a1c-82a2-2f0601f34faf admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:07.413334 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ddcd6f-2a41-4668-9046-028cef912217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:07.414024 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddcd6f-2a41-4668-9046-028cef912217 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:07.419711 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddcd6f-2a41-4668-9046-028cef912217 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:07.419711 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddcd6f-2a41-4668-9046-028cef912217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:07.419711 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-b5ddcd6f-2a41-4668-9046-028cef912217 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:07.429930 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ddcd6f-2a41-4668-9046-028cef912217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:07.431502 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ddcd6f-2a41-4668-9046-028cef912217 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:07.443077 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1368/2754] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:08:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 05 15:08:07.481148 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a03c66f6-f43c-4771-8894-4c702168c629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac9e2aeb3dab48e090318d55f90d0e07'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:07.489563 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a03c66f6-f43c-4771-8894-4c702168c629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac9e2aeb3dab48e090318d55f90d0e07'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:07.493580 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a03c66f6-f43c-4771-8894-4c702168c629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac9e2aeb3dab48e090318d55f90d0e07'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:07.494444 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a03c66f6-f43c-4771-8894-4c702168c629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac9e2aeb3dab48e090318d55f90d0e07'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:07.578463 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a03c66f6-f43c-4771-8894-4c702168c629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac9e2aeb3dab48e090318d55f90d0e07'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:07.596753 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1387/2755] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:08:07 2022] DELETE /identity/v3/users/ac9e2aeb3dab48e090318d55f90d0e07 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:07.951155 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ddcd6f-2a41-4668-9046-028cef912217 service neutron] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:07.953359 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-b5ddcd6f-2a41-4668-9046-028cef912217 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:07.974685 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ddcd6f-2a41-4668-9046-028cef912217 service neutron] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:08.043361 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b2892-ce12-4bcd-ac55-4084645eae46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:08.044221 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b2892-ce12-4bcd-ac55-4084645eae46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:08.044501 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b2892-ce12-4bcd-ac55-4084645eae46 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:08.044774 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b2892-ce12-4bcd-ac55-4084645eae46 admin admin] PATH_INFO: `/v3/projects/18c879a000f141f98d8726c2ef7b47da` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:08.046040 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b2892-ce12-4bcd-ac55-4084645eae46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18c879a000f141f98d8726c2ef7b47da)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:08.047925 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b2892-ce12-4bcd-ac55-4084645eae46 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:08.219305 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-144b2892-ce12-4bcd-ac55-4084645eae46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18c879a000f141f98d8726c2ef7b47da', 'request_id': 'req-144b2892-ce12-4bcd-ac55-4084645eae46'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:08.225563 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-144b2892-ce12-4bcd-ac55-4084645eae46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18c879a000f141f98d8726c2ef7b47da', 'request_id': 'req-144b2892-ce12-4bcd-ac55-4084645eae46'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:08.231395 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-144b2892-ce12-4bcd-ac55-4084645eae46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18c879a000f141f98d8726c2ef7b47da', 'request_id': 'req-144b2892-ce12-4bcd-ac55-4084645eae46'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:08.280521 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-144b2892-ce12-4bcd-ac55-4084645eae46 admin admin] The token cache is being invalidate because project 18c879a000f141f98d8726c2ef7b47da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:08:08.280816 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-144b2892-ce12-4bcd-ac55-4084645eae46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:08.281491 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-144b2892-ce12-4bcd-ac55-4084645eae46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:08.283021 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1369/2756] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:08:07 2022] DELETE /identity/v3/projects/18c879a000f141f98d8726c2ef7b47da => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:08:08.287158 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c66f6-f43c-4771-8894-4c702168c629 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:08.288587 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-a03c66f6-f43c-4771-8894-4c702168c629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:08.301731 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c66f6-f43c-4771-8894-4c702168c629 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:08.361449 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f730605-75b5-4f18-895f-dbe4d8c43219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:08.363070 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f730605-75b5-4f18-895f-dbe4d8c43219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:08.363580 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f730605-75b5-4f18-895f-dbe4d8c43219 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:08.364058 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f730605-75b5-4f18-895f-dbe4d8c43219 admin admin] PATH_INFO: `/v3/users/6a93bbb37803494aa611eddd421b6e26` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:08.366127 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f730605-75b5-4f18-895f-dbe4d8c43219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a93bbb37803494aa611eddd421b6e26)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:08.369681 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f730605-75b5-4f18-895f-dbe4d8c43219 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:08.563273 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-6f730605-75b5-4f18-895f-dbe4d8c43219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a93bbb37803494aa611eddd421b6e26'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:08.570666 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-6f730605-75b5-4f18-895f-dbe4d8c43219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a93bbb37803494aa611eddd421b6e26'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:08.571389 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-6f730605-75b5-4f18-895f-dbe4d8c43219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a93bbb37803494aa611eddd421b6e26'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:08.572000 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-6f730605-75b5-4f18-895f-dbe4d8c43219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a93bbb37803494aa611eddd421b6e26'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:08.673582 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-6f730605-75b5-4f18-895f-dbe4d8c43219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a93bbb37803494aa611eddd421b6e26'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:08.698142 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1388/2757] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:08:08 2022] DELETE /identity/v3/users/6a93bbb37803494aa611eddd421b6e26 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:09.197675 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b2892-ce12-4bcd-ac55-4084645eae46 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:09.202442 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-144b2892-ce12-4bcd-ac55-4084645eae46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:09.220393 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b2892-ce12-4bcd-ac55-4084645eae46 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:09.278885 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada5b8f-cd55-4bd4-be36-02a1eb3e5083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:09.279782 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada5b8f-cd55-4bd4-be36-02a1eb3e5083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:09.280065 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada5b8f-cd55-4bd4-be36-02a1eb3e5083 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:09.280337 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada5b8f-cd55-4bd4-be36-02a1eb3e5083 admin admin] PATH_INFO: `/v3/projects/b2097a653534454a941dde0b526c2407` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:09.281675 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada5b8f-cd55-4bd4-be36-02a1eb3e5083 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2097a653534454a941dde0b526c2407)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:09.283571 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada5b8f-cd55-4bd4-be36-02a1eb3e5083 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:09.391920 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-dada5b8f-cd55-4bd4-be36-02a1eb3e5083 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2097a653534454a941dde0b526c2407', 'request_id': 'req-dada5b8f-cd55-4bd4-be36-02a1eb3e5083'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:09.398401 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-dada5b8f-cd55-4bd4-be36-02a1eb3e5083 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2097a653534454a941dde0b526c2407', 'request_id': 'req-dada5b8f-cd55-4bd4-be36-02a1eb3e5083'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:09.404159 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-dada5b8f-cd55-4bd4-be36-02a1eb3e5083 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2097a653534454a941dde0b526c2407', 'request_id': 'req-dada5b8f-cd55-4bd4-be36-02a1eb3e5083'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:09.481457 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-dada5b8f-cd55-4bd4-be36-02a1eb3e5083 admin admin] The token cache is being invalidate because project b2097a653534454a941dde0b526c2407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:08:09.481748 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-dada5b8f-cd55-4bd4-be36-02a1eb3e5083 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:09.482945 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-dada5b8f-cd55-4bd4-be36-02a1eb3e5083 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:09.484232 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1370/2758] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:08:09 2022] DELETE /identity/v3/projects/b2097a653534454a941dde0b526c2407 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:09.491443 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13f1bd-796d-4b5f-ba5b-8840fac45f77 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:09.492383 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13f1bd-796d-4b5f-ba5b-8840fac45f77 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:09.492815 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13f1bd-796d-4b5f-ba5b-8840fac45f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:09.513980 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-9b13f1bd-796d-4b5f-ba5b-8840fac45f77 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:08:09.515348 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-9b13f1bd-796d-4b5f-ba5b-8840fac45f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:09.577098 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1389/2759] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:08:09.585671 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84b00b-a536-4d33-9eaa-2f5857969de2 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:09.585982 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84b00b-a536-4d33-9eaa-2f5857969de2 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:09.586256 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84b00b-a536-4d33-9eaa-2f5857969de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:09.605051 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-df84b00b-a536-4d33-9eaa-2f5857969de2 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:08:09.606241 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-df84b00b-a536-4d33-9eaa-2f5857969de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:09.615063 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1371/2760] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:08:09.619407 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13f1bd-796d-4b5f-ba5b-8840fac45f77 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:09.629839 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13f1bd-796d-4b5f-ba5b-8840fac45f77 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:09.634828 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c5b55-5589-4d8b-8685-e0dfaba0d70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:09.635520 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c5b55-5589-4d8b-8685-e0dfaba0d70b admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:09.635807 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c5b55-5589-4d8b-8685-e0dfaba0d70b admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:09.636087 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c5b55-5589-4d8b-8685-e0dfaba0d70b admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:09.636835 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c5b55-5589-4d8b-8685-e0dfaba0d70b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:08:09.637181 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c5b55-5589-4d8b-8685-e0dfaba0d70b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:09.638888 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c5b55-5589-4d8b-8685-e0dfaba0d70b admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:09.651709 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1390/2761] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 15:08:09.660812 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84b00b-a536-4d33-9eaa-2f5857969de2 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:09.673894 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84b00b-a536-4d33-9eaa-2f5857969de2 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:09.682620 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e7311-4d1b-4efd-abe4-e211ae7262df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:09.683597 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e7311-4d1b-4efd-abe4-e211ae7262df admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:09.683968 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e7311-4d1b-4efd-abe4-e211ae7262df admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:09.684419 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e7311-4d1b-4efd-abe4-e211ae7262df admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:09.685341 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e7311-4d1b-4efd-abe4-e211ae7262df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:09.687722 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e7311-4d1b-4efd-abe4-e211ae7262df admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:09.778464 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1372/2762] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:08:09 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:08:09.782893 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c5b55-5589-4d8b-8685-e0dfaba0d70b admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:09.797565 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c5b55-5589-4d8b-8685-e0dfaba0d70b admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:09.859959 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bf647-67bf-4b4e-ac3e-d38378d090a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:09.860542 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bf647-67bf-4b4e-ac3e-d38378d090a2 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:09.860821 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bf647-67bf-4b4e-ac3e-d38378d090a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:09.861120 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bf647-67bf-4b4e-ac3e-d38378d090a2 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:09.861830 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37bf647-67bf-4b4e-ac3e-d38378d090a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:09.864296 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37bf647-67bf-4b4e-ac3e-d38378d090a2 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:09.961496 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1391/2763] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:08:09 2022] POST /identity/v3/users => generated 283 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:08:09.969809 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e7311-4d1b-4efd-abe4-e211ae7262df admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:09.976843 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e7311-4d1b-4efd-abe4-e211ae7262df admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:09.982286 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81ca8f-1c5c-4b6d-aabd-85f2b9dc6b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:09.982960 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81ca8f-1c5c-4b6d-aabd-85f2b9dc6b94 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:09.983246 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81ca8f-1c5c-4b6d-aabd-85f2b9dc6b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:09.983646 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81ca8f-1c5c-4b6d-aabd-85f2b9dc6b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:09.984395 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81ca8f-1c5c-4b6d-aabd-85f2b9dc6b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:09.986036 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81ca8f-1c5c-4b6d-aabd-85f2b9dc6b94 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:09.997377 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1373/2764] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:08:10.001560 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bf647-67bf-4b4e-ac3e-d38378d090a2 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:10.014302 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bf647-67bf-4b4e-ac3e-d38378d090a2 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:10.019409 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e313d4-34bc-47d4-b390-9467fb67409e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:10.020088 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e313d4-34bc-47d4-b390-9467fb67409e admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:10.020373 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e313d4-34bc-47d4-b390-9467fb67409e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:10.020653 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e313d4-34bc-47d4-b390-9467fb67409e admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:10.027239 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e313d4-34bc-47d4-b390-9467fb67409e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:10.027239 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e313d4-34bc-47d4-b390-9467fb67409e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:10.033949 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1392/2765] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:08:10.038313 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81ca8f-1c5c-4b6d-aabd-85f2b9dc6b94 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:10.048772 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81ca8f-1c5c-4b6d-aabd-85f2b9dc6b94 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:10.056877 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f110576-8306-43bd-9845-1a68683e43fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:10.057890 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f110576-8306-43bd-9845-1a68683e43fc admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:10.058429 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f110576-8306-43bd-9845-1a68683e43fc admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:10.058787 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f110576-8306-43bd-9845-1a68683e43fc admin admin] PATH_INFO: `/v3/projects/7e02f9353cea4eaea7f1beedad4ca84a/users/e4d94b1c683447959711e9e718ae8e73/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:10.074309 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f110576-8306-43bd-9845-1a68683e43fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e02f9353cea4eaea7f1beedad4ca84a, user_id=e4d94b1c683447959711e9e718ae8e73, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:10.077135 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f110576-8306-43bd-9845-1a68683e43fc admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:10.180038 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1374/2766] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:08:10 2022] PUT /identity/v3/projects/7e02f9353cea4eaea7f1beedad4ca84a/users/e4d94b1c683447959711e9e718ae8e73/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:10.191312 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08913c8c-8fa9-4d23-be0b-5f2dc3e808e9 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:10.191677 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08913c8c-8fa9-4d23-be0b-5f2dc3e808e9 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:10.191966 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08913c8c-8fa9-4d23-be0b-5f2dc3e808e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:10.228912 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-08913c8c-8fa9-4d23-be0b-5f2dc3e808e9 None None] MFA Rules not processed for user `e4d94b1c683447959711e9e718ae8e73`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:08:10.230440 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-08913c8c-8fa9-4d23-be0b-5f2dc3e808e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:10.372592 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1393/2767] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:08:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:08:10.373992 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f110576-8306-43bd-9845-1a68683e43fc admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:10.461851 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f110576-8306-43bd-9845-1a68683e43fc admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:10.467367 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ee6d6-ae4d-4ba4-94e8-3eea44c63de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:10.468388 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ee6d6-ae4d-4ba4-94e8-3eea44c63de9 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:10.469131 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ee6d6-ae4d-4ba4-94e8-3eea44c63de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:10.469583 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ee6d6-ae4d-4ba4-94e8-3eea44c63de9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:10.470370 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ee6d6-ae4d-4ba4-94e8-3eea44c63de9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:10.472566 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ee6d6-ae4d-4ba4-94e8-3eea44c63de9 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:10.560325 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1375/2768] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:08:10 2022] POST /identity/v3/projects => generated 367 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:08:10.564460 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08913c8c-8fa9-4d23-be0b-5f2dc3e808e9 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:10.575513 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08913c8c-8fa9-4d23-be0b-5f2dc3e808e9 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:10.630778 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d2ab1-cb38-43a0-a389-5966ee78e869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:10.631394 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d2ab1-cb38-43a0-a389-5966ee78e869 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:10.631676 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d2ab1-cb38-43a0-a389-5966ee78e869 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:10.631956 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d2ab1-cb38-43a0-a389-5966ee78e869 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:10.632661 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d2ab1-cb38-43a0-a389-5966ee78e869 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:10.634658 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d2ab1-cb38-43a0-a389-5966ee78e869 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:10.704101 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1394/2769] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:08:10 2022] POST /identity/v3/users => generated 290 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:08:10.708535 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ee6d6-ae4d-4ba4-94e8-3eea44c63de9 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:10.718842 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ee6d6-ae4d-4ba4-94e8-3eea44c63de9 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:10.724227 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485f93c-3035-4f17-bc4c-cbc4c2aa5502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:10.726509 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485f93c-3035-4f17-bc4c-cbc4c2aa5502 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:10.726509 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485f93c-3035-4f17-bc4c-cbc4c2aa5502 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:10.726509 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485f93c-3035-4f17-bc4c-cbc4c2aa5502 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:10.726815 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485f93c-3035-4f17-bc4c-cbc4c2aa5502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:10.728385 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485f93c-3035-4f17-bc4c-cbc4c2aa5502 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:10.739051 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1376/2770] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:08:10.743569 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d2ab1-cb38-43a0-a389-5966ee78e869 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:10.755907 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d2ab1-cb38-43a0-a389-5966ee78e869 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:10.760986 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b4376-3f48-4677-aa24-8fa92d5ac531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:10.761911 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b4376-3f48-4677-aa24-8fa92d5ac531 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:10.762198 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b4376-3f48-4677-aa24-8fa92d5ac531 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:10.762477 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b4376-3f48-4677-aa24-8fa92d5ac531 admin admin] PATH_INFO: `/v3/projects/198edb0421fc4733a791e01602e5fd7c/users/56db5c6566c54a2fbdc4fb30fa96bcbb/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:10.780935 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b4376-3f48-4677-aa24-8fa92d5ac531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=198edb0421fc4733a791e01602e5fd7c, user_id=56db5c6566c54a2fbdc4fb30fa96bcbb, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:10.784130 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b4376-3f48-4677-aa24-8fa92d5ac531 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:10.893330 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1395/2771] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:08:10 2022] PUT /identity/v3/projects/198edb0421fc4733a791e01602e5fd7c/users/56db5c6566c54a2fbdc4fb30fa96bcbb/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:10.897437 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485f93c-3035-4f17-bc4c-cbc4c2aa5502 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:10.906867 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485f93c-3035-4f17-bc4c-cbc4c2aa5502 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:10.964208 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da81e2-5f6d-4164-824f-21a0bf1769d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:10.964894 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da81e2-5f6d-4164-824f-21a0bf1769d5 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:10.965227 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da81e2-5f6d-4164-824f-21a0bf1769d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:10.965506 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da81e2-5f6d-4164-824f-21a0bf1769d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:10.966251 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da81e2-5f6d-4164-824f-21a0bf1769d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:10.968263 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da81e2-5f6d-4164-824f-21a0bf1769d5 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:10.988912 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b4376-3f48-4677-aa24-8fa92d5ac531 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:10.989551 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1377/2772] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:08:11.007202 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b4376-3f48-4677-aa24-8fa92d5ac531 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:11.013760 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff9659-6fa1-423a-b19e-7406ce3357dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:11.015987 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff9659-6fa1-423a-b19e-7406ce3357dd admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:11.016539 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff9659-6fa1-423a-b19e-7406ce3357dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:11.017093 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff9659-6fa1-423a-b19e-7406ce3357dd admin admin] PATH_INFO: `/v3/projects/198edb0421fc4733a791e01602e5fd7c/users/56db5c6566c54a2fbdc4fb30fa96bcbb/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:11.019445 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff9659-6fa1-423a-b19e-7406ce3357dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=198edb0421fc4733a791e01602e5fd7c, user_id=56db5c6566c54a2fbdc4fb30fa96bcbb, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:11.022781 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff9659-6fa1-423a-b19e-7406ce3357dd admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:11.037380 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1396/2773] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:08:10 2022] PUT /identity/v3/projects/198edb0421fc4733a791e01602e5fd7c/users/56db5c6566c54a2fbdc4fb30fa96bcbb/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:11.048323 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab94a6e-9a1c-4dbf-a922-cbb6d924a9bd None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:11.048545 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab94a6e-9a1c-4dbf-a922-cbb6d924a9bd None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:11.048830 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab94a6e-9a1c-4dbf-a922-cbb6d924a9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:11.084514 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-cab94a6e-9a1c-4dbf-a922-cbb6d924a9bd None None] MFA Rules not processed for user `56db5c6566c54a2fbdc4fb30fa96bcbb`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:08:11.085940 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-cab94a6e-9a1c-4dbf-a922-cbb6d924a9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:11.171043 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1378/2774] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:08:11 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:08:11.180146 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff9659-6fa1-423a-b19e-7406ce3357dd admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:11.183186 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-56ff9659-6fa1-423a-b19e-7406ce3357dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:11.255482 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff9659-6fa1-423a-b19e-7406ce3357dd admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:11.259392 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8c4c9-3b8b-4c82-8729-a4b2d30f40de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:11.265254 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8c4c9-3b8b-4c82-8729-a4b2d30f40de service cinder] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:11.265254 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8c4c9-3b8b-4c82-8729-a4b2d30f40de service cinder] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:11.265254 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8c4c9-3b8b-4c82-8729-a4b2d30f40de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:11.276250 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8c4c9-3b8b-4c82-8729-a4b2d30f40de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:11.278635 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8c4c9-3b8b-4c82-8729-a4b2d30f40de service cinder] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:11.291563 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1397/2775] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:08:11 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:08:11.491180 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab94a6e-9a1c-4dbf-a922-cbb6d924a9bd None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:11.504799 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab94a6e-9a1c-4dbf-a922-cbb6d924a9bd None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:11.511540 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b5ffb7-204a-4eb6-9dc1-c721568072a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:11.512215 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5ffb7-204a-4eb6-9dc1-c721568072a2 service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:11.512467 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5ffb7-204a-4eb6-9dc1-c721568072a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:11.512769 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5ffb7-204a-4eb6-9dc1-c721568072a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:11.570094 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b5ffb7-204a-4eb6-9dc1-c721568072a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:11.571544 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b5ffb7-204a-4eb6-9dc1-c721568072a2 service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:11.589491 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1379/2776] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:08:11 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:08:15.567814 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8c4c9-3b8b-4c82-8729-a4b2d30f40de service cinder] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:15.570157 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-72c8c4c9-3b8b-4c82-8729-a4b2d30f40de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:15.639464 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8c4c9-3b8b-4c82-8729-a4b2d30f40de service cinder] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:15.644634 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ae3a2-b9c3-4368-868c-4b09da359b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:15.645675 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ae3a2-b9c3-4368-868c-4b09da359b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:15.645959 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ae3a2-b9c3-4368-868c-4b09da359b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:15.646233 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ae3a2-b9c3-4368-868c-4b09da359b39 admin admin] PATH_INFO: `/v3/users/f5d3596bbc03474dafde93a63ea3e344` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:15.647431 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ae3a2-b9c3-4368-868c-4b09da359b39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5d3596bbc03474dafde93a63ea3e344)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:15.649470 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ae3a2-b9c3-4368-868c-4b09da359b39 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:15.866366 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-bf5ae3a2-b9c3-4368-868c-4b09da359b39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5d3596bbc03474dafde93a63ea3e344'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:15.876992 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-bf5ae3a2-b9c3-4368-868c-4b09da359b39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5d3596bbc03474dafde93a63ea3e344'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:15.877764 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-bf5ae3a2-b9c3-4368-868c-4b09da359b39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5d3596bbc03474dafde93a63ea3e344'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:15.878888 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-bf5ae3a2-b9c3-4368-868c-4b09da359b39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5d3596bbc03474dafde93a63ea3e344'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:15.958675 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-bf5ae3a2-b9c3-4368-868c-4b09da359b39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5d3596bbc03474dafde93a63ea3e344'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:15.977590 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1398/2777] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:08:15 2022] DELETE /identity/v3/users/f5d3596bbc03474dafde93a63ea3e344 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:16.261127 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b5ffb7-204a-4eb6-9dc1-c721568072a2 service cinder] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:16.272713 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b5ffb7-204a-4eb6-9dc1-c721568072a2 service cinder] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:16.330767 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddbf4eb-f0f5-4228-9e60-5418786ee498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:16.331764 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbf4eb-f0f5-4228-9e60-5418786ee498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:16.332051 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbf4eb-f0f5-4228-9e60-5418786ee498 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:16.332330 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbf4eb-f0f5-4228-9e60-5418786ee498 admin admin] PATH_INFO: `/v3/projects/c3797435200949c8a45be6c5b0525dc0` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:16.333576 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddbf4eb-f0f5-4228-9e60-5418786ee498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3797435200949c8a45be6c5b0525dc0)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:16.335489 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddbf4eb-f0f5-4228-9e60-5418786ee498 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:16.441265 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-6ddbf4eb-f0f5-4228-9e60-5418786ee498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3797435200949c8a45be6c5b0525dc0', 'request_id': 'req-6ddbf4eb-f0f5-4228-9e60-5418786ee498'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:16.447633 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-6ddbf4eb-f0f5-4228-9e60-5418786ee498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3797435200949c8a45be6c5b0525dc0', 'request_id': 'req-6ddbf4eb-f0f5-4228-9e60-5418786ee498'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:16.453134 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-6ddbf4eb-f0f5-4228-9e60-5418786ee498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3797435200949c8a45be6c5b0525dc0', 'request_id': 'req-6ddbf4eb-f0f5-4228-9e60-5418786ee498'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:16.537901 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-6ddbf4eb-f0f5-4228-9e60-5418786ee498 admin admin] The token cache is being invalidate because project c3797435200949c8a45be6c5b0525dc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:08:16.538214 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-6ddbf4eb-f0f5-4228-9e60-5418786ee498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:16.538858 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-6ddbf4eb-f0f5-4228-9e60-5418786ee498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:16.540421 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1380/2778] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:08:16 2022] DELETE /identity/v3/projects/c3797435200949c8a45be6c5b0525dc0 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:16.544359 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ae3a2-b9c3-4368-868c-4b09da359b39 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:16.545788 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-bf5ae3a2-b9c3-4368-868c-4b09da359b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:16.560547 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ae3a2-b9c3-4368-868c-4b09da359b39 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:16.617317 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a498d8-7049-4ecd-a392-d46c4fbf63c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:16.618188 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a498d8-7049-4ecd-a392-d46c4fbf63c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:16.618469 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a498d8-7049-4ecd-a392-d46c4fbf63c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:16.618744 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a498d8-7049-4ecd-a392-d46c4fbf63c0 admin admin] PATH_INFO: `/v3/users/0b556d32ef164705a403d0dcd9df62f8` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:16.619934 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a498d8-7049-4ecd-a392-d46c4fbf63c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b556d32ef164705a403d0dcd9df62f8)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:16.622241 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a498d8-7049-4ecd-a392-d46c4fbf63c0 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:16.829144 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-89a498d8-7049-4ecd-a392-d46c4fbf63c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b556d32ef164705a403d0dcd9df62f8'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:16.836171 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-89a498d8-7049-4ecd-a392-d46c4fbf63c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b556d32ef164705a403d0dcd9df62f8'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:16.836823 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-89a498d8-7049-4ecd-a392-d46c4fbf63c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b556d32ef164705a403d0dcd9df62f8'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:16.837443 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-89a498d8-7049-4ecd-a392-d46c4fbf63c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b556d32ef164705a403d0dcd9df62f8'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:16.918678 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-89a498d8-7049-4ecd-a392-d46c4fbf63c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b556d32ef164705a403d0dcd9df62f8'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:16.936148 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1399/2779] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:08:16 2022] DELETE /identity/v3/users/0b556d32ef164705a403d0dcd9df62f8 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:17.252236 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddbf4eb-f0f5-4228-9e60-5418786ee498 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:17.254242 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-6ddbf4eb-f0f5-4228-9e60-5418786ee498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:17.269837 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddbf4eb-f0f5-4228-9e60-5418786ee498 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:17.327405 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58223b-0325-40ad-97e0-65884398e835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:17.328087 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58223b-0325-40ad-97e0-65884398e835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:17.328369 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58223b-0325-40ad-97e0-65884398e835 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:17.329916 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58223b-0325-40ad-97e0-65884398e835 admin admin] PATH_INFO: `/v3/projects/876c395cd3f14110b4af4a7988e9b4c1` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:17.330017 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58223b-0325-40ad-97e0-65884398e835 admin admin] RBAC: Authorizing `identity:delete_project(project_id=876c395cd3f14110b4af4a7988e9b4c1)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:17.332494 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58223b-0325-40ad-97e0-65884398e835 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:17.440503 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4e58223b-0325-40ad-97e0-65884398e835 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '876c395cd3f14110b4af4a7988e9b4c1', 'request_id': 'req-4e58223b-0325-40ad-97e0-65884398e835'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:17.447994 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4e58223b-0325-40ad-97e0-65884398e835 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '876c395cd3f14110b4af4a7988e9b4c1', 'request_id': 'req-4e58223b-0325-40ad-97e0-65884398e835'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:17.453503 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4e58223b-0325-40ad-97e0-65884398e835 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '876c395cd3f14110b4af4a7988e9b4c1', 'request_id': 'req-4e58223b-0325-40ad-97e0-65884398e835'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:17.537378 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4e58223b-0325-40ad-97e0-65884398e835 admin admin] The token cache is being invalidate because project 876c395cd3f14110b4af4a7988e9b4c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:08:17.537669 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4e58223b-0325-40ad-97e0-65884398e835 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:17.538286 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-4e58223b-0325-40ad-97e0-65884398e835 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:17.539845 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1381/2780] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:08:17 2022] DELETE /identity/v3/projects/876c395cd3f14110b4af4a7988e9b4c1 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:18.014725 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a498d8-7049-4ecd-a392-d46c4fbf63c0 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:18.016139 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-89a498d8-7049-4ecd-a392-d46c4fbf63c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:18.030071 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a498d8-7049-4ecd-a392-d46c4fbf63c0 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:18.086710 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c5da6-b86e-4f36-aac3-9206d4e4153c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:18.087615 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c5da6-b86e-4f36-aac3-9206d4e4153c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:18.087895 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c5da6-b86e-4f36-aac3-9206d4e4153c admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:18.088310 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c5da6-b86e-4f36-aac3-9206d4e4153c admin admin] PATH_INFO: `/v3/users/e4d94b1c683447959711e9e718ae8e73` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:18.089407 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c5da6-b86e-4f36-aac3-9206d4e4153c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4d94b1c683447959711e9e718ae8e73)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:18.091365 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c5da6-b86e-4f36-aac3-9206d4e4153c admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:18.307049 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-347c5da6-b86e-4f36-aac3-9206d4e4153c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4d94b1c683447959711e9e718ae8e73'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:18.313703 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-347c5da6-b86e-4f36-aac3-9206d4e4153c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4d94b1c683447959711e9e718ae8e73'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:18.314494 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-347c5da6-b86e-4f36-aac3-9206d4e4153c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4d94b1c683447959711e9e718ae8e73'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:18.315006 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-347c5da6-b86e-4f36-aac3-9206d4e4153c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4d94b1c683447959711e9e718ae8e73'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:18.383823 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-347c5da6-b86e-4f36-aac3-9206d4e4153c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4d94b1c683447959711e9e718ae8e73'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:18.402884 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1400/2781] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:08:18 2022] DELETE /identity/v3/users/e4d94b1c683447959711e9e718ae8e73 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:18.407570 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba63889-0aed-4397-9d47-1cb1a1193c5e None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:18.408086 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba63889-0aed-4397-9d47-1cb1a1193c5e None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:18.408188 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba63889-0aed-4397-9d47-1cb1a1193c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:18.426173 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-0ba63889-0aed-4397-9d47-1cb1a1193c5e None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:08:18.427370 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-0ba63889-0aed-4397-9d47-1cb1a1193c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:18.485412 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1382/2782] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:08:18.495307 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c5da6-b86e-4f36-aac3-9206d4e4153c admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:18.496893 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-347c5da6-b86e-4f36-aac3-9206d4e4153c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:18.555753 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c5da6-b86e-4f36-aac3-9206d4e4153c admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:18.559451 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedc848-c056-4c91-b20d-bb06e63c5237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:18.560270 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedc848-c056-4c91-b20d-bb06e63c5237 service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:18.560556 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedc848-c056-4c91-b20d-bb06e63c5237 service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:18.560959 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedc848-c056-4c91-b20d-bb06e63c5237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:18.570549 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaedc848-c056-4c91-b20d-bb06e63c5237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:18.572002 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaedc848-c056-4c91-b20d-bb06e63c5237 service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:18.581327 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1401/2783] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:08:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:08:19.011998 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba63889-0aed-4397-9d47-1cb1a1193c5e None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:19.013511 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-0ba63889-0aed-4397-9d47-1cb1a1193c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:19.026904 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba63889-0aed-4397-9d47-1cb1a1193c5e None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:19.034878 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98f5e6-ac64-4f49-8729-15a0917a75d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:19.035752 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98f5e6-ac64-4f49-8729-15a0917a75d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:19.036030 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98f5e6-ac64-4f49-8729-15a0917a75d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:19.036299 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98f5e6-ac64-4f49-8729-15a0917a75d5 admin admin] PATH_INFO: `/v3/projects/7e02f9353cea4eaea7f1beedad4ca84a` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:19.037625 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98f5e6-ac64-4f49-8729-15a0917a75d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e02f9353cea4eaea7f1beedad4ca84a)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:19.039693 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98f5e6-ac64-4f49-8729-15a0917a75d5 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:19.215577 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-bc98f5e6-ac64-4f49-8729-15a0917a75d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e02f9353cea4eaea7f1beedad4ca84a', 'request_id': 'req-bc98f5e6-ac64-4f49-8729-15a0917a75d5'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:19.221794 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-bc98f5e6-ac64-4f49-8729-15a0917a75d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e02f9353cea4eaea7f1beedad4ca84a', 'request_id': 'req-bc98f5e6-ac64-4f49-8729-15a0917a75d5'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:19.227588 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-bc98f5e6-ac64-4f49-8729-15a0917a75d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e02f9353cea4eaea7f1beedad4ca84a', 'request_id': 'req-bc98f5e6-ac64-4f49-8729-15a0917a75d5'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:19.354865 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-bc98f5e6-ac64-4f49-8729-15a0917a75d5 admin admin] The token cache is being invalidate because project 7e02f9353cea4eaea7f1beedad4ca84a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:08:19.355149 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-bc98f5e6-ac64-4f49-8729-15a0917a75d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:19.355801 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-bc98f5e6-ac64-4f49-8729-15a0917a75d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:19.358375 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1383/2784] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:08:19 2022] DELETE /identity/v3/projects/7e02f9353cea4eaea7f1beedad4ca84a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:08:19.362118 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedc848-c056-4c91-b20d-bb06e63c5237 service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:19.372486 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedc848-c056-4c91-b20d-bb06e63c5237 service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:19.429546 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6e968-3b78-447a-9ba4-97a962c43864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:19.430425 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6e968-3b78-447a-9ba4-97a962c43864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:19.430713 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6e968-3b78-447a-9ba4-97a962c43864 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:19.430993 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6e968-3b78-447a-9ba4-97a962c43864 admin admin] PATH_INFO: `/v3/users/56db5c6566c54a2fbdc4fb30fa96bcbb` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:19.432225 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6e968-3b78-447a-9ba4-97a962c43864 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56db5c6566c54a2fbdc4fb30fa96bcbb)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:19.434213 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6e968-3b78-447a-9ba4-97a962c43864 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:19.609846 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a6b6e968-3b78-447a-9ba4-97a962c43864 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56db5c6566c54a2fbdc4fb30fa96bcbb'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:19.617677 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a6b6e968-3b78-447a-9ba4-97a962c43864 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56db5c6566c54a2fbdc4fb30fa96bcbb'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:19.618392 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a6b6e968-3b78-447a-9ba4-97a962c43864 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56db5c6566c54a2fbdc4fb30fa96bcbb'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:19.618998 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a6b6e968-3b78-447a-9ba4-97a962c43864 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56db5c6566c54a2fbdc4fb30fa96bcbb'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:19.695706 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-a6b6e968-3b78-447a-9ba4-97a962c43864 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56db5c6566c54a2fbdc4fb30fa96bcbb'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:19.713263 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1402/2785] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:08:19 2022] DELETE /identity/v3/users/56db5c6566c54a2fbdc4fb30fa96bcbb => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:20.134412 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98f5e6-ac64-4f49-8729-15a0917a75d5 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:20.135859 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-bc98f5e6-ac64-4f49-8729-15a0917a75d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:20.150228 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98f5e6-ac64-4f49-8729-15a0917a75d5 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:20.206403 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed936b29-769f-468b-b810-2194d0b109b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:20.207455 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed936b29-769f-468b-b810-2194d0b109b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:20.207739 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed936b29-769f-468b-b810-2194d0b109b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:20.208081 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed936b29-769f-468b-b810-2194d0b109b7 admin admin] PATH_INFO: `/v3/projects/198edb0421fc4733a791e01602e5fd7c` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:20.209625 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed936b29-769f-468b-b810-2194d0b109b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=198edb0421fc4733a791e01602e5fd7c)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:20.212520 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed936b29-769f-468b-b810-2194d0b109b7 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:20.327183 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ed936b29-769f-468b-b810-2194d0b109b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '198edb0421fc4733a791e01602e5fd7c', 'request_id': 'req-ed936b29-769f-468b-b810-2194d0b109b7'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:20.333575 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ed936b29-769f-468b-b810-2194d0b109b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '198edb0421fc4733a791e01602e5fd7c', 'request_id': 'req-ed936b29-769f-468b-b810-2194d0b109b7'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:20.340575 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ed936b29-769f-468b-b810-2194d0b109b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '198edb0421fc4733a791e01602e5fd7c', 'request_id': 'req-ed936b29-769f-468b-b810-2194d0b109b7'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:20.416036 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ed936b29-769f-468b-b810-2194d0b109b7 admin admin] The token cache is being invalidate because project 198edb0421fc4733a791e01602e5fd7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:08:20.416285 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ed936b29-769f-468b-b810-2194d0b109b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:20.416854 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-ed936b29-769f-468b-b810-2194d0b109b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:20.418409 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1384/2786] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:08:20 2022] DELETE /identity/v3/projects/198edb0421fc4733a791e01602e5fd7c => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:20.424107 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107402b-ec7d-43f4-b56f-5130275013ac None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:20.424692 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107402b-ec7d-43f4-b56f-5130275013ac None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:20.424692 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107402b-ec7d-43f4-b56f-5130275013ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:20.442241 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-c107402b-ec7d-43f4-b56f-5130275013ac None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:08:20.443522 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-c107402b-ec7d-43f4-b56f-5130275013ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:20.503180 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1403/2787] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:08:20.512529 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1793a-ffc7-462c-b2bf-69d91233013f None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:20.512529 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1793a-ffc7-462c-b2bf-69d91233013f None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:20.512718 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1793a-ffc7-462c-b2bf-69d91233013f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:20.531482 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-6ca1793a-ffc7-462c-b2bf-69d91233013f None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:08:20.532654 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-6ca1793a-ffc7-462c-b2bf-69d91233013f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:20.541708 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1385/2788] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:08:20.545919 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107402b-ec7d-43f4-b56f-5130275013ac None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:20.556313 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107402b-ec7d-43f4-b56f-5130275013ac None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:20.560925 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70761825-3e6c-45f3-ae4a-0dc394607ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:20.561606 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70761825-3e6c-45f3-ae4a-0dc394607ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:20.561892 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70761825-3e6c-45f3-ae4a-0dc394607ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:20.562182 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70761825-3e6c-45f3-ae4a-0dc394607ff1 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:20.562892 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70761825-3e6c-45f3-ae4a-0dc394607ff1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:08:20.563201 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70761825-3e6c-45f3-ae4a-0dc394607ff1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:20.564806 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70761825-3e6c-45f3-ae4a-0dc394607ff1 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:20.576888 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1404/2789] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 15:08:20.581032 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1793a-ffc7-462c-b2bf-69d91233013f None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:20.590829 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1793a-ffc7-462c-b2bf-69d91233013f None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:20.595420 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7825c8-8c1a-448c-98c4-32c569537cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:20.596060 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7825c8-8c1a-448c-98c4-32c569537cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:20.596338 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7825c8-8c1a-448c-98c4-32c569537cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:20.596611 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7825c8-8c1a-448c-98c4-32c569537cb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:20.597351 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7825c8-8c1a-448c-98c4-32c569537cb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:20.599234 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7825c8-8c1a-448c-98c4-32c569537cb8 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:20.714281 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1386/2790] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:08:20 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:08:20.718330 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70761825-3e6c-45f3-ae4a-0dc394607ff1 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:20.729176 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70761825-3e6c-45f3-ae4a-0dc394607ff1 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:20.784864 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245cf5f1-1f70-400e-89e3-bf01d48ee3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:20.785619 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cf5f1-1f70-400e-89e3-bf01d48ee3b3 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:20.785884 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cf5f1-1f70-400e-89e3-bf01d48ee3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:20.786157 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cf5f1-1f70-400e-89e3-bf01d48ee3b3 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:20.786852 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245cf5f1-1f70-400e-89e3-bf01d48ee3b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:20.788738 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245cf5f1-1f70-400e-89e3-bf01d48ee3b3 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:20.905934 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1405/2791] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:08:20 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:08:20.907345 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7825c8-8c1a-448c-98c4-32c569537cb8 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:20.918049 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7825c8-8c1a-448c-98c4-32c569537cb8 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:20.922604 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9531c-7c5f-4a15-8525-d012be1793ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:20.923237 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9531c-7c5f-4a15-8525-d012be1793ec admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:20.923519 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9531c-7c5f-4a15-8525-d012be1793ec admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:20.923793 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9531c-7c5f-4a15-8525-d012be1793ec admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:20.924526 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9531c-7c5f-4a15-8525-d012be1793ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:20.926144 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9531c-7c5f-4a15-8525-d012be1793ec admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:20.936737 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1387/2792] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:08:20.940817 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245cf5f1-1f70-400e-89e3-bf01d48ee3b3 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:20.950956 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245cf5f1-1f70-400e-89e3-bf01d48ee3b3 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:20.955834 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54f986-61d2-41ed-b0e5-4630905fba7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:20.956482 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54f986-61d2-41ed-b0e5-4630905fba7e admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:20.956768 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54f986-61d2-41ed-b0e5-4630905fba7e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:20.957047 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54f986-61d2-41ed-b0e5-4630905fba7e admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:20.957855 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54f986-61d2-41ed-b0e5-4630905fba7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:20.959539 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54f986-61d2-41ed-b0e5-4630905fba7e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:20.969497 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1406/2793] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:08:20.973495 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9531c-7c5f-4a15-8525-d012be1793ec admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:20.984048 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9531c-7c5f-4a15-8525-d012be1793ec admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:20.988679 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6c8b5-5272-442b-8010-169681b394b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:20.989573 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6c8b5-5272-442b-8010-169681b394b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:20.989854 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6c8b5-5272-442b-8010-169681b394b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:20.990148 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6c8b5-5272-442b-8010-169681b394b3 admin admin] PATH_INFO: `/v3/projects/216f79b6ebc44d92b702aacc72834974/users/d6e0f1a728fb4d659a22c8d6147019d0/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:21.005380 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6c8b5-5272-442b-8010-169681b394b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=216f79b6ebc44d92b702aacc72834974, user_id=d6e0f1a728fb4d659a22c8d6147019d0, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:21.009303 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6c8b5-5272-442b-8010-169681b394b3 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:21.120969 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1388/2794] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:08:20 2022] PUT /identity/v3/projects/216f79b6ebc44d92b702aacc72834974/users/d6e0f1a728fb4d659a22c8d6147019d0/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:08:21.132076 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fcace-64c7-47ae-9dad-b2bace01689a None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:21.132370 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fcace-64c7-47ae-9dad-b2bace01689a None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:21.132651 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fcace-64c7-47ae-9dad-b2bace01689a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:21.158684 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-821fcace-64c7-47ae-9dad-b2bace01689a None None] MFA Rules not processed for user `d6e0f1a728fb4d659a22c8d6147019d0`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:08:21.159917 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-821fcace-64c7-47ae-9dad-b2bace01689a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:21.222559 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1407/2795] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:08:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:08:21.227955 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6c8b5-5272-442b-8010-169681b394b3 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:21.285291 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6c8b5-5272-442b-8010-169681b394b3 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:21.290530 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b50cb-f535-4741-b346-706c62d5a734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:21.291172 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b50cb-f535-4741-b346-706c62d5a734 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:21.291451 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b50cb-f535-4741-b346-706c62d5a734 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:21.291721 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b50cb-f535-4741-b346-706c62d5a734 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:21.292403 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b50cb-f535-4741-b346-706c62d5a734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:21.294299 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b50cb-f535-4741-b346-706c62d5a734 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:21.367957 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1389/2796] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:08:21 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:08:21.371970 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fcace-64c7-47ae-9dad-b2bace01689a None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:21.383326 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fcace-64c7-47ae-9dad-b2bace01689a None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:21.446762 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f292c-d69f-4a62-a883-94a4740358ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:21.447422 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f292c-d69f-4a62-a883-94a4740358ba admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:21.447705 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f292c-d69f-4a62-a883-94a4740358ba admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:21.447994 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f292c-d69f-4a62-a883-94a4740358ba admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:21.448700 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f292c-d69f-4a62-a883-94a4740358ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:21.450637 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f292c-d69f-4a62-a883-94a4740358ba admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:21.542014 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1408/2797] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:08:21 2022] POST /identity/v3/users => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:08:21.545999 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b50cb-f535-4741-b346-706c62d5a734 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:21.556042 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b50cb-f535-4741-b346-706c62d5a734 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:21.560610 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de642d-0585-4a88-8044-f1cc0d51cabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:21.561299 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de642d-0585-4a88-8044-f1cc0d51cabe admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:21.561586 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de642d-0585-4a88-8044-f1cc0d51cabe admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:21.561862 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de642d-0585-4a88-8044-f1cc0d51cabe admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:21.562601 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de642d-0585-4a88-8044-f1cc0d51cabe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:21.564178 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de642d-0585-4a88-8044-f1cc0d51cabe admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:21.574207 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1390/2798] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:08:21.578153 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f292c-d69f-4a62-a883-94a4740358ba admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:21.588300 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f292c-d69f-4a62-a883-94a4740358ba admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:21.592884 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522a44e-8681-40a0-8e95-976cd4683eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:21.593775 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522a44e-8681-40a0-8e95-976cd4683eab admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:21.594054 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522a44e-8681-40a0-8e95-976cd4683eab admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:21.594328 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522a44e-8681-40a0-8e95-976cd4683eab admin admin] PATH_INFO: `/v3/projects/05eecfab7b0545838340ed51b0e088b5/users/ebb86de71c3e4ebc9df874d24a5809ab/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:21.609317 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522a44e-8681-40a0-8e95-976cd4683eab admin admin] RBAC: Authorizing `identity:create_grant(project_id=05eecfab7b0545838340ed51b0e088b5, user_id=ebb86de71c3e4ebc9df874d24a5809ab, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:21.611935 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522a44e-8681-40a0-8e95-976cd4683eab admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:21.701393 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1409/2799] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:08:21 2022] PUT /identity/v3/projects/05eecfab7b0545838340ed51b0e088b5/users/ebb86de71c3e4ebc9df874d24a5809ab/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 05 15:08:21.705312 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de642d-0585-4a88-8044-f1cc0d51cabe admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:21.715667 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de642d-0585-4a88-8044-f1cc0d51cabe admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:21.768903 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7ecc3-246a-45fd-9649-705242366eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:21.769585 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7ecc3-246a-45fd-9649-705242366eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:21.769865 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7ecc3-246a-45fd-9649-705242366eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:21.770139 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7ecc3-246a-45fd-9649-705242366eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:21.770857 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7ecc3-246a-45fd-9649-705242366eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:21.772438 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7ecc3-246a-45fd-9649-705242366eb8 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:21.782508 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1391/2800] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:08:21.786616 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522a44e-8681-40a0-8e95-976cd4683eab admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:21.796678 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522a44e-8681-40a0-8e95-976cd4683eab admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:21.801409 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be487e15-c6ee-4beb-9a8a-0a5950289fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:21.802275 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be487e15-c6ee-4beb-9a8a-0a5950289fdc admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:21.802565 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be487e15-c6ee-4beb-9a8a-0a5950289fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:21.802830 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be487e15-c6ee-4beb-9a8a-0a5950289fdc admin admin] PATH_INFO: `/v3/projects/05eecfab7b0545838340ed51b0e088b5/users/ebb86de71c3e4ebc9df874d24a5809ab/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:21.804801 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be487e15-c6ee-4beb-9a8a-0a5950289fdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=05eecfab7b0545838340ed51b0e088b5, user_id=ebb86de71c3e4ebc9df874d24a5809ab, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:21.807549 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be487e15-c6ee-4beb-9a8a-0a5950289fdc admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:21.817641 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1410/2801] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:08:21 2022] PUT /identity/v3/projects/05eecfab7b0545838340ed51b0e088b5/users/ebb86de71c3e4ebc9df874d24a5809ab/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:21.828142 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111642f-6e76-4c85-87b6-4592d594d93d None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:21.828434 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111642f-6e76-4c85-87b6-4592d594d93d None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:21.828717 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111642f-6e76-4c85-87b6-4592d594d93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:21.855246 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-8111642f-6e76-4c85-87b6-4592d594d93d None None] MFA Rules not processed for user `ebb86de71c3e4ebc9df874d24a5809ab`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:08:21.856461 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-8111642f-6e76-4c85-87b6-4592d594d93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:21.918480 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1392/2802] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:08:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:08:21.927903 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be487e15-c6ee-4beb-9a8a-0a5950289fdc admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:21.929609 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-be487e15-c6ee-4beb-9a8a-0a5950289fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:21.984472 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be487e15-c6ee-4beb-9a8a-0a5950289fdc admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:21.988047 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c81ab7-128b-40e0-80c0-4ff60bf57cd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:21.988665 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c81ab7-128b-40e0-80c0-4ff60bf57cd2 service cinder] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:21.988943 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c81ab7-128b-40e0-80c0-4ff60bf57cd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:21.989248 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c81ab7-128b-40e0-80c0-4ff60bf57cd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:22.042542 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c81ab7-128b-40e0-80c0-4ff60bf57cd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:22.043890 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c81ab7-128b-40e0-80c0-4ff60bf57cd2 service cinder] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:22.052415 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1411/2803] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:08:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:08:27.235883 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111642f-6e76-4c85-87b6-4592d594d93d None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:27.245934 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111642f-6e76-4c85-87b6-4592d594d93d None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:27.249552 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60e9f3-298a-4ada-8fa5-f9033cf50786 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:27.250182 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60e9f3-298a-4ada-8fa5-f9033cf50786 service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:27.250465 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60e9f3-298a-4ada-8fa5-f9033cf50786 service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:27.250739 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60e9f3-298a-4ada-8fa5-f9033cf50786 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:27.260275 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60e9f3-298a-4ada-8fa5-f9033cf50786 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:27.261733 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60e9f3-298a-4ada-8fa5-f9033cf50786 service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:27.270822 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1393/2804] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:08:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:08:33.095954 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c81ab7-128b-40e0-80c0-4ff60bf57cd2 service cinder] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:33.157903 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c81ab7-128b-40e0-80c0-4ff60bf57cd2 service cinder] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:33.162499 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efa60f-1a0c-410c-997c-4c6f77277dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:33.163367 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efa60f-1a0c-410c-997c-4c6f77277dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:33.163648 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efa60f-1a0c-410c-997c-4c6f77277dec admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:33.163924 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efa60f-1a0c-410c-997c-4c6f77277dec admin admin] PATH_INFO: `/v3/users/d6e0f1a728fb4d659a22c8d6147019d0` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:33.165177 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61efa60f-1a0c-410c-997c-4c6f77277dec admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6e0f1a728fb4d659a22c8d6147019d0)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:33.167146 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61efa60f-1a0c-410c-997c-4c6f77277dec admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:33.337116 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-61efa60f-1a0c-410c-997c-4c6f77277dec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6e0f1a728fb4d659a22c8d6147019d0'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:33.344003 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-61efa60f-1a0c-410c-997c-4c6f77277dec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6e0f1a728fb4d659a22c8d6147019d0'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:33.344684 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-61efa60f-1a0c-410c-997c-4c6f77277dec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6e0f1a728fb4d659a22c8d6147019d0'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:33.345322 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-61efa60f-1a0c-410c-997c-4c6f77277dec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6e0f1a728fb4d659a22c8d6147019d0'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:33.440391 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-61efa60f-1a0c-410c-997c-4c6f77277dec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6e0f1a728fb4d659a22c8d6147019d0'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:33.457923 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1412/2805] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:08:33 2022] DELETE /identity/v3/users/d6e0f1a728fb4d659a22c8d6147019d0 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:33.462622 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa77a66-793d-4951-9aff-955df4acab62 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:33.463123 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa77a66-793d-4951-9aff-955df4acab62 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:33.463231 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa77a66-793d-4951-9aff-955df4acab62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:33.480608 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-baa77a66-793d-4951-9aff-955df4acab62 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:08:33.481836 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-baa77a66-793d-4951-9aff-955df4acab62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:33.538307 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1394/2806] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:08:33.547995 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efa60f-1a0c-410c-997c-4c6f77277dec admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:33.549481 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-61efa60f-1a0c-410c-997c-4c6f77277dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:33.737600 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efa60f-1a0c-410c-997c-4c6f77277dec admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:33.741191 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1f11a-daa2-4ec3-a758-5e31b57e2740 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:33.741826 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1f11a-daa2-4ec3-a758-5e31b57e2740 service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:33.742110 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1f11a-daa2-4ec3-a758-5e31b57e2740 service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:33.742386 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1f11a-daa2-4ec3-a758-5e31b57e2740 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:33.752145 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1f11a-daa2-4ec3-a758-5e31b57e2740 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:33.753617 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1f11a-daa2-4ec3-a758-5e31b57e2740 service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:33.763356 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1413/2807] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:08:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:08:34.270982 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa77a66-793d-4951-9aff-955df4acab62 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:34.272417 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-baa77a66-793d-4951-9aff-955df4acab62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:34.284789 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa77a66-793d-4951-9aff-955df4acab62 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:34.290126 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10590f0f-f387-40cb-92f1-a9738db7c751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:34.290994 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10590f0f-f387-40cb-92f1-a9738db7c751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:34.291276 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10590f0f-f387-40cb-92f1-a9738db7c751 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:34.291555 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10590f0f-f387-40cb-92f1-a9738db7c751 admin admin] PATH_INFO: `/v3/projects/216f79b6ebc44d92b702aacc72834974` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:34.292754 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10590f0f-f387-40cb-92f1-a9738db7c751 admin admin] RBAC: Authorizing `identity:delete_project(project_id=216f79b6ebc44d92b702aacc72834974)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:34.294698 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10590f0f-f387-40cb-92f1-a9738db7c751 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:34.546170 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-10590f0f-f387-40cb-92f1-a9738db7c751 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '216f79b6ebc44d92b702aacc72834974', 'request_id': 'req-10590f0f-f387-40cb-92f1-a9738db7c751'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:34.552520 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-10590f0f-f387-40cb-92f1-a9738db7c751 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '216f79b6ebc44d92b702aacc72834974', 'request_id': 'req-10590f0f-f387-40cb-92f1-a9738db7c751'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:34.558091 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-10590f0f-f387-40cb-92f1-a9738db7c751 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '216f79b6ebc44d92b702aacc72834974', 'request_id': 'req-10590f0f-f387-40cb-92f1-a9738db7c751'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:34.649969 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-10590f0f-f387-40cb-92f1-a9738db7c751 admin admin] The token cache is being invalidate because project 216f79b6ebc44d92b702aacc72834974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:08:34.650243 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-10590f0f-f387-40cb-92f1-a9738db7c751 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:34.650865 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-10590f0f-f387-40cb-92f1-a9738db7c751 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:34.652390 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1395/2808] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:08:34 2022] DELETE /identity/v3/projects/216f79b6ebc44d92b702aacc72834974 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:34.656457 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1f11a-daa2-4ec3-a758-5e31b57e2740 service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:34.665818 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1f11a-daa2-4ec3-a758-5e31b57e2740 service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:34.720994 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329c1ba-3cf2-41b5-aeb5-cceea17676cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:34.721882 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329c1ba-3cf2-41b5-aeb5-cceea17676cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:34.722192 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329c1ba-3cf2-41b5-aeb5-cceea17676cc admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:34.722468 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329c1ba-3cf2-41b5-aeb5-cceea17676cc admin admin] PATH_INFO: `/v3/users/ebb86de71c3e4ebc9df874d24a5809ab` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:34.723651 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329c1ba-3cf2-41b5-aeb5-cceea17676cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebb86de71c3e4ebc9df874d24a5809ab)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:34.725943 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329c1ba-3cf2-41b5-aeb5-cceea17676cc admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:34.925003 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-5329c1ba-3cf2-41b5-aeb5-cceea17676cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebb86de71c3e4ebc9df874d24a5809ab'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:34.932265 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-5329c1ba-3cf2-41b5-aeb5-cceea17676cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebb86de71c3e4ebc9df874d24a5809ab'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:34.936406 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-5329c1ba-3cf2-41b5-aeb5-cceea17676cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebb86de71c3e4ebc9df874d24a5809ab'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:34.936406 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-5329c1ba-3cf2-41b5-aeb5-cceea17676cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebb86de71c3e4ebc9df874d24a5809ab'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:35.009797 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-5329c1ba-3cf2-41b5-aeb5-cceea17676cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebb86de71c3e4ebc9df874d24a5809ab'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:35.026298 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1414/2809] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:08:34 2022] DELETE /identity/v3/users/ebb86de71c3e4ebc9df874d24a5809ab => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:35.407465 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10590f0f-f387-40cb-92f1-a9738db7c751 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:35.408950 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-10590f0f-f387-40cb-92f1-a9738db7c751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:35.425110 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10590f0f-f387-40cb-92f1-a9738db7c751 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:35.477706 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be273a-3abd-4cc4-8a28-fcff9c3ca8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:35.479225 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be273a-3abd-4cc4-8a28-fcff9c3ca8d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:35.479507 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be273a-3abd-4cc4-8a28-fcff9c3ca8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:35.479805 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be273a-3abd-4cc4-8a28-fcff9c3ca8d1 admin admin] PATH_INFO: `/v3/projects/05eecfab7b0545838340ed51b0e088b5` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:35.480985 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be273a-3abd-4cc4-8a28-fcff9c3ca8d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05eecfab7b0545838340ed51b0e088b5)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:35.482963 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be273a-3abd-4cc4-8a28-fcff9c3ca8d1 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:35.594099 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-65be273a-3abd-4cc4-8a28-fcff9c3ca8d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05eecfab7b0545838340ed51b0e088b5', 'request_id': 'req-65be273a-3abd-4cc4-8a28-fcff9c3ca8d1'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:35.600069 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-65be273a-3abd-4cc4-8a28-fcff9c3ca8d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05eecfab7b0545838340ed51b0e088b5', 'request_id': 'req-65be273a-3abd-4cc4-8a28-fcff9c3ca8d1'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:35.606222 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-65be273a-3abd-4cc4-8a28-fcff9c3ca8d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05eecfab7b0545838340ed51b0e088b5', 'request_id': 'req-65be273a-3abd-4cc4-8a28-fcff9c3ca8d1'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:35.668142 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-65be273a-3abd-4cc4-8a28-fcff9c3ca8d1 admin admin] The token cache is being invalidate because project 05eecfab7b0545838340ed51b0e088b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:08:35.668425 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-65be273a-3abd-4cc4-8a28-fcff9c3ca8d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:35.669048 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-65be273a-3abd-4cc4-8a28-fcff9c3ca8d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:35.670585 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1396/2810] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:08:35 2022] DELETE /identity/v3/projects/05eecfab7b0545838340ed51b0e088b5 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:35.677323 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765b7ea-0a33-43cf-8fa0-4af39ff040b3 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:35.677793 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765b7ea-0a33-43cf-8fa0-4af39ff040b3 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:35.677897 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765b7ea-0a33-43cf-8fa0-4af39ff040b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:35.695705 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-3765b7ea-0a33-43cf-8fa0-4af39ff040b3 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:08:35.696805 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-3765b7ea-0a33-43cf-8fa0-4af39ff040b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:35.752831 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1415/2811] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:08:35.761786 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea7028-aff3-4989-8e51-ea7e7f99888e None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:35.762078 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea7028-aff3-4989-8e51-ea7e7f99888e None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:35.762353 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea7028-aff3-4989-8e51-ea7e7f99888e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:35.780729 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-f0ea7028-aff3-4989-8e51-ea7e7f99888e None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:08:35.781938 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-f0ea7028-aff3-4989-8e51-ea7e7f99888e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:35.789633 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1397/2812] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:08:35.793822 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765b7ea-0a33-43cf-8fa0-4af39ff040b3 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:35.802927 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765b7ea-0a33-43cf-8fa0-4af39ff040b3 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:35.807394 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03bf614-5460-4611-ba42-725dc5a4e61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:35.808027 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bf614-5460-4611-ba42-725dc5a4e61a admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:35.808304 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bf614-5460-4611-ba42-725dc5a4e61a admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:35.808575 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bf614-5460-4611-ba42-725dc5a4e61a admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:35.809334 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03bf614-5460-4611-ba42-725dc5a4e61a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:08:35.809636 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03bf614-5460-4611-ba42-725dc5a4e61a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:35.811243 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03bf614-5460-4611-ba42-725dc5a4e61a admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:35.822715 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1416/2813] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 15:08:35.826917 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea7028-aff3-4989-8e51-ea7e7f99888e None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:35.835830 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea7028-aff3-4989-8e51-ea7e7f99888e None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:35.841141 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a9734-ae5e-4095-9a9d-095299f83349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:35.841784 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a9734-ae5e-4095-9a9d-095299f83349 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:35.842067 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a9734-ae5e-4095-9a9d-095299f83349 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:35.842345 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a9734-ae5e-4095-9a9d-095299f83349 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:35.843050 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a9734-ae5e-4095-9a9d-095299f83349 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:35.844928 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a9734-ae5e-4095-9a9d-095299f83349 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:35.926785 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1398/2814] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:08:35 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:08:35.930918 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03bf614-5460-4611-ba42-725dc5a4e61a admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:35.940673 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03bf614-5460-4611-ba42-725dc5a4e61a admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:35.993701 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3805c4-2ce2-473c-8127-125e6ee1256f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:35.994284 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3805c4-2ce2-473c-8127-125e6ee1256f admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:35.994567 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3805c4-2ce2-473c-8127-125e6ee1256f admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:35.994847 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3805c4-2ce2-473c-8127-125e6ee1256f admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:35.995543 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3805c4-2ce2-473c-8127-125e6ee1256f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:35.997477 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3805c4-2ce2-473c-8127-125e6ee1256f admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:36.089913 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1417/2815] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:08:35 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:08:36.094173 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a9734-ae5e-4095-9a9d-095299f83349 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:36.104835 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a9734-ae5e-4095-9a9d-095299f83349 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:36.109453 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5aa75b-fcba-4875-95b9-51212cde41f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:36.110105 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5aa75b-fcba-4875-95b9-51212cde41f0 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:36.110386 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5aa75b-fcba-4875-95b9-51212cde41f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:36.110661 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5aa75b-fcba-4875-95b9-51212cde41f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:36.111392 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5aa75b-fcba-4875-95b9-51212cde41f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:36.112977 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5aa75b-fcba-4875-95b9-51212cde41f0 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:36.122983 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1399/2816] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:08:36.126762 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3805c4-2ce2-473c-8127-125e6ee1256f admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:36.137003 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3805c4-2ce2-473c-8127-125e6ee1256f admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:36.141580 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38aa719-2014-4b8a-ba34-2ecd37e10dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:36.142213 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38aa719-2014-4b8a-ba34-2ecd37e10dea admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:36.142492 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38aa719-2014-4b8a-ba34-2ecd37e10dea admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:36.142762 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38aa719-2014-4b8a-ba34-2ecd37e10dea admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:36.143482 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38aa719-2014-4b8a-ba34-2ecd37e10dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:36.145057 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38aa719-2014-4b8a-ba34-2ecd37e10dea admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:36.155805 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1418/2817] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:08:36.159749 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5aa75b-fcba-4875-95b9-51212cde41f0 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:36.169266 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5aa75b-fcba-4875-95b9-51212cde41f0 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:36.173990 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88661d-b06a-4a1d-8363-ca464b416365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:36.174855 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88661d-b06a-4a1d-8363-ca464b416365 admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:36.175134 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88661d-b06a-4a1d-8363-ca464b416365 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:36.175404 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88661d-b06a-4a1d-8363-ca464b416365 admin admin] PATH_INFO: `/v3/projects/7aaad94afc8a45a8b1affe0ca8d38b8a/users/aa16c8acce74463ba0f9fbfaf99d62e1/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:36.189746 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88661d-b06a-4a1d-8363-ca464b416365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aaad94afc8a45a8b1affe0ca8d38b8a, user_id=aa16c8acce74463ba0f9fbfaf99d62e1, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:36.192350 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88661d-b06a-4a1d-8363-ca464b416365 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:36.271810 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1400/2818] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:08:36 2022] PUT /identity/v3/projects/7aaad94afc8a45a8b1affe0ca8d38b8a/users/aa16c8acce74463ba0f9fbfaf99d62e1/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:36.283495 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79859575-a3c7-4d33-ad4f-7241f27a2264 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:36.283780 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79859575-a3c7-4d33-ad4f-7241f27a2264 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:36.284058 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79859575-a3c7-4d33-ad4f-7241f27a2264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:36.309477 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-79859575-a3c7-4d33-ad4f-7241f27a2264 None None] MFA Rules not processed for user `aa16c8acce74463ba0f9fbfaf99d62e1`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:08:36.310663 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-79859575-a3c7-4d33-ad4f-7241f27a2264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:36.371948 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1419/2819] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:08:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:08:36.381796 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88661d-b06a-4a1d-8363-ca464b416365 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:36.383424 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-4a88661d-b06a-4a1d-8363-ca464b416365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:36.437104 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88661d-b06a-4a1d-8363-ca464b416365 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:36.440730 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc007a-34ef-46f5-9ef7-76c07e29f510 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:36.441400 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc007a-34ef-46f5-9ef7-76c07e29f510 service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:36.441685 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc007a-34ef-46f5-9ef7-76c07e29f510 service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:36.441960 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc007a-34ef-46f5-9ef7-76c07e29f510 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:36.450517 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc007a-34ef-46f5-9ef7-76c07e29f510 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:36.451939 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc007a-34ef-46f5-9ef7-76c07e29f510 service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:36.460470 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1401/2820] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:08:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:08:36.479694 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79859575-a3c7-4d33-ad4f-7241f27a2264 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:36.539891 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79859575-a3c7-4d33-ad4f-7241f27a2264 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:36.545422 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac241b-3624-489e-8895-eba367df3df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:36.546290 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac241b-3624-489e-8895-eba367df3df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:36.546570 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac241b-3624-489e-8895-eba367df3df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:36.546844 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac241b-3624-489e-8895-eba367df3df2 admin admin] PATH_INFO: `/v3/users/aa16c8acce74463ba0f9fbfaf99d62e1` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:36.548049 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac241b-3624-489e-8895-eba367df3df2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa16c8acce74463ba0f9fbfaf99d62e1)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:36.550036 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac241b-3624-489e-8895-eba367df3df2 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:36.721145 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-1cac241b-3624-489e-8895-eba367df3df2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa16c8acce74463ba0f9fbfaf99d62e1'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:36.727937 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-1cac241b-3624-489e-8895-eba367df3df2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa16c8acce74463ba0f9fbfaf99d62e1'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:36.729208 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-1cac241b-3624-489e-8895-eba367df3df2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa16c8acce74463ba0f9fbfaf99d62e1'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:36.729853 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-1cac241b-3624-489e-8895-eba367df3df2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa16c8acce74463ba0f9fbfaf99d62e1'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:36.820438 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-1cac241b-3624-489e-8895-eba367df3df2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa16c8acce74463ba0f9fbfaf99d62e1'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:36.836994 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1420/2821] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:08:36 2022] DELETE /identity/v3/users/aa16c8acce74463ba0f9fbfaf99d62e1 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:36.841850 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f2a1c-aa16-4232-abc4-40f673bc13d2 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:36.842332 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f2a1c-aa16-4232-abc4-40f673bc13d2 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:36.842439 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f2a1c-aa16-4232-abc4-40f673bc13d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:36.860178 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-6a0f2a1c-aa16-4232-abc4-40f673bc13d2 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:08:36.861379 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-6a0f2a1c-aa16-4232-abc4-40f673bc13d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:36.918778 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1402/2822] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:08:36.928448 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac241b-3624-489e-8895-eba367df3df2 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:36.929806 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-1cac241b-3624-489e-8895-eba367df3df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:36.984853 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac241b-3624-489e-8895-eba367df3df2 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:36.988416 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319b485-0777-407b-95b9-3d3ce38bb45b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:36.989034 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319b485-0777-407b-95b9-3d3ce38bb45b service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:36.989342 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319b485-0777-407b-95b9-3d3ce38bb45b service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:36.989612 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319b485-0777-407b-95b9-3d3ce38bb45b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:36.998241 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0319b485-0777-407b-95b9-3d3ce38bb45b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:36.999656 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0319b485-0777-407b-95b9-3d3ce38bb45b service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:37.008569 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1421/2823] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:08:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:08:37.440593 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f2a1c-aa16-4232-abc4-40f673bc13d2 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:37.441242 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-6a0f2a1c-aa16-4232-abc4-40f673bc13d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:37.455756 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f2a1c-aa16-4232-abc4-40f673bc13d2 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:37.461121 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625181e-a257-47d9-ac00-2948a4fd30c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:37.463625 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625181e-a257-47d9-ac00-2948a4fd30c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:37.463625 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625181e-a257-47d9-ac00-2948a4fd30c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:37.463625 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625181e-a257-47d9-ac00-2948a4fd30c8 admin admin] PATH_INFO: `/v3/projects/7aaad94afc8a45a8b1affe0ca8d38b8a` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:37.464842 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625181e-a257-47d9-ac00-2948a4fd30c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aaad94afc8a45a8b1affe0ca8d38b8a)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:37.466792 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625181e-a257-47d9-ac00-2948a4fd30c8 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:37.557334 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-d625181e-a257-47d9-ac00-2948a4fd30c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aaad94afc8a45a8b1affe0ca8d38b8a', 'request_id': 'req-d625181e-a257-47d9-ac00-2948a4fd30c8'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:37.563411 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-d625181e-a257-47d9-ac00-2948a4fd30c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aaad94afc8a45a8b1affe0ca8d38b8a', 'request_id': 'req-d625181e-a257-47d9-ac00-2948a4fd30c8'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:37.571277 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-d625181e-a257-47d9-ac00-2948a4fd30c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aaad94afc8a45a8b1affe0ca8d38b8a', 'request_id': 'req-d625181e-a257-47d9-ac00-2948a4fd30c8'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:37.666229 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-d625181e-a257-47d9-ac00-2948a4fd30c8 admin admin] The token cache is being invalidate because project 7aaad94afc8a45a8b1affe0ca8d38b8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:08:37.666571 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-d625181e-a257-47d9-ac00-2948a4fd30c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:37.667198 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-d625181e-a257-47d9-ac00-2948a4fd30c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:37.668831 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1403/2824] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:08:37 2022] DELETE /identity/v3/projects/7aaad94afc8a45a8b1affe0ca8d38b8a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:37.675029 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5a4c9-4d9d-463b-9f99-cfc37b1e5e04 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:37.675315 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5a4c9-4d9d-463b-9f99-cfc37b1e5e04 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:37.675590 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5a4c9-4d9d-463b-9f99-cfc37b1e5e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:37.696653 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-f8a5a4c9-4d9d-463b-9f99-cfc37b1e5e04 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:08:37.696653 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-f8a5a4c9-4d9d-463b-9f99-cfc37b1e5e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:37.751927 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1422/2825] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:08:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:08:37.760007 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7e9fb-4778-447c-b79c-9611935cb85c None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:37.760326 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7e9fb-4778-447c-b79c-9611935cb85c None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:37.761185 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7e9fb-4778-447c-b79c-9611935cb85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:37.779019 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-b2b7e9fb-4778-447c-b79c-9611935cb85c None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:08:37.780208 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-b2b7e9fb-4778-447c-b79c-9611935cb85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:37.788250 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1404/2826] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:08:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:08:37.792402 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5a4c9-4d9d-463b-9f99-cfc37b1e5e04 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:37.801960 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5a4c9-4d9d-463b-9f99-cfc37b1e5e04 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:37.806653 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8d4ff-7da7-4033-8e38-e37981a4b2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:37.807794 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8d4ff-7da7-4033-8e38-e37981a4b2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:37.808070 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8d4ff-7da7-4033-8e38-e37981a4b2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:37.808335 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8d4ff-7da7-4033-8e38-e37981a4b2e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:37.809052 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8d4ff-7da7-4033-8e38-e37981a4b2e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:08:37.809396 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8d4ff-7da7-4033-8e38-e37981a4b2e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:37.811070 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8d4ff-7da7-4033-8e38-e37981a4b2e5 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:37.821999 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1423/2827] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 15:08:37.826779 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7e9fb-4778-447c-b79c-9611935cb85c None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:37.835864 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7e9fb-4778-447c-b79c-9611935cb85c None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:37.841057 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f942ec-ffd0-4ec4-844c-76dbe8acc6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:37.846405 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f942ec-ffd0-4ec4-844c-76dbe8acc6e4 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:37.846405 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f942ec-ffd0-4ec4-844c-76dbe8acc6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:37.846405 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f942ec-ffd0-4ec4-844c-76dbe8acc6e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:37.846405 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f942ec-ffd0-4ec4-844c-76dbe8acc6e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:37.846405 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f942ec-ffd0-4ec4-844c-76dbe8acc6e4 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:37.921929 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1405/2828] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:08:37 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:08:37.926075 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8d4ff-7da7-4033-8e38-e37981a4b2e5 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:37.936572 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8d4ff-7da7-4033-8e38-e37981a4b2e5 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:37.991287 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e25c0-8fa7-451d-9db6-eec095fe6ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:37.991881 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e25c0-8fa7-451d-9db6-eec095fe6ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:37.992237 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e25c0-8fa7-451d-9db6-eec095fe6ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:37.992516 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e25c0-8fa7-451d-9db6-eec095fe6ae3 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:37.993253 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e25c0-8fa7-451d-9db6-eec095fe6ae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:37.995691 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e25c0-8fa7-451d-9db6-eec095fe6ae3 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:38.074664 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1424/2829] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:08:37 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:08:38.078907 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f942ec-ffd0-4ec4-844c-76dbe8acc6e4 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:38.088803 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f942ec-ffd0-4ec4-844c-76dbe8acc6e4 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:38.093708 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4f2d4-40c9-4c87-837f-b2087af19201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:38.094397 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4f2d4-40c9-4c87-837f-b2087af19201 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:38.094686 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4f2d4-40c9-4c87-837f-b2087af19201 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:38.094966 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4f2d4-40c9-4c87-837f-b2087af19201 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:38.095702 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4f2d4-40c9-4c87-837f-b2087af19201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:38.097352 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4f2d4-40c9-4c87-837f-b2087af19201 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:38.108505 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1406/2830] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:08:38.112313 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e25c0-8fa7-451d-9db6-eec095fe6ae3 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:38.122797 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e25c0-8fa7-451d-9db6-eec095fe6ae3 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:38.127554 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60343826-f487-4ecd-82b5-212e1281ade2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:38.133102 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60343826-f487-4ecd-82b5-212e1281ade2 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:38.133102 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60343826-f487-4ecd-82b5-212e1281ade2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:38.133102 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60343826-f487-4ecd-82b5-212e1281ade2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:38.133102 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60343826-f487-4ecd-82b5-212e1281ade2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:38.133102 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60343826-f487-4ecd-82b5-212e1281ade2 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:38.140848 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1425/2831] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:08:38.144925 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4f2d4-40c9-4c87-837f-b2087af19201 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:38.154590 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4f2d4-40c9-4c87-837f-b2087af19201 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:38.159298 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5a47c-99e1-48b1-968b-04d5b88afe3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:38.160163 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5a47c-99e1-48b1-968b-04d5b88afe3a admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:38.160445 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5a47c-99e1-48b1-968b-04d5b88afe3a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:38.160723 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5a47c-99e1-48b1-968b-04d5b88afe3a admin admin] PATH_INFO: `/v3/projects/7fe0fadf1ece4860b6e03a0067c8cb9c/users/acff694cd1d840e3b3c4dcd12da851ea/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:38.175022 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea5a47c-99e1-48b1-968b-04d5b88afe3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fe0fadf1ece4860b6e03a0067c8cb9c, user_id=acff694cd1d840e3b3c4dcd12da851ea, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:38.177765 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea5a47c-99e1-48b1-968b-04d5b88afe3a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:38.255285 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1407/2832] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:08:38 2022] PUT /identity/v3/projects/7fe0fadf1ece4860b6e03a0067c8cb9c/users/acff694cd1d840e3b3c4dcd12da851ea/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:38.266451 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ba92e-a537-467e-bc1f-89b64f0247d0 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:38.270507 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ba92e-a537-467e-bc1f-89b64f0247d0 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:38.270507 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ba92e-a537-467e-bc1f-89b64f0247d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:38.293053 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-459ba92e-a537-467e-bc1f-89b64f0247d0 None None] MFA Rules not processed for user `acff694cd1d840e3b3c4dcd12da851ea`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:08:38.294393 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-459ba92e-a537-467e-bc1f-89b64f0247d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:38.354701 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1426/2833] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:08:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:08:38.364581 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5a47c-99e1-48b1-968b-04d5b88afe3a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:38.366272 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-4ea5a47c-99e1-48b1-968b-04d5b88afe3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:38.422499 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5a47c-99e1-48b1-968b-04d5b88afe3a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:38.426162 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac17e8-97c3-4dbb-8ff2-f701d5dd9ba4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:38.426799 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac17e8-97c3-4dbb-8ff2-f701d5dd9ba4 service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:38.427086 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac17e8-97c3-4dbb-8ff2-f701d5dd9ba4 service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:38.427362 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac17e8-97c3-4dbb-8ff2-f701d5dd9ba4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:38.435395 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac17e8-97c3-4dbb-8ff2-f701d5dd9ba4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:38.436819 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac17e8-97c3-4dbb-8ff2-f701d5dd9ba4 service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:38.445376 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1408/2834] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:08:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:08:44.664137 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ba92e-a537-467e-bc1f-89b64f0247d0 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:44.724082 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ba92e-a537-467e-bc1f-89b64f0247d0 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:44.728875 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade89604-59ec-4a72-bc02-b31a7767bdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:44.729774 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade89604-59ec-4a72-bc02-b31a7767bdcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:44.730059 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade89604-59ec-4a72-bc02-b31a7767bdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:44.730336 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade89604-59ec-4a72-bc02-b31a7767bdcb admin admin] PATH_INFO: `/v3/users/acff694cd1d840e3b3c4dcd12da851ea` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:44.731552 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade89604-59ec-4a72-bc02-b31a7767bdcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=acff694cd1d840e3b3c4dcd12da851ea)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:44.733558 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade89604-59ec-4a72-bc02-b31a7767bdcb admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:44.947291 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-ade89604-59ec-4a72-bc02-b31a7767bdcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acff694cd1d840e3b3c4dcd12da851ea'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:44.956216 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-ade89604-59ec-4a72-bc02-b31a7767bdcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acff694cd1d840e3b3c4dcd12da851ea'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:44.958536 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-ade89604-59ec-4a72-bc02-b31a7767bdcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acff694cd1d840e3b3c4dcd12da851ea'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:44.958536 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-ade89604-59ec-4a72-bc02-b31a7767bdcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acff694cd1d840e3b3c4dcd12da851ea'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:45.031914 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-ade89604-59ec-4a72-bc02-b31a7767bdcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acff694cd1d840e3b3c4dcd12da851ea'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:45.048358 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1427/2835] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:08:44 2022] DELETE /identity/v3/users/acff694cd1d840e3b3c4dcd12da851ea => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:45.053656 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44805727-b9bc-4e7c-979c-409002f364a4 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:45.053656 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44805727-b9bc-4e7c-979c-409002f364a4 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:45.053656 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44805727-b9bc-4e7c-979c-409002f364a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:45.070853 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-44805727-b9bc-4e7c-979c-409002f364a4 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:08:45.072032 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-44805727-b9bc-4e7c-979c-409002f364a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:45.127337 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1409/2836] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:08:45.136732 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade89604-59ec-4a72-bc02-b31a7767bdcb admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:45.138152 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-ade89604-59ec-4a72-bc02-b31a7767bdcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:45.192446 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade89604-59ec-4a72-bc02-b31a7767bdcb admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:45.195971 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7dd7f-9e2a-49da-b7cd-10a6628aeb0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:45.196592 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7dd7f-9e2a-49da-b7cd-10a6628aeb0e service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:45.196875 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7dd7f-9e2a-49da-b7cd-10a6628aeb0e service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:45.197180 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7dd7f-9e2a-49da-b7cd-10a6628aeb0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:45.206514 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7dd7f-9e2a-49da-b7cd-10a6628aeb0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:45.207903 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7dd7f-9e2a-49da-b7cd-10a6628aeb0e service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:45.216985 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1428/2837] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:08:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:08:45.622637 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44805727-b9bc-4e7c-979c-409002f364a4 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:45.625522 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-44805727-b9bc-4e7c-979c-409002f364a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:45.636908 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44805727-b9bc-4e7c-979c-409002f364a4 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:45.642189 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fab676-05e5-4388-8428-cba63a68983f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:45.645034 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fab676-05e5-4388-8428-cba63a68983f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:45.645351 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fab676-05e5-4388-8428-cba63a68983f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:45.645630 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fab676-05e5-4388-8428-cba63a68983f admin admin] PATH_INFO: `/v3/projects/7fe0fadf1ece4860b6e03a0067c8cb9c` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:45.646913 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fab676-05e5-4388-8428-cba63a68983f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fe0fadf1ece4860b6e03a0067c8cb9c)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:45.648837 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fab676-05e5-4388-8428-cba63a68983f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:45.745729 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-a6fab676-05e5-4388-8428-cba63a68983f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fe0fadf1ece4860b6e03a0067c8cb9c', 'request_id': 'req-a6fab676-05e5-4388-8428-cba63a68983f'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:45.752238 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-a6fab676-05e5-4388-8428-cba63a68983f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fe0fadf1ece4860b6e03a0067c8cb9c', 'request_id': 'req-a6fab676-05e5-4388-8428-cba63a68983f'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:45.757431 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-a6fab676-05e5-4388-8428-cba63a68983f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fe0fadf1ece4860b6e03a0067c8cb9c', 'request_id': 'req-a6fab676-05e5-4388-8428-cba63a68983f'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:45.825576 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-a6fab676-05e5-4388-8428-cba63a68983f admin admin] The token cache is being invalidate because project 7fe0fadf1ece4860b6e03a0067c8cb9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:08:45.825863 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-a6fab676-05e5-4388-8428-cba63a68983f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:45.826506 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-a6fab676-05e5-4388-8428-cba63a68983f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:08:45.828029 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1410/2838] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:08:45 2022] DELETE /identity/v3/projects/7fe0fadf1ece4860b6e03a0067c8cb9c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:45.834000 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec915ec-54e9-4e47-9329-e4e5cbde917a None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:45.835604 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec915ec-54e9-4e47-9329-e4e5cbde917a None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:45.835604 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec915ec-54e9-4e47-9329-e4e5cbde917a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:45.856513 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-6ec915ec-54e9-4e47-9329-e4e5cbde917a None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:08:45.857779 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-6ec915ec-54e9-4e47-9329-e4e5cbde917a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:45.919418 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1429/2839] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:08:45.927884 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a31f8-aa3f-45b4-a67a-367ee172d02a None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:45.928174 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a31f8-aa3f-45b4-a67a-367ee172d02a None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:45.928466 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a31f8-aa3f-45b4-a67a-367ee172d02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:45.946123 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-245a31f8-aa3f-45b4-a67a-367ee172d02a None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:08:45.947295 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-245a31f8-aa3f-45b4-a67a-367ee172d02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:45.954984 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1411/2840] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:08:45.958859 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec915ec-54e9-4e47-9329-e4e5cbde917a None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:45.968620 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec915ec-54e9-4e47-9329-e4e5cbde917a None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:45.973057 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cb07d-afa7-4446-936d-1223948899f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:45.973716 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cb07d-afa7-4446-936d-1223948899f7 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:45.973996 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cb07d-afa7-4446-936d-1223948899f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:45.974271 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cb07d-afa7-4446-936d-1223948899f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:45.974989 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69cb07d-afa7-4446-936d-1223948899f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:08:45.975289 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69cb07d-afa7-4446-936d-1223948899f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:45.977172 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69cb07d-afa7-4446-936d-1223948899f7 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:45.988735 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1430/2841] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 05 15:08:45.992643 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a31f8-aa3f-45b4-a67a-367ee172d02a None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:46.001453 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a31f8-aa3f-45b4-a67a-367ee172d02a None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:46.005919 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33995258-ec58-4c3c-bdcf-6f260c86400a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:46.006545 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33995258-ec58-4c3c-bdcf-6f260c86400a admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:46.006823 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33995258-ec58-4c3c-bdcf-6f260c86400a admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:46.007093 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33995258-ec58-4c3c-bdcf-6f260c86400a admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:46.007808 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33995258-ec58-4c3c-bdcf-6f260c86400a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:46.009718 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33995258-ec58-4c3c-bdcf-6f260c86400a admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:46.121279 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1412/2842] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:08:45 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:08:46.125442 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cb07d-afa7-4446-936d-1223948899f7 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:46.135436 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cb07d-afa7-4446-936d-1223948899f7 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:46.189447 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d9b91-94d1-4a2e-924f-6e2dc58f7716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:46.190098 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d9b91-94d1-4a2e-924f-6e2dc58f7716 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:46.190379 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d9b91-94d1-4a2e-924f-6e2dc58f7716 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:46.190653 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d9b91-94d1-4a2e-924f-6e2dc58f7716 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:46.191349 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d9b91-94d1-4a2e-924f-6e2dc58f7716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:46.193304 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d9b91-94d1-4a2e-924f-6e2dc58f7716 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:46.273688 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1431/2843] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:08:46 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:08:46.277798 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33995258-ec58-4c3c-bdcf-6f260c86400a admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:46.288492 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33995258-ec58-4c3c-bdcf-6f260c86400a admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:46.293037 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073aa21-33f4-41cc-87ff-26870f362613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:46.293717 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073aa21-33f4-41cc-87ff-26870f362613 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:46.293995 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073aa21-33f4-41cc-87ff-26870f362613 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:46.294266 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073aa21-33f4-41cc-87ff-26870f362613 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:46.294990 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073aa21-33f4-41cc-87ff-26870f362613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:46.296639 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073aa21-33f4-41cc-87ff-26870f362613 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:46.306516 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1413/2844] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:08:46.310380 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d9b91-94d1-4a2e-924f-6e2dc58f7716 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:46.320157 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d9b91-94d1-4a2e-924f-6e2dc58f7716 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:46.324682 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d2af7-38d3-4218-b5c3-65a825f16b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:46.325355 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d2af7-38d3-4218-b5c3-65a825f16b48 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:46.325638 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d2af7-38d3-4218-b5c3-65a825f16b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:46.325913 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d2af7-38d3-4218-b5c3-65a825f16b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:46.326634 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d2af7-38d3-4218-b5c3-65a825f16b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:46.328720 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d2af7-38d3-4218-b5c3-65a825f16b48 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:46.338702 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1432/2845] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:08:46.343141 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073aa21-33f4-41cc-87ff-26870f362613 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:46.352850 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073aa21-33f4-41cc-87ff-26870f362613 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:46.357368 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b6055-4787-4b6e-acb2-96cc2d86dbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:46.358283 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b6055-4787-4b6e-acb2-96cc2d86dbdf admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:46.358565 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b6055-4787-4b6e-acb2-96cc2d86dbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:46.358838 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b6055-4787-4b6e-acb2-96cc2d86dbdf admin admin] PATH_INFO: `/v3/projects/4ed05f9412d9477ea62f75cd05af148b/users/86bfbcae996a457ebe52d8c2fb7bafe4/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:46.372361 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b6055-4787-4b6e-acb2-96cc2d86dbdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ed05f9412d9477ea62f75cd05af148b, user_id=86bfbcae996a457ebe52d8c2fb7bafe4, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:46.375000 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b6055-4787-4b6e-acb2-96cc2d86dbdf admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:46.452367 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1414/2846] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:08:46 2022] PUT /identity/v3/projects/4ed05f9412d9477ea62f75cd05af148b/users/86bfbcae996a457ebe52d8c2fb7bafe4/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:46.457434 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fda56-d27e-47f9-9e82-a57f96995504 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:46.457721 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fda56-d27e-47f9-9e82-a57f96995504 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:46.457998 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fda56-d27e-47f9-9e82-a57f96995504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:46.476373 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-1a5fda56-d27e-47f9-9e82-a57f96995504 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:08:46.477588 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-1a5fda56-d27e-47f9-9e82-a57f96995504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:46.534305 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1433/2847] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:08:46.543655 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b6055-4787-4b6e-acb2-96cc2d86dbdf admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:46.545500 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-3c3b6055-4787-4b6e-acb2-96cc2d86dbdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:46.599988 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b6055-4787-4b6e-acb2-96cc2d86dbdf admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:46.604081 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249b1de-1cf4-49cd-9c10-e22cbd7422da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:46.604718 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249b1de-1cf4-49cd-9c10-e22cbd7422da service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:46.605001 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249b1de-1cf4-49cd-9c10-e22cbd7422da service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:46.605316 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249b1de-1cf4-49cd-9c10-e22cbd7422da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:46.614652 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249b1de-1cf4-49cd-9c10-e22cbd7422da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:46.616071 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249b1de-1cf4-49cd-9c10-e22cbd7422da service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:46.625713 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1415/2848] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:08:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:08:51.872682 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5639b19-701a-4f68-9be0-19576532d3cd None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:51.873736 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5639b19-701a-4f68-9be0-19576532d3cd None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:51.874020 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5639b19-701a-4f68-9be0-19576532d3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:51.906474 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-b5639b19-701a-4f68-9be0-19576532d3cd None None] MFA Rules not processed for user `86bfbcae996a457ebe52d8c2fb7bafe4`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:08:51.907903 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-b5639b19-701a-4f68-9be0-19576532d3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:51.974278 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1434/2849] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:08:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 05 15:08:51.979045 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249b1de-1cf4-49cd-9c10-e22cbd7422da service neutron] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:51.989399 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249b1de-1cf4-49cd-9c10-e22cbd7422da service neutron] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:51.994189 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9544d0-b033-4ac2-8a55-1ad770d9b10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:51.994839 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9544d0-b033-4ac2-8a55-1ad770d9b10f admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:51.995125 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9544d0-b033-4ac2-8a55-1ad770d9b10f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:51.995402 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9544d0-b033-4ac2-8a55-1ad770d9b10f admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:51.996103 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9544d0-b033-4ac2-8a55-1ad770d9b10f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:51.998069 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9544d0-b033-4ac2-8a55-1ad770d9b10f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:52.089167 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1416/2850] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:08:51 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:08:52.091655 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5639b19-701a-4f68-9be0-19576532d3cd None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:52.103956 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5639b19-701a-4f68-9be0-19576532d3cd None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:52.170983 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c8c4b-2ffb-4973-b344-0c75d135a3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:52.171663 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c8c4b-2ffb-4973-b344-0c75d135a3b3 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:52.171946 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c8c4b-2ffb-4973-b344-0c75d135a3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:52.172205 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c8c4b-2ffb-4973-b344-0c75d135a3b3 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:52.172909 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c8c4b-2ffb-4973-b344-0c75d135a3b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:52.174938 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c8c4b-2ffb-4973-b344-0c75d135a3b3 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:52.284065 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1435/2851] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:08:52 2022] POST /identity/v3/users => generated 296 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:08:52.287854 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9544d0-b033-4ac2-8a55-1ad770d9b10f admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:52.301383 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9544d0-b033-4ac2-8a55-1ad770d9b10f admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:52.318839 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ab4c0-e6fb-40fe-9c4c-ce9e5c0a9f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:52.319818 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ab4c0-e6fb-40fe-9c4c-ce9e5c0a9f7e admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:52.320267 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ab4c0-e6fb-40fe-9c4c-ce9e5c0a9f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:52.321836 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ab4c0-e6fb-40fe-9c4c-ce9e5c0a9f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:52.322799 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ab4c0-e6fb-40fe-9c4c-ce9e5c0a9f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:52.324515 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ab4c0-e6fb-40fe-9c4c-ce9e5c0a9f7e admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:52.358604 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c8c4b-2ffb-4973-b344-0c75d135a3b3 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:52.365870 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1417/2852] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:08:52.369930 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c8c4b-2ffb-4973-b344-0c75d135a3b3 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:52.375077 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54265e-a9d2-426b-afec-3229d8514f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:52.376062 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54265e-a9d2-426b-afec-3229d8514f13 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:52.376425 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54265e-a9d2-426b-afec-3229d8514f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:52.376807 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54265e-a9d2-426b-afec-3229d8514f13 admin admin] PATH_INFO: `/v3/projects/27c841a04bb44a3cae004da17444831e/users/583756335017412e8902888f32cf17f0/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:52.398904 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54265e-a9d2-426b-afec-3229d8514f13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27c841a04bb44a3cae004da17444831e, user_id=583756335017412e8902888f32cf17f0, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:52.398904 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54265e-a9d2-426b-afec-3229d8514f13 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:52.498482 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1436/2853] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:08:52 2022] PUT /identity/v3/projects/27c841a04bb44a3cae004da17444831e/users/583756335017412e8902888f32cf17f0/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:52.502781 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ab4c0-e6fb-40fe-9c4c-ce9e5c0a9f7e admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:52.524630 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ab4c0-e6fb-40fe-9c4c-ce9e5c0a9f7e admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:52.592626 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3653aea-a82d-4860-8e90-df8061ae425f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:52.593433 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3653aea-a82d-4860-8e90-df8061ae425f admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:52.593717 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3653aea-a82d-4860-8e90-df8061ae425f admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:52.593993 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3653aea-a82d-4860-8e90-df8061ae425f admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:52.594728 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3653aea-a82d-4860-8e90-df8061ae425f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:52.596311 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3653aea-a82d-4860-8e90-df8061ae425f admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:52.606228 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1418/2854] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:08:52.610266 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54265e-a9d2-426b-afec-3229d8514f13 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:52.620263 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54265e-a9d2-426b-afec-3229d8514f13 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:52.625405 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ae971-9595-432b-bc56-a64ba230e563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:52.626266 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ae971-9595-432b-bc56-a64ba230e563 admin admin] REQUEST_METHOD: `PUT` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:52.626542 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ae971-9595-432b-bc56-a64ba230e563 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:52.626836 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ae971-9595-432b-bc56-a64ba230e563 admin admin] PATH_INFO: `/v3/projects/27c841a04bb44a3cae004da17444831e/users/583756335017412e8902888f32cf17f0/roles/494131614fcf424f92e0817fa7ff6961` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:52.628774 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ae971-9595-432b-bc56-a64ba230e563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27c841a04bb44a3cae004da17444831e, user_id=583756335017412e8902888f32cf17f0, role_id=494131614fcf424f92e0817fa7ff6961)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:52.631460 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ae971-9595-432b-bc56-a64ba230e563 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:52.642531 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1437/2855] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:08:52 2022] PUT /identity/v3/projects/27c841a04bb44a3cae004da17444831e/users/583756335017412e8902888f32cf17f0/roles/494131614fcf424f92e0817fa7ff6961 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:08:58.969902 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2995837-e9f4-482e-b864-879c090e1a8f None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:58.970726 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2995837-e9f4-482e-b864-879c090e1a8f None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:58.971004 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2995837-e9f4-482e-b864-879c090e1a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:59.000480 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-c2995837-e9f4-482e-b864-879c090e1a8f None None] MFA Rules not processed for user `583756335017412e8902888f32cf17f0`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:08:59.002009 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-c2995837-e9f4-482e-b864-879c090e1a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:59.076467 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1419/2856] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:08:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:08:59.088705 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ae971-9595-432b-bc56-a64ba230e563 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:08:59.090567 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-1b8ae971-9595-432b-bc56-a64ba230e563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:08:59.164689 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ae971-9595-432b-bc56-a64ba230e563 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:08:59.170178 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803e41b-1792-4311-ad6a-713f68bc6bfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:08:59.170807 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803e41b-1792-4311-ad6a-713f68bc6bfb service nova] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:08:59.171624 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803e41b-1792-4311-ad6a-713f68bc6bfb service nova] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:08:59.171900 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803e41b-1792-4311-ad6a-713f68bc6bfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:08:59.228010 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803e41b-1792-4311-ad6a-713f68bc6bfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:08:59.229670 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803e41b-1792-4311-ad6a-713f68bc6bfb service nova] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:08:59.238724 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1438/2857] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:08:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:09:07.761151 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826c469-dabb-4471-9ef5-71a852673359 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:09:07.761651 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826c469-dabb-4471-9ef5-71a852673359 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:09:07.761754 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826c469-dabb-4471-9ef5-71a852673359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:09:07.780361 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-0826c469-dabb-4471-9ef5-71a852673359 None None] MFA Rules not processed for user `7a8386858f994d4f9c29aaf040a539e0`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:09:07.781573 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-0826c469-dabb-4471-9ef5-71a852673359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:09:07.834032 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1420/2858] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:09:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:09:17.793483 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27c5c4-0ebc-4ae1-81b8-cebde7c57259 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:09:17.794021 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27c5c4-0ebc-4ae1-81b8-cebde7c57259 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:09:17.794124 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27c5c4-0ebc-4ae1-81b8-cebde7c57259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:09:17.810574 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-3f27c5c4-0ebc-4ae1-81b8-cebde7c57259 None None] MFA Rules not processed for user `86bfbcae996a457ebe52d8c2fb7bafe4`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:09:17.811932 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-3f27c5c4-0ebc-4ae1-81b8-cebde7c57259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:09:17.818756 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1439/2859] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:09:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:09:22.342643 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826c469-dabb-4471-9ef5-71a852673359 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:09:22.344390 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-0826c469-dabb-4471-9ef5-71a852673359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:09:22.399240 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826c469-dabb-4471-9ef5-71a852673359 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:09:22.402910 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bdcf8-1ab5-4dab-9547-69daa8882e73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:09:22.403548 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bdcf8-1ab5-4dab-9547-69daa8882e73 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:09:22.403825 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bdcf8-1ab5-4dab-9547-69daa8882e73 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:09:22.404104 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bdcf8-1ab5-4dab-9547-69daa8882e73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:09:22.405865 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-c10bdcf8-1ab5-4dab-9547-69daa8882e73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:09:22.420300 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bdcf8-1ab5-4dab-9547-69daa8882e73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:09:22.421841 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bdcf8-1ab5-4dab-9547-69daa8882e73 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:09:22.432823 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1421/2860] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:09:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:09:24.933869 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27c5c4-0ebc-4ae1-81b8-cebde7c57259 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:09:24.943625 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27c5c4-0ebc-4ae1-81b8-cebde7c57259 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:09:24.947191 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb95b1-21ba-4688-9557-79f756db3d73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:09:24.947845 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb95b1-21ba-4688-9557-79f756db3d73 service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:09:24.948125 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb95b1-21ba-4688-9557-79f756db3d73 service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:09:24.948397 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb95b1-21ba-4688-9557-79f756db3d73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:09:24.950193 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-38bb95b1-21ba-4688-9557-79f756db3d73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:09:24.963187 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb95b1-21ba-4688-9557-79f756db3d73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:09:24.964647 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb95b1-21ba-4688-9557-79f756db3d73 service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:09:24.976095 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1440/2861] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:09:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:09:45.090842 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bdcf8-1ab5-4dab-9547-69daa8882e73 service neutron] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:09:45.100110 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bdcf8-1ab5-4dab-9547-69daa8882e73 service neutron] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:09:45.103759 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e719b-b958-43f8-a05d-867e2888b7f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:09:45.104390 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e719b-b958-43f8-a05d-867e2888b7f1 service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:09:45.104679 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e719b-b958-43f8-a05d-867e2888b7f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:09:45.104957 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e719b-b958-43f8-a05d-867e2888b7f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:09:45.114936 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e719b-b958-43f8-a05d-867e2888b7f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:09:45.116416 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e719b-b958-43f8-a05d-867e2888b7f1 service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:09:45.126807 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1422/2862] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:09:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:10:13.888878 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb95b1-21ba-4688-9557-79f756db3d73 service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:10:13.890410 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-38bb95b1-21ba-4688-9557-79f756db3d73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:10:13.955281 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb95b1-21ba-4688-9557-79f756db3d73 service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:10:13.959742 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7e36c-b9bb-4b95-88d6-e382d2ec54f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:10:13.960623 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7e36c-b9bb-4b95-88d6-e382d2ec54f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:10:13.960900 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7e36c-b9bb-4b95-88d6-e382d2ec54f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:10:13.961209 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7e36c-b9bb-4b95-88d6-e382d2ec54f0 admin admin] PATH_INFO: `/v3/users/7a8386858f994d4f9c29aaf040a539e0` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:10:13.962395 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7e36c-b9bb-4b95-88d6-e382d2ec54f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a8386858f994d4f9c29aaf040a539e0)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:10:13.964431 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7e36c-b9bb-4b95-88d6-e382d2ec54f0 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:10:14.165324 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3aa7e36c-b9bb-4b95-88d6-e382d2ec54f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a8386858f994d4f9c29aaf040a539e0'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:10:14.172023 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3aa7e36c-b9bb-4b95-88d6-e382d2ec54f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a8386858f994d4f9c29aaf040a539e0'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:10:14.172598 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3aa7e36c-b9bb-4b95-88d6-e382d2ec54f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a8386858f994d4f9c29aaf040a539e0'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:10:14.173265 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3aa7e36c-b9bb-4b95-88d6-e382d2ec54f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a8386858f994d4f9c29aaf040a539e0'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:10:14.278014 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-3aa7e36c-b9bb-4b95-88d6-e382d2ec54f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a8386858f994d4f9c29aaf040a539e0'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:10:14.300149 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1441/2863] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:10:13 2022] DELETE /identity/v3/users/7a8386858f994d4f9c29aaf040a539e0 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:10:14.557495 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e719b-b958-43f8-a05d-867e2888b7f1 service neutron] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:10:14.569411 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e719b-b958-43f8-a05d-867e2888b7f1 service neutron] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:10:14.635133 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5e098-4869-44a1-8d8e-609386ead518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:10:14.635954 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5e098-4869-44a1-8d8e-609386ead518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:10:14.636269 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5e098-4869-44a1-8d8e-609386ead518 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:10:14.636546 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5e098-4869-44a1-8d8e-609386ead518 admin admin] PATH_INFO: `/v3/projects/4ffa8c6fb14941c6ba03ddd2d63c49be` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:10:14.637748 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5e098-4869-44a1-8d8e-609386ead518 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ffa8c6fb14941c6ba03ddd2d63c49be)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:10:14.640287 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5e098-4869-44a1-8d8e-609386ead518 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:10:14.766525 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-96b5e098-4869-44a1-8d8e-609386ead518 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'request_id': 'req-96b5e098-4869-44a1-8d8e-609386ead518'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:10:14.772259 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-96b5e098-4869-44a1-8d8e-609386ead518 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'request_id': 'req-96b5e098-4869-44a1-8d8e-609386ead518'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:10:14.777462 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-96b5e098-4869-44a1-8d8e-609386ead518 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'request_id': 'req-96b5e098-4869-44a1-8d8e-609386ead518'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:10:14.846702 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-96b5e098-4869-44a1-8d8e-609386ead518 admin admin] The token cache is being invalidate because project 4ffa8c6fb14941c6ba03ddd2d63c49be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:10:14.846986 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-96b5e098-4869-44a1-8d8e-609386ead518 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:10:14.847734 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-96b5e098-4869-44a1-8d8e-609386ead518 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:10:14.849563 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1423/2864] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:10:14 2022] DELETE /identity/v3/projects/4ffa8c6fb14941c6ba03ddd2d63c49be => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:10:14.855278 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bc63d-21c3-43da-a466-890f771bd26c None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:10:14.855595 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bc63d-21c3-43da-a466-890f771bd26c None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:10:14.855869 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bc63d-21c3-43da-a466-890f771bd26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:10:14.874461 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-1f4bc63d-21c3-43da-a466-890f771bd26c None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:10:14.875980 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-1f4bc63d-21c3-43da-a466-890f771bd26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:10:14.936875 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1442/2865] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:10:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:10:14.944508 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e578cb2-785d-4f71-91f4-aafa8cc709f3 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:10:14.944801 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e578cb2-785d-4f71-91f4-aafa8cc709f3 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:10:14.945148 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e578cb2-785d-4f71-91f4-aafa8cc709f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:10:14.962718 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-1e578cb2-785d-4f71-91f4-aafa8cc709f3 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:10:14.963897 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-1e578cb2-785d-4f71-91f4-aafa8cc709f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:10:14.971941 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1424/2866] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:10:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:10:14.976182 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4bc63d-21c3-43da-a466-890f771bd26c None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:10:14.986051 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4bc63d-21c3-43da-a466-890f771bd26c None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:10:14.990471 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e876b-cc45-410b-a9ea-dcac528e4706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:10:14.991146 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e876b-cc45-410b-a9ea-dcac528e4706 admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:10:14.991454 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e876b-cc45-410b-a9ea-dcac528e4706 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:10:14.991726 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e876b-cc45-410b-a9ea-dcac528e4706 admin admin] PATH_INFO: `/v3/domains` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:10:14.992443 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e876b-cc45-410b-a9ea-dcac528e4706 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 05 15:10:14.992746 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e876b-cc45-410b-a9ea-dcac528e4706 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:10:14.994427 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e876b-cc45-410b-a9ea-dcac528e4706 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:10:15.006285 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1443/2867] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jan 5 15:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 05 15:10:15.010128 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e578cb2-785d-4f71-91f4-aafa8cc709f3 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:10:15.019114 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e578cb2-785d-4f71-91f4-aafa8cc709f3 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:10:15.023840 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c41338-e018-41fb-b364-bcc75b457848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:10:15.024488 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c41338-e018-41fb-b364-bcc75b457848 admin admin] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:10:15.024770 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c41338-e018-41fb-b364-bcc75b457848 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:10:15.025285 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c41338-e018-41fb-b364-bcc75b457848 admin admin] PATH_INFO: `/v3/projects` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:10:15.026028 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c41338-e018-41fb-b364-bcc75b457848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:10:15.027959 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c41338-e018-41fb-b364-bcc75b457848 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:10:15.112284 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1425/2868] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jan 5 15:10:15 2022] POST /identity/v3/projects => generated 395 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 05 15:10:15.116375 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e876b-cc45-410b-a9ea-dcac528e4706 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:10:15.126496 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e876b-cc45-410b-a9ea-dcac528e4706 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:10:15.182151 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045736e6-c3e4-43a5-8c85-7f013eacb361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:10:15.182810 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045736e6-c3e4-43a5-8c85-7f013eacb361 admin admin] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:10:15.183092 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045736e6-c3e4-43a5-8c85-7f013eacb361 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:10:15.183398 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045736e6-c3e4-43a5-8c85-7f013eacb361 admin admin] PATH_INFO: `/v3/users` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:10:15.184177 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045736e6-c3e4-43a5-8c85-7f013eacb361 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:10:15.186413 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045736e6-c3e4-43a5-8c85-7f013eacb361 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:10:15.260669 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1444/2869] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jan 5 15:10:15 2022] POST /identity/v3/users => generated 298 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 05 15:10:15.265681 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c41338-e018-41fb-b364-bcc75b457848 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:10:15.275997 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c41338-e018-41fb-b364-bcc75b457848 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:10:15.281251 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52114f-67cc-486b-9f7e-d7b134acaec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:10:15.281913 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52114f-67cc-486b-9f7e-d7b134acaec9 admin admin] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:10:15.282199 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52114f-67cc-486b-9f7e-d7b134acaec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:10:15.282476 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52114f-67cc-486b-9f7e-d7b134acaec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:10:15.283213 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52114f-67cc-486b-9f7e-d7b134acaec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:10:15.284821 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52114f-67cc-486b-9f7e-d7b134acaec9 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:10:15.295677 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1426/2870] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 05 15:10:15.299699 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045736e6-c3e4-43a5-8c85-7f013eacb361 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:10:15.309407 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045736e6-c3e4-43a5-8c85-7f013eacb361 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:10:15.314110 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd03ec-1878-4269-93d4-48e20e0b410f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:10:15.314754 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd03ec-1878-4269-93d4-48e20e0b410f admin admin] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:10:15.315037 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd03ec-1878-4269-93d4-48e20e0b410f admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:10:15.315314 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd03ec-1878-4269-93d4-48e20e0b410f admin admin] PATH_INFO: `/v3/roles` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:10:15.316040 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd03ec-1878-4269-93d4-48e20e0b410f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:10:15.317721 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd03ec-1878-4269-93d4-48e20e0b410f admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:10:15.327270 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1445/2871] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jan 5 15:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 05 15:10:15.331203 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52114f-67cc-486b-9f7e-d7b134acaec9 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:10:15.340782 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52114f-67cc-486b-9f7e-d7b134acaec9 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:10:15.346005 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce57f3-f25c-43d7-8a0a-b8709f3244ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:10:15.346865 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce57f3-f25c-43d7-8a0a-b8709f3244ff admin admin] REQUEST_METHOD: `PUT` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:10:15.347170 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce57f3-f25c-43d7-8a0a-b8709f3244ff admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:10:15.347452 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce57f3-f25c-43d7-8a0a-b8709f3244ff admin admin] PATH_INFO: `/v3/projects/b48bec9ebb5c482993c33471f3d92a6b/users/d81ed65fd62b4404846bc251f1064195/roles/eaba1e26bf0040868b08b042a7859698` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:10:15.362021 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce57f3-f25c-43d7-8a0a-b8709f3244ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b48bec9ebb5c482993c33471f3d92a6b, user_id=d81ed65fd62b4404846bc251f1064195, role_id=eaba1e26bf0040868b08b042a7859698)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:10:15.364640 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce57f3-f25c-43d7-8a0a-b8709f3244ff admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:10:15.460245 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1427/2872] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jan 5 15:10:15 2022] PUT /identity/v3/projects/b48bec9ebb5c482993c33471f3d92a6b/users/d81ed65fd62b4404846bc251f1064195/roles/eaba1e26bf0040868b08b042a7859698 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:10:15.470456 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c9591-190e-4569-8be0-113ff9b8d0dd None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:10:15.470748 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c9591-190e-4569-8be0-113ff9b8d0dd None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:10:15.471030 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c9591-190e-4569-8be0-113ff9b8d0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:10:15.497246 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-9b4c9591-190e-4569-8be0-113ff9b8d0dd None None] MFA Rules not processed for user `d81ed65fd62b4404846bc251f1064195`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:10:15.498493 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-9b4c9591-190e-4569-8be0-113ff9b8d0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:10:15.564532 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1446/2873] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:10:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:10:15.574674 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce57f3-f25c-43d7-8a0a-b8709f3244ff admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:10:15.576862 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-02ce57f3-f25c-43d7-8a0a-b8709f3244ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:10:15.630969 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce57f3-f25c-43d7-8a0a-b8709f3244ff admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:10:15.634633 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d30ede-3eb7-4c05-96a7-493e89fb1666 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541bd71b355d4b7ca35372e11be54be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:10:15.635268 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d30ede-3eb7-4c05-96a7-493e89fb1666 service cinder] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:10:15.635549 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d30ede-3eb7-4c05-96a7-493e89fb1666 service cinder] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:10:15.635822 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d30ede-3eb7-4c05-96a7-493e89fb1666 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:10:15.644673 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d30ede-3eb7-4c05-96a7-493e89fb1666 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:10:15.646204 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d30ede-3eb7-4c05-96a7-493e89fb1666 service cinder] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:10:15.655277 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1428/2874] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:10:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:10:24.595698 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c9591-190e-4569-8be0-113ff9b8d0dd None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:10:24.655981 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c9591-190e-4569-8be0-113ff9b8d0dd None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:10:24.660466 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227932a-752d-4721-922d-47b7cc087dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:10:24.661349 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227932a-752d-4721-922d-47b7cc087dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:10:24.661633 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227932a-752d-4721-922d-47b7cc087dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:10:24.661905 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227932a-752d-4721-922d-47b7cc087dd9 admin admin] PATH_INFO: `/v3/users/d81ed65fd62b4404846bc251f1064195` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:10:24.663082 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1227932a-752d-4721-922d-47b7cc087dd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d81ed65fd62b4404846bc251f1064195)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:10:24.664977 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1227932a-752d-4721-922d-47b7cc087dd9 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:10:24.884498 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-1227932a-752d-4721-922d-47b7cc087dd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd81ed65fd62b4404846bc251f1064195'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:10:24.891600 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-1227932a-752d-4721-922d-47b7cc087dd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd81ed65fd62b4404846bc251f1064195'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:10:24.892262 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-1227932a-752d-4721-922d-47b7cc087dd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd81ed65fd62b4404846bc251f1064195'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:10:24.892874 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-1227932a-752d-4721-922d-47b7cc087dd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd81ed65fd62b4404846bc251f1064195'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:10:24.983669 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-1227932a-752d-4721-922d-47b7cc087dd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd81ed65fd62b4404846bc251f1064195'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:10:25.000432 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1447/2875] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:10:24 2022] DELETE /identity/v3/users/d81ed65fd62b4404846bc251f1064195 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:10:25.005120 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb6cfd-f50e-403b-82e7-2246d0fa66d5 None None] REQUEST_METHOD: `POST` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:10:25.005622 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb6cfd-f50e-403b-82e7-2246d0fa66d5 None None] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:10:25.005737 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb6cfd-f50e-403b-82e7-2246d0fa66d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:10:25.023082 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.auth.core [None req-d7bb6cfd-f50e-403b-82e7-2246d0fa66d5 None None] MFA Rules not processed for user `a7c8dfde39e84abdb68271d16eaed381`. Rule list: `[]` (Enabled: `True`). {{(pid=90997) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:10:25.024271 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-d7bb6cfd-f50e-403b-82e7-2246d0fa66d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:10:25.079409 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1429/2876] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:10:25.088937 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227932a-752d-4721-922d-47b7cc087dd9 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:10:25.090371 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-1227932a-752d-4721-922d-47b7cc087dd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:10:25.146903 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227932a-752d-4721-922d-47b7cc087dd9 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:10:25.150509 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c8f07-13ba-416d-9cd7-8ff8fdee2f50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:10:25.153156 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c8f07-13ba-416d-9cd7-8ff8fdee2f50 service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:10:25.153156 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c8f07-13ba-416d-9cd7-8ff8fdee2f50 service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:10:25.153156 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c8f07-13ba-416d-9cd7-8ff8fdee2f50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:10:25.160462 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c8f07-13ba-416d-9cd7-8ff8fdee2f50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:10:25.161911 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c8f07-13ba-416d-9cd7-8ff8fdee2f50 service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:10:25.171129 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1448/2877] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:10:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:10:25.562999 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb6cfd-f50e-403b-82e7-2246d0fa66d5 None None] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:10:25.564419 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-d7bb6cfd-f50e-403b-82e7-2246d0fa66d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:10:25.576083 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb6cfd-f50e-403b-82e7-2246d0fa66d5 None None] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:10:25.581341 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9cca7-f6c9-4b18-98f0-15bddb6848d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:10:25.582203 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9cca7-f6c9-4b18-98f0-15bddb6848d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:10:25.582501 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9cca7-f6c9-4b18-98f0-15bddb6848d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:10:25.583654 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9cca7-f6c9-4b18-98f0-15bddb6848d4 admin admin] PATH_INFO: `/v3/projects/b48bec9ebb5c482993c33471f3d92a6b` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:10:25.584113 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac9cca7-f6c9-4b18-98f0-15bddb6848d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b48bec9ebb5c482993c33471f3d92a6b)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:10:25.586135 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac9cca7-f6c9-4b18-98f0-15bddb6848d4 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:10:25.745516 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-9ac9cca7-f6c9-4b18-98f0-15bddb6848d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b48bec9ebb5c482993c33471f3d92a6b', 'request_id': 'req-9ac9cca7-f6c9-4b18-98f0-15bddb6848d4'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:10:25.751370 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-9ac9cca7-f6c9-4b18-98f0-15bddb6848d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b48bec9ebb5c482993c33471f3d92a6b', 'request_id': 'req-9ac9cca7-f6c9-4b18-98f0-15bddb6848d4'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:10:25.756610 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-9ac9cca7-f6c9-4b18-98f0-15bddb6848d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b48bec9ebb5c482993c33471f3d92a6b', 'request_id': 'req-9ac9cca7-f6c9-4b18-98f0-15bddb6848d4'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:10:25.853823 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-9ac9cca7-f6c9-4b18-98f0-15bddb6848d4 admin admin] The token cache is being invalidate because project b48bec9ebb5c482993c33471f3d92a6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:10:25.854161 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-9ac9cca7-f6c9-4b18-98f0-15bddb6848d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:10:25.854818 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-9ac9cca7-f6c9-4b18-98f0-15bddb6848d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:10:25.856434 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1430/2878] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:10:25 2022] DELETE /identity/v3/projects/b48bec9ebb5c482993c33471f3d92a6b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:10:40.846301 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c8f07-13ba-416d-9cd7-8ff8fdee2f50 service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:10:40.854830 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c8f07-13ba-416d-9cd7-8ff8fdee2f50 service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:10:40.901817 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605590e6-6de5-448f-9a65-b0e2a83689d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:10:40.902447 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605590e6-6de5-448f-9a65-b0e2a83689d3 service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:10:40.902724 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605590e6-6de5-448f-9a65-b0e2a83689d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:10:40.902998 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605590e6-6de5-448f-9a65-b0e2a83689d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:10:40.904739 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-605590e6-6de5-448f-9a65-b0e2a83689d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:10:40.913868 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605590e6-6de5-448f-9a65-b0e2a83689d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:10:40.915272 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605590e6-6de5-448f-9a65-b0e2a83689d3 service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:10:40.923032 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1449/2879] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:10:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:11:45.496352 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9cca7-f6c9-4b18-98f0-15bddb6848d4 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:11:45.499430 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-9ac9cca7-f6c9-4b18-98f0-15bddb6848d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:11:45.648194 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9cca7-f6c9-4b18-98f0-15bddb6848d4 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:11:45.654992 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e1795-3414-45b1-a8ab-a0c9a25251d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:11:45.656024 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e1795-3414-45b1-a8ab-a0c9a25251d5 service nova] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:11:45.656761 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e1795-3414-45b1-a8ab-a0c9a25251d5 service nova] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:11:45.659021 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e1795-3414-45b1-a8ab-a0c9a25251d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:11:45.661800 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-d54e1795-3414-45b1-a8ab-a0c9a25251d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:11:45.679097 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e1795-3414-45b1-a8ab-a0c9a25251d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:11:45.681056 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e1795-3414-45b1-a8ab-a0c9a25251d5 service nova] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:11:45.699505 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1431/2880] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:11:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:11:47.441986 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2939c7-c342-449a-9107-6c04937d4105 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:11:47.449129 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2939c7-c342-449a-9107-6c04937d4105 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:11:47.449129 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2939c7-c342-449a-9107-6c04937d4105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:11:47.465447 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-da2939c7-c342-449a-9107-6c04937d4105 None None] MFA Rules not processed for user `86bfbcae996a457ebe52d8c2fb7bafe4`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:11:47.467141 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-da2939c7-c342-449a-9107-6c04937d4105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:11:47.526906 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1450/2881] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:11:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:11:48.087169 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e1795-3414-45b1-a8ab-a0c9a25251d5 service nova] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:11:48.088550 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-d54e1795-3414-45b1-a8ab-a0c9a25251d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:11:48.121809 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e1795-3414-45b1-a8ab-a0c9a25251d5 service nova] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:11:48.125536 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecb23c-b150-46a7-81f4-c14cf8a107ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:11:48.126192 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecb23c-b150-46a7-81f4-c14cf8a107ea service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:11:48.126477 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecb23c-b150-46a7-81f4-c14cf8a107ea service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:11:48.126757 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecb23c-b150-46a7-81f4-c14cf8a107ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:11:48.128596 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-05ecb23c-b150-46a7-81f4-c14cf8a107ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:11:48.142223 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ecb23c-b150-46a7-81f4-c14cf8a107ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:11:48.148445 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ecb23c-b150-46a7-81f4-c14cf8a107ea service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:11:48.157558 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1432/2882] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:11:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:11:48.933820 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2939c7-c342-449a-9107-6c04937d4105 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:11:48.935230 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-da2939c7-c342-449a-9107-6c04937d4105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:11:49.004210 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2939c7-c342-449a-9107-6c04937d4105 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:11:49.009021 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9683c-f129-42c0-8150-a4932976d891 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8847b97a7089420a8b8b817f3059c660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:11:49.009678 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9683c-f129-42c0-8150-a4932976d891 service placement] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:11:49.009958 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9683c-f129-42c0-8150-a4932976d891 service placement] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:11:49.010231 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9683c-f129-42c0-8150-a4932976d891 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:11:49.011959 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-fbf9683c-f129-42c0-8150-a4932976d891 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:11:49.023451 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9683c-f129-42c0-8150-a4932976d891 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:11:49.024949 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9683c-f129-42c0-8150-a4932976d891 service placement] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:11:49.035154 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1451/2883] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:11:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:12:05.135978 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecb23c-b150-46a7-81f4-c14cf8a107ea service neutron] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:12:05.150223 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecb23c-b150-46a7-81f4-c14cf8a107ea service neutron] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:12:05.155796 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70cc8d-36e4-4d19-bfc6-339d0d6ee870 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:12:05.156433 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70cc8d-36e4-4d19-bfc6-339d0d6ee870 service nova] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:12:05.156747 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70cc8d-36e4-4d19-bfc6-339d0d6ee870 service nova] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:12:05.157000 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70cc8d-36e4-4d19-bfc6-339d0d6ee870 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:12:05.158815 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-0e70cc8d-36e4-4d19-bfc6-339d0d6ee870 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:12:05.170974 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e70cc8d-36e4-4d19-bfc6-339d0d6ee870 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:12:05.174096 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e70cc8d-36e4-4d19-bfc6-339d0d6ee870 service nova] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:12:05.183066 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1433/2884] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:12:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:12:09.564862 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9683c-f129-42c0-8150-a4932976d891 service placement] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:12:09.577570 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9683c-f129-42c0-8150-a4932976d891 service placement] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:12:09.583546 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840f25d-fda2-4542-9ae9-7fc57347a063 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:12:09.584180 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840f25d-fda2-4542-9ae9-7fc57347a063 service nova] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:12:09.584462 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840f25d-fda2-4542-9ae9-7fc57347a063 service nova] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:12:09.584843 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840f25d-fda2-4542-9ae9-7fc57347a063 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:12:09.586604 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-9840f25d-fda2-4542-9ae9-7fc57347a063 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:12:09.600156 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840f25d-fda2-4542-9ae9-7fc57347a063 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:12:09.601706 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840f25d-fda2-4542-9ae9-7fc57347a063 service nova] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:12:09.612138 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1452/2885] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:12:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:13:42.040056 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70cc8d-36e4-4d19-bfc6-339d0d6ee870 service nova] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:13:42.041514 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-0e70cc8d-36e4-4d19-bfc6-339d0d6ee870 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:13:42.075780 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70cc8d-36e4-4d19-bfc6-339d0d6ee870 service nova] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:13:42.081261 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3b6ab-b571-4fd7-9bea-70142d179334 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8847b97a7089420a8b8b817f3059c660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:13:42.081897 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3b6ab-b571-4fd7-9bea-70142d179334 service placement] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:13:42.082179 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3b6ab-b571-4fd7-9bea-70142d179334 service placement] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:13:42.082459 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3b6ab-b571-4fd7-9bea-70142d179334 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:13:42.084189 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-d3d3b6ab-b571-4fd7-9bea-70142d179334 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:13:42.096200 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3b6ab-b571-4fd7-9bea-70142d179334 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:13:42.097840 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3b6ab-b571-4fd7-9bea-70142d179334 service placement] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:13:42.107385 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1434/2886] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:13:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:13:43.825499 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58f061-b3e1-4529-98f1-c8a8ddbbfd39 None None] REQUEST_METHOD: `POST` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:13:43.826040 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58f061-b3e1-4529-98f1-c8a8ddbbfd39 None None] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:13:43.826040 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58f061-b3e1-4529-98f1-c8a8ddbbfd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:13:43.843268 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.auth.core [None req-de58f061-b3e1-4529-98f1-c8a8ddbbfd39 None None] MFA Rules not processed for user `86bfbcae996a457ebe52d8c2fb7bafe4`. Rule list: `[]` (Enabled: `True`). {{(pid=90996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 05 15:13:43.844475 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-de58f061-b3e1-4529-98f1-c8a8ddbbfd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:13:43.851516 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1453/2887] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jan 5 15:13:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 05 15:13:59.704680 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3b6ab-b571-4fd7-9bea-70142d179334 service placement] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:13:59.706090 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-d3d3b6ab-b571-4fd7-9bea-70142d179334 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:13:59.748463 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3b6ab-b571-4fd7-9bea-70142d179334 service placement] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:13:59.753953 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77295223-af4d-40d8-8927-161d30fdb281 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77db235e2f7046e4bdbad7f31b5e3ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:13:59.754586 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77295223-af4d-40d8-8927-161d30fdb281 service nova] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:13:59.754867 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77295223-af4d-40d8-8927-161d30fdb281 service nova] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:13:59.755141 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77295223-af4d-40d8-8927-161d30fdb281 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:13:59.756885 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-77295223-af4d-40d8-8927-161d30fdb281 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:13:59.766869 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77295223-af4d-40d8-8927-161d30fdb281 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:13:59.768441 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77295223-af4d-40d8-8927-161d30fdb281 service nova] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:13:59.777087 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1435/2888] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:13:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:15:40.656885 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58f061-b3e1-4529-98f1-c8a8ddbbfd39 None None] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:15:40.667387 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58f061-b3e1-4529-98f1-c8a8ddbbfd39 None None] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:15:40.671122 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f7d0a-5a3c-4ca3-86f2-a6f7c16832d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:15:40.672271 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f7d0a-5a3c-4ca3-86f2-a6f7c16832d8 service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:15:40.672585 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f7d0a-5a3c-4ca3-86f2-a6f7c16832d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:15:40.672895 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f7d0a-5a3c-4ca3-86f2-a6f7c16832d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:15:40.682860 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f7d0a-5a3c-4ca3-86f2-a6f7c16832d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:15:40.686890 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f7d0a-5a3c-4ca3-86f2-a6f7c16832d8 service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:15:40.694075 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1454/2889] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:15:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:15:40.959591 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77295223-af4d-40d8-8927-161d30fdb281 service nova] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:15:40.969754 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77295223-af4d-40d8-8927-161d30fdb281 service nova] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:15:40.973555 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e811a-3887-4342-8b71-47a0fc5d174f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:15:40.974181 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e811a-3887-4342-8b71-47a0fc5d174f service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:15:40.974459 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e811a-3887-4342-8b71-47a0fc5d174f service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:15:40.974736 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e811a-3887-4342-8b71-47a0fc5d174f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:15:40.976455 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-192e811a-3887-4342-8b71-47a0fc5d174f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:15:40.991288 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e811a-3887-4342-8b71-47a0fc5d174f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:15:40.992891 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e811a-3887-4342-8b71-47a0fc5d174f service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:15:41.004455 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1436/2890] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:15:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:15:42.265049 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f7d0a-5a3c-4ca3-86f2-a6f7c16832d8 service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:15:42.266837 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-f81f7d0a-5a3c-4ca3-86f2-a6f7c16832d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:15:42.278158 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f7d0a-5a3c-4ca3-86f2-a6f7c16832d8 service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:15:42.282216 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120ac3a-9755-4c5f-9ff3-d4ec5c31fa60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:15:42.282837 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120ac3a-9755-4c5f-9ff3-d4ec5c31fa60 service neutron] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:15:42.283115 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120ac3a-9755-4c5f-9ff3-d4ec5c31fa60 service neutron] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:15:42.283390 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120ac3a-9755-4c5f-9ff3-d4ec5c31fa60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:15:42.285054 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-3120ac3a-9755-4c5f-9ff3-d4ec5c31fa60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:15:42.298388 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3120ac3a-9755-4c5f-9ff3-d4ec5c31fa60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:15:42.299792 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3120ac3a-9755-4c5f-9ff3-d4ec5c31fa60 service neutron] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:15:42.310220 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1455/2891] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:15:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:15:56.066575 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e811a-3887-4342-8b71-47a0fc5d174f service neutron] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:15:56.075389 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e811a-3887-4342-8b71-47a0fc5d174f service neutron] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:15:56.079565 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7971a8-7242-4d1c-a532-d7cf64fc169e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6234d716a014808a8a4eb22b903bbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:15:56.080197 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7971a8-7242-4d1c-a532-d7cf64fc169e service neutron] REQUEST_METHOD: `GET` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:15:56.080484 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7971a8-7242-4d1c-a532-d7cf64fc169e service neutron] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:15:56.080763 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7971a8-7242-4d1c-a532-d7cf64fc169e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:15:56.082567 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-cc7971a8-7242-4d1c-a532-d7cf64fc169e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:15:56.161901 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7971a8-7242-4d1c-a532-d7cf64fc169e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:15:56.163336 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7971a8-7242-4d1c-a532-d7cf64fc169e service neutron] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:15:56.181026 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1437/2892] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:15:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 05 15:16:03.336618 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120ac3a-9755-4c5f-9ff3-d4ec5c31fa60 service neutron] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:16:03.338130 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-3120ac3a-9755-4c5f-9ff3-d4ec5c31fa60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:16:03.352359 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120ac3a-9755-4c5f-9ff3-d4ec5c31fa60 service neutron] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:16:03.356822 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29e28f-6242-430a-bc57-cd664cc5ea4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:16:03.357807 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29e28f-6242-430a-bc57-cd664cc5ea4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:16:03.358090 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29e28f-6242-430a-bc57-cd664cc5ea4e admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:16:03.358458 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29e28f-6242-430a-bc57-cd664cc5ea4e admin admin] PATH_INFO: `/v3/users/86bfbcae996a457ebe52d8c2fb7bafe4` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:16:03.359637 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29e28f-6242-430a-bc57-cd664cc5ea4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=86bfbcae996a457ebe52d8c2fb7bafe4)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:16:03.361584 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29e28f-6242-430a-bc57-cd664cc5ea4e admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:16:03.543525 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-cb29e28f-6242-430a-bc57-cd664cc5ea4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86bfbcae996a457ebe52d8c2fb7bafe4'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:16:03.550076 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-cb29e28f-6242-430a-bc57-cd664cc5ea4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86bfbcae996a457ebe52d8c2fb7bafe4'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:16:03.550732 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-cb29e28f-6242-430a-bc57-cd664cc5ea4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86bfbcae996a457ebe52d8c2fb7bafe4'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:16:03.551336 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-cb29e28f-6242-430a-bc57-cd664cc5ea4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86bfbcae996a457ebe52d8c2fb7bafe4'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:16:03.615413 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-cb29e28f-6242-430a-bc57-cd664cc5ea4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86bfbcae996a457ebe52d8c2fb7bafe4'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:16:03.635113 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1456/2893] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:16:03 2022] DELETE /identity/v3/users/86bfbcae996a457ebe52d8c2fb7bafe4 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:16:03.864604 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7971a8-7242-4d1c-a532-d7cf64fc169e service neutron] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:16:03.874826 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7971a8-7242-4d1c-a532-d7cf64fc169e service neutron] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:16:03.930316 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afd715-95ff-471b-87b5-3ba5b963eaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:16:03.931160 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afd715-95ff-471b-87b5-3ba5b963eaf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:16:03.931439 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afd715-95ff-471b-87b5-3ba5b963eaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:16:03.931708 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afd715-95ff-471b-87b5-3ba5b963eaf4 admin admin] PATH_INFO: `/v3/projects/4ed05f9412d9477ea62f75cd05af148b` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:16:03.932871 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afd715-95ff-471b-87b5-3ba5b963eaf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ed05f9412d9477ea62f75cd05af148b)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:16:03.934827 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afd715-95ff-471b-87b5-3ba5b963eaf4 admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:16:04.056537 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-75afd715-95ff-471b-87b5-3ba5b963eaf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ed05f9412d9477ea62f75cd05af148b', 'request_id': 'req-75afd715-95ff-471b-87b5-3ba5b963eaf4'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:16:04.063059 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-75afd715-95ff-471b-87b5-3ba5b963eaf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ed05f9412d9477ea62f75cd05af148b', 'request_id': 'req-75afd715-95ff-471b-87b5-3ba5b963eaf4'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:16:04.068202 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-75afd715-95ff-471b-87b5-3ba5b963eaf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ed05f9412d9477ea62f75cd05af148b', 'request_id': 'req-75afd715-95ff-471b-87b5-3ba5b963eaf4'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:16:04.136827 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-75afd715-95ff-471b-87b5-3ba5b963eaf4 admin admin] The token cache is being invalidate because project 4ed05f9412d9477ea62f75cd05af148b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:16:04.137150 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-75afd715-95ff-471b-87b5-3ba5b963eaf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:16:04.137783 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-75afd715-95ff-471b-87b5-3ba5b963eaf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:16:04.139313 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1438/2894] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:16:03 2022] DELETE /identity/v3/projects/4ed05f9412d9477ea62f75cd05af148b => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:16:04.143601 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29e28f-6242-430a-bc57-cd664cc5ea4e admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:16:04.145141 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-cb29e28f-6242-430a-bc57-cd664cc5ea4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:16:04.157789 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29e28f-6242-430a-bc57-cd664cc5ea4e admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:16:04.212454 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6f222-64ce-4978-a623-099b4c34bd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:16:04.213351 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6f222-64ce-4978-a623-099b4c34bd09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:16:04.213637 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6f222-64ce-4978-a623-099b4c34bd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:16:04.213912 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6f222-64ce-4978-a623-099b4c34bd09 admin admin] PATH_INFO: `/v3/users/583756335017412e8902888f32cf17f0` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:16:04.215097 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6f222-64ce-4978-a623-099b4c34bd09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=583756335017412e8902888f32cf17f0)` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:16:04.217035 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6f222-64ce-4978-a623-099b4c34bd09 admin admin] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:16:04.420254 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-21f6f222-64ce-4978-a623-099b4c34bd09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '583756335017412e8902888f32cf17f0'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:16:04.428058 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-21f6f222-64ce-4978-a623-099b4c34bd09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '583756335017412e8902888f32cf17f0'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:16:04.428727 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-21f6f222-64ce-4978-a623-099b4c34bd09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '583756335017412e8902888f32cf17f0'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:16:04.429394 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-21f6f222-64ce-4978-a623-099b4c34bd09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '583756335017412e8902888f32cf17f0'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:16:04.503305 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.notifications [None req-21f6f222-64ce-4978-a623-099b4c34bd09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '583756335017412e8902888f32cf17f0'} {{(pid=90996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:16:04.521241 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1457/2895] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jan 5 15:16:04 2022] DELETE /identity/v3/users/583756335017412e8902888f32cf17f0 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:16:04.750785 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afd715-95ff-471b-87b5-3ba5b963eaf4 admin admin] Authenticating user token {{(pid=90997) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:16:04.752377 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.fernet_utils [None req-75afd715-95ff-471b-87b5-3ba5b963eaf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90997) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:16:04.765210 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afd715-95ff-471b-87b5-3ba5b963eaf4 admin admin] Validating token access rules against request {{(pid=90997) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:16:04.820221 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbb385-9804-461b-b5a3-6605649952fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c8dfde39e84abdb68271d16eaed381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90997) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:16:04.821105 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbb385-9804-461b-b5a3-6605649952fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:16:04.821398 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbb385-9804-461b-b5a3-6605649952fc admin admin] SCRIPT_NAME: `/identity` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:16:04.821676 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbb385-9804-461b-b5a3-6605649952fc admin admin] PATH_INFO: `/v3/projects/27c841a04bb44a3cae004da17444831e` {{(pid=90997) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:16:04.822865 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbb385-9804-461b-b5a3-6605649952fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=27c841a04bb44a3cae004da17444831e)` {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:16:04.824768 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbb385-9804-461b-b5a3-6605649952fc admin admin] RBAC: Authorization granted {{(pid=90997) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:16:04.930876 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-facbb385-9804-461b-b5a3-6605649952fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27c841a04bb44a3cae004da17444831e', 'request_id': 'req-facbb385-9804-461b-b5a3-6605649952fc'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:16:04.937409 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-facbb385-9804-461b-b5a3-6605649952fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27c841a04bb44a3cae004da17444831e', 'request_id': 'req-facbb385-9804-461b-b5a3-6605649952fc'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:16:04.942619 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-facbb385-9804-461b-b5a3-6605649952fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27c841a04bb44a3cae004da17444831e', 'request_id': 'req-facbb385-9804-461b-b5a3-6605649952fc'} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:16:05.037884 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-facbb385-9804-461b-b5a3-6605649952fc admin admin] The token cache is being invalidate because project 27c841a04bb44a3cae004da17444831e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90997) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 05 15:16:05.038092 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-facbb385-9804-461b-b5a3-6605649952fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:16:05.038713 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: DEBUG keystone.notifications [None req-facbb385-9804-461b-b5a3-6605649952fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90997) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 05 15:16:05.040268 dv-cinder-master-3-iscsi devstack@keystone.service[90997]: [pid: 90997|app: 0|req: 1439/2896] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jan 5 15:16:04 2022] DELETE /identity/v3/projects/27c841a04bb44a3cae004da17444831e => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 05 15:18:47.387388 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6f222-64ce-4978-a623-099b4c34bd09 admin admin] Authenticating user token {{(pid=90996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 05 15:18:47.388789 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-21f6f222-64ce-4978-a623-099b4c34bd09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:18:47.455704 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6f222-64ce-4978-a623-099b4c34bd09 admin admin] Validating token access rules against request {{(pid=90996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 05 15:18:47.512425 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63789a-dd8d-433c-9ac4-0d24aab4ad20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8847b97a7089420a8b8b817f3059c660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbf90e947f3a4fcdb6f42646a4bf34a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 05 15:18:47.513091 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63789a-dd8d-433c-9ac4-0d24aab4ad20 service placement] REQUEST_METHOD: `GET` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 05 15:18:47.513386 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63789a-dd8d-433c-9ac4-0d24aab4ad20 service placement] SCRIPT_NAME: `/identity` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 05 15:18:47.513663 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63789a-dd8d-433c-9ac4-0d24aab4ad20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 05 15:18:47.515460 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.fernet_utils [None req-ce63789a-dd8d-433c-9ac4-0d24aab4ad20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 05 15:18:47.526996 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63789a-dd8d-433c-9ac4-0d24aab4ad20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 05 15:18:47.528571 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63789a-dd8d-433c-9ac4-0d24aab4ad20 service placement] RBAC: Authorization granted {{(pid=90996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 05 15:18:47.538790 dv-cinder-master-3-iscsi devstack@keystone.service[90996]: [pid: 90996|app: 0|req: 1458/2897] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jan 5 15:18:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)